00000100:00100000:1.0F:1789498706.880796:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789498706.880828:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076aa20c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916153088:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789498706.880896:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498706.880963:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916152960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789498706.880989:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0F:1789498706.881050:0:17832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916153088 00000100:00100000:0.0:1789498706.881067:0:17832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916153088 00000100:00100000:0.0:1789498706.881128:0:17832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916152960 00000100:00100000:0.0:1789498706.881132:0:17832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916152960 00000100:00100000:0.0:1789498706.881149:0:17832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789498706.881157:0:17832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916153088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789498706.881204:0:17832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789498706.881252:0:17832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916153088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498706.881260:0:17832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789498706.881280:0:17832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789498706.881287:0:17832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916152960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789498706.881304:0:17832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1789498706.881333:0:17832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916152960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 46us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498706.881338:0:17832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789498706.881379:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076aa20c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916153088:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789498706.881391:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916152960:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789498707.262268:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0F:1789498707.843437:0:17845:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789498708.286388:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498708.411952:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20dec396-e124-4c94-9424-ae01f240e87e:3643:1876424916153216:0@lo:400:kworker.0 00000100:00100000:2.0:1789498708.412038:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498708.412086:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588198a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876424916153728:0@lo:400:kworker.0 00000100:00100000:2.0:1789498708.412115:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498708.412134:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876424916154240:0@lo:400:kworker.0 00000100:00100000:2.0:1789498708.412171:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498708.412187:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876424916154752:0@lo:400:kworker.0 00000100:00100000:2.0:1789498708.412206:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498708.412226:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789498708.412232:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916153344:0@lo:400:kworker.0 00000100:00100000:2.0:1789498708.412270:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498708.412288:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916153856:0@lo:400:kworker.0 00000100:00100000:2.0:1789498708.412306:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498708.412320:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588199880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876424916154368:0@lo:400:kworker.0 00000100:00100000:2.0:1789498708.412357:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498708.412400:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916153216 00000100:00100000:2.0:1789498708.412409:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916153216 00000100:00100000:2.0:1789498708.412460:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789498708.412469:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc429c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20dec396-e124-4c94-9424-ae01f240e87e+24:3643:x1876424916153216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498708.412521:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc429c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:20dec396-e124-4c94-9424-ae01f240e87e+24:3643:x1876424916153216:12345-0@lo:400:kworker.0 Request processed in 53us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498708.412529:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789498708.412588:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916153728 00000100:00100000:2.0:1789498708.412592:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916153728 00000100:00100000:2.0:1789498708.412899:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916154240 00000100:00100000:2.0:1789498708.412904:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916154240 00000100:00100000:2.0:1789498708.412927:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916154752 00000100:00100000:2.0:1789498708.412930:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916154752 00000100:00100000:2.0:1789498708.412952:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916154368 00000100:00100000:2.0:1789498708.412955:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916154368 00000100:00100000:2.0:1789498708.412970:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789498708.412976:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876424916153728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498708.413026:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876424916153728:12345-0@lo:400:kworker.0 Request processed in 50us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498708.413032:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789498708.413045:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789498708.413051:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0768524a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876424916154240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498708.413129:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0768524a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876424916154240:12345-0@lo:400:kworker.0 Request processed in 79us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498708.413197:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789498708.413212:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789498708.413219:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0768524a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876424916154752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498708.413250:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0768524a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876424916154752:12345-0@lo:400:kworker.0 Request processed in 33us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498708.413256:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789498708.413268:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789498708.413273:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876424916154368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498708.413299:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876424916154368:12345-0@lo:400:kworker.0 Request processed in 25us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498708.413304:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789498708.413327:0:17832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916153344 00000100:00100000:2.0:1789498708.413331:0:17832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916153344 00000100:00100000:2.0:1789498708.413354:0:17832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916153856 00000100:00100000:2.0:1789498708.413364:0:17832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916153856 00000100:00100000:2.0:1789498708.413380:0:17832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789498708.413386:0:17832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876424916153344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498708.413419:0:17832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876424916153344:12345-0@lo:400:kworker.0 Request processed in 33us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498708.413425:0:17832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789498708.413436:0:17832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789498708.413443:0:17832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916153856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498708.413469:0:17832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916153856:12345-0@lo:400:kworker.0 Request processed in 27us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498708.413475:0:17832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1789498708.413505:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789498708.413509:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789498708.413567:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916153344:0@lo:400:kworker.0 00000100:00100000:2.0:1789498708.413577:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588198380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916153856:0@lo:400:kworker.0 00000100:00100000:2.0:1789498708.413587:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588199880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876424916154368:0@lo:400:kworker.0 00000100:00100000:2.0:1789498708.413596:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20dec396-e124-4c94-9424-ae01f240e87e:3643:1876424916153216:0@lo:400:kworker.0 00000100:00100000:2.0:1789498708.413604:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588198a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876424916153728:0@lo:400:kworker.0 00000100:00100000:1.0:1789498708.413800:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916153472:0@lo:400:kworker.0 00000100:00100000:1.0:1789498708.413835:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498708.413857:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916153984:0@lo:400:kworker.0 00000100:00100000:1.0:1789498708.413879:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498708.413894:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876424916154496:0@lo:400:kworker.0 00000100:00100000:1.0:1789498708.413915:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498708.413935:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789498708.413942:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916153600:0@lo:400:kworker.0 00000100:00100000:1.0:1789498708.413962:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498708.413978:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916154112:0@lo:400:kworker.0 00000100:00100000:1.0:1789498708.414011:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498708.414029:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1876424916154624:0@lo:400:kworker.0 00000100:00100000:1.0:1789498708.414049:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498708.414118:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876424916154240:0@lo:400:kworker.0 00010000:00080000:2.0:1789498708.414134:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0758819a300 x1876424916154752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498708.414211:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876424916154752:0@lo:400:kworker.0 00000100:00100000:2.0:1789498708.414429:0:19084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916153472 00000100:00100000:2.0:1789498708.414443:0:19084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916153472 00000100:00100000:2.0:1789498708.414479:0:19084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916153984 00000100:00100000:2.0:1789498708.414482:0:19084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916153984 00000100:00100000:2.0:1789498708.414494:0:19084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916153600 00000100:00100000:2.0:1789498708.414496:0:19084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916153600 00000100:00100000:2.0:1789498708.414507:0:19084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916154112 00000100:00100000:2.0:1789498708.414509:0:19084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916154112 00000100:00100000:2.0:1789498708.414522:0:19084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789498708.414529:0:19084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916153472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498708.414596:0:19084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916153472:12345-0@lo:400:kworker.0 Request processed in 67us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498708.414603:0:19084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789498708.414689:0:19084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789498708.414697:0:19084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c1619f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916153984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498708.414727:0:19084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c1619f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916153984:12345-0@lo:400:kworker.0 Request processed in 32us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498708.414733:0:19084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789498708.414744:0:19084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789498708.414750:0:19084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c1619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916153600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498708.414775:0:19084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c1619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916153600:12345-0@lo:400:kworker.0 Request processed in 26us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498708.414781:0:19084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789498708.414792:0:19084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789498708.414797:0:19084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c1619880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916154112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498708.414824:0:19084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c1619880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916154112:12345-0@lo:400:kworker.0 Request processed in 27us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498708.414829:0:19084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789498708.414853:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916154496 00000100:00100000:2.0:1789498708.414857:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916154496 00000100:00100000:2.0:1789498708.414881:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916154624 00000100:00100000:2.0:1789498708.414884:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916154624 00000100:00100000:2.0:1789498708.414901:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789498708.414907:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c161a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876424916154496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498708.414936:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c161a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876424916154496:12345-0@lo:400:kworker.0 Request processed in 30us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498708.414942:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789498708.414953:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789498708.414959:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9ca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876424916154624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498708.414996:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9ca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876424916154624:12345-0@lo:400:kworker.0 Request processed in 37us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498708.415001:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1789498708.415021:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789498708.415025:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789498708.415028:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789498708.415030:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789498708.415054:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588198e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916153600:0@lo:400:kworker.0 00000100:00100000:2.0:1789498708.415064:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588199180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916154112:0@lo:400:kworker.0 00000100:00100000:2.0:1789498708.415073:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1876424916154624:0@lo:400:kworker.0 00000100:00100000:2.0:1789498708.415082:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916153472:0@lo:400:kworker.0 00000100:00100000:2.0:1789498708.415091:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588199f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916153984:0@lo:400:kworker.0 00010000:00080000:2.0:1789498708.415101:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0758819b800 x1876424916154496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498708.415122:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876424916154496:0@lo:400:kworker.0 00000100:00100000:1.0:1789498708.415733:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076aa20c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876424916154880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789498708.415775:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498708.416995:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916154880 00000100:00100000:2.0:1789498708.417003:0:18601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916154880 00000100:00100000:2.0:1789498708.417047:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789498708.417056:0:18601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9ca7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876424916154880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789498708.417084:0:18601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1789498708.417422:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916155008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498708.417457:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498708.417507:0:19589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916155008 00000100:00100000:1.0:1789498708.417511:0:19589:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916155008 00000100:00100000:1.0:1789498708.417550:0:19589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789498708.417557:0:19589:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9ca6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916155008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789498708.417569:0:19589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1789498708.417601:0:19589:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9ca6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916155008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498708.417607:0:19589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789498708.417666:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916155008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498708.419003:0:18601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9ca7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876424916154880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1942us (3221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498708.419014:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789498708.419079:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076aa20c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876424916154880:0@lo:13:osp-pre-1-1.0 00000001:00080000:1.0:1789498708.926170:0:17070:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:1.0:1789498708.926193:0:17070:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa07683674b40 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:1.0:1789498708.926200:0:17070:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa076bbe29800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa07683674540 00000020:00080000:1.0:1789498708.926203:0:17070:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa076bbe29000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa07588295a00 00000020:00080000:3.0F:1789498708.926328:0:17131:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:3.0:1789498708.926419:0:17131:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1789498708.926509:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa076c1571400/0x70d6b5fa1825e166 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498708.926522:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa076c1571400/0x70d6b5fa1825e166 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498708.926544:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa076c1571400/0x70d6b5fa1825e166 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498708.926551:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c1571400 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:0.0:1789498708.926556:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa076c1571400/0x70d6b5fa1825e166 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498708.926563:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa076c1571400/0x70d6b5fa1825e166 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498708.926589:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa07587435900) 00010000:00010000:0.0:1789498708.926592:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789498708.926597:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa076c1571400/0x70d6b5fa1825e166 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498708.926604:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa076c1571400/0x70d6b5fa1825e166 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19316 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498709.323744:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498709.457915:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498709.457974:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498709.458005:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498709.458030:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498709.458049:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498709.458066:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498709.458083:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498709.458115:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498709.458194:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498709.458228:0:20242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896160896 00000100:00100000:1.0:1789498709.458246:0:20242:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896160896 00000100:00100000:1.0:1789498709.458304:0:20242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896160768 00000100:00100000:1.0:1789498709.458319:0:20242:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896160768 00000100:00100000:1.0:1789498709.458337:0:20242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896161280 00000100:00100000:1.0:1789498709.458350:0:20242:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896161280 00000100:00100000:1.0:1789498709.458379:0:20242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896161408 00000100:00100000:1.0:1789498709.458382:0:20242:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896161408 00000100:00100000:1.0:1789498709.458402:0:20242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 74 00000100:00100000:1.0:1789498709.458412:0:20242:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e628490-3532-4bd6-bd50-78c84d98cfb9+5:2392:x1876424896160896:12345-192.168.204.17@tcp:400:kworker.0 00000100:00100000:1.0:1789498709.458492:0:20242:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e628490-3532-4bd6-bd50-78c84d98cfb9+5:2392:x1876424896160896:12345-192.168.204.17@tcp:400:kworker.0 Request processed in 81us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498709.458501:0:20242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 74 00000100:00100000:1.0:1789498709.458522:0:20242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 75 00000100:00100000:1.0:1789498709.458529:0:20242:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e628490-3532-4bd6-bd50-78c84d98cfb9+13:2392:x1876424896160768:12345-192.168.204.17@tcp:400:kworker.0 00000100:00100000:1.0:1789498709.458874:0:20242:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e628490-3532-4bd6-bd50-78c84d98cfb9+13:2392:x1876424896160768:12345-192.168.204.17@tcp:400:kworker.0 Request processed in 343us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498709.458881:0:20242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 75 00000100:00100000:1.0:1789498709.458895:0:20242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 76 00000100:00100000:1.0:1789498709.458902:0:20242:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075856fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:009e7412-2a14-4c71-98d7-be20ea80e3db+6:2393:x1876424896161280:12345-192.168.204.17@tcp:400:kworker.0 00000100:00100000:1.0:1789498709.458926:0:20242:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075856fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:009e7412-2a14-4c71-98d7-be20ea80e3db+6:2393:x1876424896161280:12345-192.168.204.17@tcp:400:kworker.0 Request processed in 25us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498709.458932:0:20242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 76 00000100:00100000:1.0:1789498709.458942:0:20242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 77 00000100:00100000:1.0:1789498709.458948:0:20242:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075856fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:009e7412-2a14-4c71-98d7-be20ea80e3db+5:2392:x1876424896161408:12345-192.168.204.17@tcp:400:kworker.0 00000100:00100000:1.0:1789498709.458986:0:20242:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075856fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:009e7412-2a14-4c71-98d7-be20ea80e3db+5:2392:x1876424896161408:12345-192.168.204.17@tcp:400:kworker.0 Request processed in 37us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498709.458992:0:20242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 77 00000100:00100000:1.0:1789498709.459011:0:19084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896161152 00000100:00100000:1.0:1789498709.459021:0:19084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896161152 00000100:00100000:1.0:1789498709.459049:0:19084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896161024 00000100:00100000:1.0:1789498709.459051:0:19084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896161024 00000100:00100000:1.0:1789498709.459062:0:19084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896161536 00000100:00100000:1.0:1789498709.459064:0:19084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896161536 00000100:00100000:1.0:1789498709.459072:0:19084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896161664 00000100:00100000:1.0:1789498709.459074:0:19084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896161664 00000100:00100000:1.0:1789498709.459085:0:19084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 32 00000100:00100000:1.0:1789498709.459090:0:19084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075856fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e628490-3532-4bd6-bd50-78c84d98cfb9+5:2392:x1876424896161152:12345-192.168.204.17@tcp:400:kworker.0 00000100:00100000:1.0:1789498709.459115:0:19084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075856fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e628490-3532-4bd6-bd50-78c84d98cfb9+5:2392:x1876424896161152:12345-192.168.204.17@tcp:400:kworker.0 Request processed in 24us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498709.459121:0:19084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 32 00000100:00100000:1.0:1789498709.459133:0:19084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 30 00000100:00100000:1.0:1789498709.459140:0:19084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075856fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e628490-3532-4bd6-bd50-78c84d98cfb9+5:2391:x1876424896161024:12345-192.168.204.17@tcp:9:kworker.0 00000020:00000080:1.0:1789498709.459157:0:19084:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825de95 00000100:00080000:1.0:1789498709.459173:0:19084:0:(import.c:65:import_set_state_nolock()) ffffa07587228000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789498709.459216:0:19084:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1789498709.463066:0:19084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075856fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e628490-3532-4bd6-bd50-78c84d98cfb9+2:2391:x1876424896161024:12345-192.168.204.17@tcp:9:kworker.0 Request processed in 3915us (4970us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498709.463081:0:19084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 30 00000100:00100000:1.0:1789498709.463110:0:19084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 31 00000100:00100000:1.0:1789498709.463122:0:19084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075856fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:009e7412-2a14-4c71-98d7-be20ea80e3db+5:2391:x1876424896161536:12345-192.168.204.17@tcp:9:kworker.0 00000020:00000080:1.0:1789498709.463151:0:19084:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825ded4 00000100:00080000:1.0:1789498709.463161:0:19084:0:(import.c:65:import_set_state_nolock()) ffffa075875a0000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789498709.463214:0:19084:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1789498709.463289:0:19084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075856fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:009e7412-2a14-4c71-98d7-be20ea80e3db+2:2391:x1876424896161536:12345-192.168.204.17@tcp:9:kworker.0 Request processed in 170us (5172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498709.463325:0:19084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 31 00000100:00100000:1.0:1789498709.463340:0:19084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 32 00000100:00100000:1.0:1789498709.464013:0:19084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075856ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:009e7412-2a14-4c71-98d7-be20ea80e3db+5:2391:x1876424896161664:12345-192.168.204.17@tcp:9:kworker.0 00000020:00000080:1.0:1789498709.464066:0:19084:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825dedb 00000100:00080000:1.0:1789498709.464102:0:19084:0:(import.c:65:import_set_state_nolock()) ffffa075875a3800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789498709.464165:0:19084:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1789498709.464862:0:19084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075856ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:009e7412-2a14-4c71-98d7-be20ea80e3db+2:2391:x1876424896161664:12345-192.168.204.17@tcp:9:kworker.0 Request processed in 854us (6666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498709.464872:0:19084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 32 00000100:00080000:1.0:1789498709.464921:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789498709.464926:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789498709.464929:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789498709.464932:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789498709.465001:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498709.465879:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896160640 00000100:00100000:2.0:1789498709.465888:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896160640 00000100:00100000:2.0:1789498709.465932:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 169 00000100:00100000:2.0:1789498709.465941:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc429850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d9110ca-e4e1-41f3-8b8d-d4ddfb2e552d+13:2392:x1876424896160640:12345-192.168.204.17@tcp:400:kworker.0 00000100:00100000:2.0:1789498709.466000:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc429850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d9110ca-e4e1-41f3-8b8d-d4ddfb2e552d+13:2392:x1876424896160640:12345-192.168.204.17@tcp:400:kworker.0 Request processed in 60us (8096us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498709.466007:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 169 00010000:00010000:0.0:1789498709.466702:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498709.466709:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498710.106735:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498710.107325:0:20242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896161792 00000100:00100000:2.0:1789498710.107336:0:20242:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896161792 00000100:00100000:2.0:1789498710.107401:0:20242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 65 00000100:00100000:2.0:1789498710.107411:0:20242:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075882eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e628490-3532-4bd6-bd50-78c84d98cfb9+13:15561:x1876424896161792:12345-192.168.204.17@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789498710.107591:0:20242:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075882eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e628490-3532-4bd6-bd50-78c84d98cfb9+13:15561:x1876424896161792:12345-192.168.204.17@tcp:60:lhsmtool_posix.0 Request processed in 122us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498710.107600:0:20242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 65 00000100:00100000:2.0:1789498710.119659:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498710.119758:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896161920 00000100:00100000:1.0:1789498710.119769:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896161920 00000100:00100000:1.0:1789498710.119833:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 66 00000100:00100000:1.0:1789498710.119843:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e628490-3532-4bd6-bd50-78c84d98cfb9+5:15561:x1876424896161920:12345-192.168.204.17@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789498710.119971:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e628490-3532-4bd6-bd50-78c84d98cfb9+5:15561:x1876424896161920:12345-192.168.204.17@tcp:60:lhsmtool_posix.0 Request processed in 129us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498710.119979:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 66 00000100:00100000:0.0:1789498710.131866:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498710.131942:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896162176 00000100:00100000:1.0:1789498710.131966:0:17094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896162176 00000100:00100000:1.0:1789498710.132044:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 12 00000100:00100000:1.0:1789498710.132056:0:17094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076aa20c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e628490-3532-4bd6-bd50-78c84d98cfb9+13:15561:x1876424896162176:12345-192.168.204.17@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789498710.132516:0:17094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076aa20c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e628490-3532-4bd6-bd50-78c84d98cfb9+14:15561:x1876424896162176:12345-192.168.204.17@tcp:35:lhsmtool_posix.0 Request processed in 462us (662us total) trans 8589934624 rc 0/0 00000100:00100000:1.0:1789498710.132525:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 12 00010000:00010000:1.0:1789498710.332689:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498711.356425:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498711.483844:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876424916155136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498711.483944:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498711.484066:0:19589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916155136 00000100:00100000:1.0:1789498711.484075:0:19589:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916155136 00000100:00100000:1.0:1789498711.484161:0:19589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789498711.484173:0:19589:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076981b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876424916155136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789498711.484208:0:19589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789498711.484269:0:19589:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076981b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876424916155136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498711.484277:0:19589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789498711.484418:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876424916155136:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789498711.484485:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789498711.484499:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076aa20d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916155264:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789498711.484567:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498711.484757:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916155264 00000100:00100000:3.0:1789498711.484762:0:18602:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916155264 00000100:00100000:3.0:1789498711.484807:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789498711.484814:0:18602:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916155264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789498711.484825:0:18602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789498711.484857:0:18602:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916155264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498711.484863:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789498711.484941:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076aa20d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916155264:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789498711.485174:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789498711.995951:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075882e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876424916155392:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789498711.996021:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498711.996079:0:17832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916155392 00000100:00100000:1.0:1789498711.996087:0:17832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916155392 00000100:00100000:1.0:1789498711.996135:0:17832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789498711.996144:0:17832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075882e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876424916155392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789498711.996182:0:17832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1789498711.996226:0:17832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075882e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876424916155392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498711.996234:0:17832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789498711.996283:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075882e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876424916155392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789498711.996377:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789498711.996386:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076aa20d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876424916155520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789498711.996430:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498711.996467:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916155520 00000100:00100000:0.0:1789498711.996471:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916155520 00000100:00100000:0.0:1789498711.996496:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789498711.996502:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076aa20c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876424916155520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789498711.996522:0:17096:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789498711.996585:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076aa20c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876424916155520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498711.996591:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789498711.996617:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076aa20d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876424916155520:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1789498712.123665:0:17126:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789498712.123675:0:17126:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498712.123697:0:17126:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789498712.123703:0:17126:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:02000400:0.0:1789498712.347081:0:20472:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 14:58:29 (1789498709) 00010000:00010000:1.0:1789498712.382020:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498713.404907:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498713.532063:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076aa20d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876424916155648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789498713.532138:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498713.532210:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916155648 00000100:00100000:0.0:1789498713.532218:0:18601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916155648 00000100:00100000:1.0:1789498713.532369:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916156032:0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.532408:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498713.532428:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916156544:0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.532451:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498713.532478:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1876424916157056:0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.532513:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498713.532575:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789498713.532582:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916156160:0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.532606:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498713.532635:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876424916156672:0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.532659:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498713.532676:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876424916157184:0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.532697:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498713.532721:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876424916155904:0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.532749:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498713.532787:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876424916156416:0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.532819:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498713.532839:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876424916156928:0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.532859:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498713.532876:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789498713.532899:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076981b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20dec396-e124-4c94-9424-ae01f240e87e:3644:1876424916155776:0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.532925:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498713.532947:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876424916156288:0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.532985:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498713.533002:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876424916156800:0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.533028:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498713.533047:0:19084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916156032 00000100:00100000:1.0:1789498713.533051:0:19084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916156032 00000100:00100000:1.0:1789498713.533084:0:19084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916156544 00000100:00100000:1.0:1789498713.533087:0:19084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916156544 00000100:00100000:1.0:1789498713.533108:0:19084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916156160 00000100:00100000:1.0:1789498713.533110:0:19084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916156160 00000100:00100000:1.0:1789498713.533126:0:19084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789498713.533133:0:19084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075882e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916156032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.533181:0:19084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075882e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916156032:12345-0@lo:400:kworker.0 Request processed in 48us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498713.533188:0:19084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789498713.533203:0:19084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789498713.533210:0:19084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075882e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916156544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.533236:0:19084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075882e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916156544:12345-0@lo:400:kworker.0 Request processed in 27us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498713.533242:0:19084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789498713.533253:0:19084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789498713.533259:0:19084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075882e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916156160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.533293:0:19084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075882e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916156160:12345-0@lo:400:kworker.0 Request processed in 34us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498713.533299:0:19084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789498713.533316:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916157056 00000100:00100000:1.0:1789498713.533319:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916157056 00000100:00100000:1.0:1789498713.533339:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916156672 00000100:00100000:1.0:1789498713.533341:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916156672 00000100:00100000:1.0:1789498713.533351:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916157184 00000100:00100000:1.0:1789498713.533353:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916157184 00000100:00100000:1.0:1789498713.533372:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916156928 00000100:00100000:1.0:1789498713.533375:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916156928 00000100:00100000:1.0:1789498713.533386:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916156288 00000100:00100000:1.0:1789498713.533388:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916156288 00000100:00100000:1.0:1789498713.533397:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916156800 00000100:00100000:1.0:1789498713.533399:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916156800 00000100:00100000:1.0:1789498713.533410:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789498713.533416:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075882ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876424916157056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.533446:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075882ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876424916157056:12345-0@lo:400:kworker.0 Request processed in 31us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498713.533452:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789498713.533462:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789498713.533467:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075882eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876424916156672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.533493:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075882eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876424916156672:12345-0@lo:400:kworker.0 Request processed in 26us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498713.533499:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789498713.533509:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789498713.533515:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075882e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876424916157184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.533562:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075882e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876424916157184:12345-0@lo:400:kworker.0 Request processed in 48us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498713.533568:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789498713.533579:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789498713.533585:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075882eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876424916156928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.533631:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075882eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876424916156928:12345-0@lo:400:kworker.0 Request processed in 45us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498713.533637:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789498713.533650:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789498713.533663:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075882e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876424916156288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.533692:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075882e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876424916156288:12345-0@lo:400:kworker.0 Request processed in 31us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498713.533698:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789498713.533709:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789498713.533715:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075882eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876424916156800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.533740:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075882eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876424916156800:12345-0@lo:400:kworker.0 Request processed in 26us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498713.533746:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789498713.533795:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916155904 00000100:00100000:1.0:1789498713.533799:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916155904 00000100:00100000:1.0:1789498713.533822:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916156416 00000100:00100000:1.0:1789498713.533824:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916156416 00000100:00100000:1.0:1789498713.533834:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789498713.533839:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075882e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876424916155904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.533865:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075882e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876424916155904:12345-0@lo:400:kworker.0 Request processed in 26us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498713.533871:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789498713.533893:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789498713.533900:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075882e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876424916156416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.533930:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075882e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876424916156416:12345-0@lo:400:kworker.0 Request processed in 32us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498713.533937:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789498713.533960:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916155776 00000100:00100000:1.0:1789498713.533964:0:17085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916155776 00000100:00100000:1.0:1789498713.533989:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789498713.533996:0:17085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc42a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20dec396-e124-4c94-9424-ae01f240e87e+24:3644:x1876424916155776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.534036:0:17085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc42a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:20dec396-e124-4c94-9424-ae01f240e87e+24:3644:x1876424916155776:12345-0@lo:400:kworker.0 Request processed in 41us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498713.534042:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789498713.534110:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076981b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20dec396-e124-4c94-9424-ae01f240e87e:3644:1876424916155776:0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.534124:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876424916156288:0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.534131:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876424916156800:0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.534144:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876424916155904:0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.534153:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876424916156416:0@lo:400:kworker.0 00010000:00080000:1.0:1789498713.534165:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0758819ce00 x1876424916156928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498713.534176:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876424916156928:0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.534204:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789498713.534212:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075882ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876424916157312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498713.534240:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498713.534268:0:19589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916157312 00000100:00100000:1.0:1789498713.534272:0:19589:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916157312 00000100:00100000:0.0:1789498713.535825:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789498713.535859:0:18601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07684c17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876424916155648:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789498713.535873:0:19589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00002000:00000024:0.0:1789498713.536106:0:18601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1789498713.536135:0:19589:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075882e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876424916157312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789498713.536150:0:19589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1789498713.537624:0:18601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07684c17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876424916155648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1771us (5482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498713.537636:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1789498713.537669:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789498713.537675:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789498713.537678:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789498713.537681:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789498713.537740:0:19589:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075882e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876424916157312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1857us (3496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498713.537745:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076aa20d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876424916155648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789498713.537753:0:19589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789498713.538099:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075882ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876424916157312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498713.538157:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916156160:0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.538185:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876424916156672:0@lo:400:kworker.0 00010000:00080000:1.0:1789498713.538199:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa075883da300 x1876424916157184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498713.538210:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876424916157184:0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.538222:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916156032:0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.538234:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916156544:0@lo:400:kworker.0 00000100:00100000:1.0:1789498713.538245:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1876424916157056:0@lo:400:kworker.0 00010000:00010000:1.0:1789498714.433370:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498714.542438:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498714.542480:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498714.542555:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896162304 00000100:00100000:2.0:1789498714.542565:0:17084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896162304 00000100:00100000:2.0:1789498714.542618:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 171 00000100:00100000:2.0:1789498714.542627:0:17084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc42a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d9110ca-e4e1-41f3-8b8d-d4ddfb2e552d+13:2394:x1876424896162304:12345-192.168.204.17@tcp:400:kworker.0 00000100:00100000:2.0:1789498714.542711:0:17084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc42a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d9110ca-e4e1-41f3-8b8d-d4ddfb2e552d+13:2394:x1876424896162304:12345-192.168.204.17@tcp:400:kworker.0 Request processed in 85us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498714.542719:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 171 00000100:00100000:3.0:1789498714.543695:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498714.549495:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498714.552370:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896162560 00000100:00100000:1.0:1789498714.552384:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896162560 00000100:00100000:1.0:1789498714.552455:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896162816 00000100:00100000:1.0:1789498714.552458:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896162816 00000100:00100000:1.0:1789498714.552487:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 84 00000100:00100000:1.0:1789498714.552500:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e628490-3532-4bd6-bd50-78c84d98cfb9+5:2394:x1876424896162560:12345-192.168.204.17@tcp:400:kworker.0 00000100:00100000:1.0:1789498714.552602:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e628490-3532-4bd6-bd50-78c84d98cfb9+5:2394:x1876424896162560:12345-192.168.204.17@tcp:400:kworker.0 Request processed in 107us (10121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498714.552610:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 84 00000100:00100000:1.0:1789498714.552630:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 85 00000100:00100000:1.0:1789498714.552636:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:009e7412-2a14-4c71-98d7-be20ea80e3db+6:2394:x1876424896162816:12345-192.168.204.17@tcp:400:kworker.0 00000100:00100000:1.0:1789498714.557080:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:009e7412-2a14-4c71-98d7-be20ea80e3db+6:2394:x1876424896162816:12345-192.168.204.17@tcp:400:kworker.0 Request processed in 4429us (13373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498714.557095:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 85 00000100:00080000:1.0:1789498714.557259:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789498714.557274:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789498714.570492:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498714.570561:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498714.570720:0:19316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896162432 00000100:00100000:2.0:1789498714.570730:0:19316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896162432 00000100:00100000:2.0:1789498714.570785:0:19316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896162944 00000100:00100000:2.0:1789498714.570788:0:19316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896162944 00000100:00100000:2.0:1789498714.570811:0:19316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 86 00000100:00100000:2.0:1789498714.570820:0:19316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e628490-3532-4bd6-bd50-78c84d98cfb9+14:2394:x1876424896162432:12345-192.168.204.17@tcp:400:kworker.0 00000100:00100000:2.0:1789498714.570915:0:19316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e628490-3532-4bd6-bd50-78c84d98cfb9+14:2394:x1876424896162432:12345-192.168.204.17@tcp:400:kworker.0 Request processed in 94us (21427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498714.570922:0:19316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 86 00000100:00100000:2.0:1789498714.570940:0:19316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 87 00000100:00100000:2.0:1789498714.570947:0:19316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:009e7412-2a14-4c71-98d7-be20ea80e3db+5:2394:x1876424896162944:12345-192.168.204.17@tcp:400:kworker.0 00000100:00100000:2.0:1789498714.570979:0:19316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:009e7412-2a14-4c71-98d7-be20ea80e3db+5:2394:x1876424896162944:12345-192.168.204.17@tcp:400:kworker.0 Request processed in 33us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498714.570999:0:19316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 87 00000100:00100000:1.0:1789498714.571686:0:19084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896162688 00000100:00100000:1.0:1789498714.571693:0:19084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896162688 00000100:00100000:1.0:1789498714.571737:0:19084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 36 00000100:00100000:1.0:1789498714.571746:0:19084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e628490-3532-4bd6-bd50-78c84d98cfb9+5:2394:x1876424896162688:12345-192.168.204.17@tcp:400:kworker.0 00000100:00100000:1.0:1789498714.571789:0:19084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2e628490-3532-4bd6-bd50-78c84d98cfb9+5:2394:x1876424896162688:12345-192.168.204.17@tcp:400:kworker.0 Request processed in 45us (1307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498714.571796:0:19084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 36 00000100:00080000:1.0:1789498714.571825:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789498714.571830:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789498714.571832:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789498714.573255:0:17070:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934624 is committed 00000020:00080000:1.0:1789498714.573268:0:17070:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:3.0:1789498714.573326:0:17131:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:3.0:1789498714.573338:0:17131:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00010000:00010000:1.0:1789498715.452241:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789498715.582585:0:18594:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 009e7412-2a14-4c71-98d7-be20ea80e3db 00000020:00000080:0.0:1789498715.582595:0:18594:0:(genops.c:885:class_export_put()) final put ffffa075875a4000/009e7412-2a14-4c71-98d7-be20ea80e3db 00000001:00100000:0.0:1789498715.582624:0:18594:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2e628490-3532-4bd6-bd50-78c84d98cfb9 00000020:00000080:0.0:1789498715.582627:0:18594:0:(genops.c:885:class_export_put()) final put ffffa0758722c800/2e628490-3532-4bd6-bd50-78c84d98cfb9 00000001:00100000:3.0:1789498715.583388:0:19413:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 009e7412-2a14-4c71-98d7-be20ea80e3db 00000020:00000080:3.0:1789498715.583393:0:19413:0:(genops.c:885:class_export_put()) final put ffffa075875a5800/009e7412-2a14-4c71-98d7-be20ea80e3db 00000020:00000080:2.0:1789498715.583529:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffffa075875a4000/009e7412-2a14-4c71-98d7-be20ea80e3db for lustre-OST0000 00000020:00000080:2.0:1789498715.587449:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffffa0758722c800/2e628490-3532-4bd6-bd50-78c84d98cfb9 for lustre-OST0000 00000020:00000080:2.0:1789498715.587521:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffffa075875a5800/009e7412-2a14-4c71-98d7-be20ea80e3db for lustre-OST0001 00000020:00000080:2.0:1789498715.587556:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa075875a0000 for lustre-OST0000 00000020:00000080:2.0:1789498715.587562:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa07587228000 for lustre-OST0000 00000020:00000080:2.0:1789498715.587565:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa075875a3800 for lustre-OST0001 00000100:00100000:1.0:1789498716.148480:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498716.148826:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896163200 00000100:00100000:3.0:1789498716.148848:0:17093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896163200 00000100:00100000:3.0:1789498716.148929:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 13 00000100:00100000:3.0:1789498716.148940:0:17093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075882ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e628490-3532-4bd6-bd50-78c84d98cfb9+13:16316:x1876424896163200:12345-192.168.204.17@tcp:35:umount.0 00000001:00080000:3.0:1789498716.149195:0:17093:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:3.0:1789498716.149287:0:17093:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:3.0:1789498716.149434:0:17093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075882ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e628490-3532-4bd6-bd50-78c84d98cfb9+16:16316:x1876424896163200:12345-192.168.204.17@tcp:35:umount.0 Request processed in 495us (960us total) trans 8589934627 rc 0/0 00000100:00100000:3.0:1789498716.149443:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 13 00000020:00080000:3.0:1789498716.149448:0:17093:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00080000:1.0:1789498716.149811:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498716.154930:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498716.155337:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498716.155391:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:0.0:1789498716.155635:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896163328 00000100:00100000:0.0:1789498716.155664:0:17075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896163328 00000100:00100000:0.0:1789498716.155733:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896163584 00000100:00100000:0.0:1789498716.155737:0:17075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896163584 00000100:00100000:0.0:1789498716.155753:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896163456 00000100:00100000:0.0:1789498716.155757:0:17075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896163456 00000100:00100000:0.0:1789498716.155774:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 3 00000100:00100000:0.0:1789498716.155784:0:17075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d9110ca-e4e1-41f3-8b8d-d4ddfb2e552d+15:2394:x1876424896163328:12345-192.168.204.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498716.155799:0:17075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498716.155819:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa075874a1200/0x70d6b5fa1825de72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f08b expref: 15 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498716.155848:0:17075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498716.155911:0:17075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d9110ca-e4e1-41f3-8b8d-d4ddfb2e552d+14:2394:x1876424896163328:12345-192.168.204.17@tcp:103:ldlm_bl.0 Request processed in 128us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498716.155919:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 3 00000100:00100000:2.0:1789498716.155941:0:20121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 4 00000100:00100000:2.0:1789498716.157622:0:20121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075877dd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1d9110ca-e4e1-41f3-8b8d-d4ddfb2e552d+13:2394:x1876424896163584:12345-192.168.204.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789498716.157646:0:20121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498716.157666:0:20121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa076c20e1600/0x70d6b5fa1825df36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f172 expref: 13 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498716.157682:0:20121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498716.157723:0:20121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075877dd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1d9110ca-e4e1-41f3-8b8d-d4ddfb2e552d+12:2394:x1876424896163584:12345-192.168.204.17@tcp:103:ldlm_bl.0 Request processed in 1773us (2387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498716.161387:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 5 00000100:00100000:0.0:1789498716.161420:0:17075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d9110ca-e4e1-41f3-8b8d-d4ddfb2e552d+12:2394:x1876424896163456:12345-192.168.204.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498716.161442:0:17075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498716.161467:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa076813d6600/0x70d6b5fa1825de79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f0bc expref: 12 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498716.161575:0:17075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498716.161923:0:17075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d9110ca-e4e1-41f3-8b8d-d4ddfb2e552d+11:2394:x1876424896163456:12345-192.168.204.17@tcp:103:ldlm_bl.0 Request processed in 519us (6530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498716.161933:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 5 00000100:00100000:3.0:1789498716.162131:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498716.162372:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896163712 00000100:00100000:1.0:1789498716.162381:0:18598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896163712 00000100:00100000:1.0:1789498716.162432:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 33 00000100:00100000:1.0:1789498716.162441:0:18598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e628490-3532-4bd6-bd50-78c84d98cfb9+5:2391:x1876424896163712:12345-192.168.204.17@tcp:9:umount.0 00000020:00000080:1.0:1789498716.162473:0:18598:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825de9c 00000100:00080000:1.0:1789498716.162494:0:18598:0:(import.c:65:import_set_state_nolock()) ffffa075856d9800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789498716.162565:0:18598:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1789498716.162720:0:18598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e628490-3532-4bd6-bd50-78c84d98cfb9+2:2391:x1876424896163712:12345-192.168.204.17@tcp:9:umount.0 Request processed in 280us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498716.162727:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 33 00010000:00010000:1.0:1789498716.162792:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789498716.163465:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789498716.166976:0:20121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 4 00000100:00100000:0.0:1789498716.194437:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498716.196965:0:20242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896164608 00000100:00100000:2.0:1789498716.196981:0:20242:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896164608 00000100:00100000:2.0:1789498716.197054:0:20242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 67 00000100:00100000:2.0:1789498716.197066:0:20242:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076aa20ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e628490-3532-4bd6-bd50-78c84d98cfb9+16:2391:x1876424896164608:12345-192.168.204.17@tcp:39:umount.0 00000020:00000080:2.0:1789498716.197097:0:20242:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825de87 00000020:00010000:2.0:1789498716.197113:0:20242:0:(genops.c:1920:obd_stale_export_put()) Put export ffffa075810df800: total 0 00000100:00080000:2.0:1789498716.197117:0:20242:0:(import.c:65:import_set_state_nolock()) ffffa075810db000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789498716.197147:0:20242:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:2.0:1789498716.197424:0:20242:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076aa20ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2e628490-3532-4bd6-bd50-78c84d98cfb9+15:2391:x1876424896164608:12345-192.168.204.17@tcp:39:umount.0 Request processed in 361us (3009us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1789498716.197444:0:20242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 67 00000020:00010000:1.0:1789498716.197967:0:17079:0:(genops.c:1906:obd_stale_export_get()) Get export ffffa075810df800: total 0 00010000:00010000:1.0:1789498716.197990:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498716.198042:0:17079:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa075810df800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1789498716.198079:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa07587435800) 00010000:00010000:1.0:1789498716.198083:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789498716.198092:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa076c1571c00/0x70d6b5fa1825df52 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f179 expref: 14 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498716.198118:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa076bef6b900) 00010000:00010000:1.0:1789498716.198121:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789498716.198125:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa076bc6d9000/0x70d6b5fa1825e032 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f1b8 expref: 13 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498716.198141:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa07587435700) 00010000:00010000:1.0:1789498716.198143:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789498716.198147:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa076bc6d8c00/0x70d6b5fa1825e0e1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f1f7 expref: 12 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498716.198159:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa07587435700) 00010000:00010000:1.0:1789498716.198161:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789498716.198165:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa076bc6d8e00/0x70d6b5fa1825e0b0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f1e2 expref: 11 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498716.198176:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa076bef6b000) 00010000:00010000:1.0:1789498716.198179:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789498716.198182:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa076bc6d8a00/0x70d6b5fa1825dfad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f18e expref: 10 pid: 19316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498716.198194:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa07587435700) 00010000:00010000:1.0:1789498716.198196:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789498716.198208:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa076bc6d9a00/0x70d6b5fa1825e19e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f22f expref: 9 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498716.198224:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa076bef6b100) 00010000:00010000:1.0:1789498716.198227:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498716.198231:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa076bc6d9c00/0x70d6b5fa1825df6e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f180 expref: 8 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498716.198246:0:17079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa07587435900) 00010000:00010000:1.0:1789498716.198248:0:17079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789498716.198252:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa076c1571a00/0x70d6b5fa1825e13c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f20c expref: 7 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498716.198264:0:17079:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa075810df800, canceled 8 locks, left on hash table 0. 00010000:00010000:1.0:1789498716.198745:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498716.198748:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498716.198750:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498716.232296:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498716.232653:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896164736 00000100:00100000:2.0:1789498716.232665:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896164736 00000100:00100000:2.0:1789498716.232782:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 68 00000100:00100000:2.0:1789498716.232822:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075882e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e628490-3532-4bd6-bd50-78c84d98cfb9+5:2391:x1876424896164736:12345-192.168.204.17@tcp:39:umount.0 00000020:00000080:2.0:1789498716.232889:0:17091:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825de8e 00000100:00080000:2.0:1789498716.232921:0:17091:0:(import.c:65:import_set_state_nolock()) ffffa076bbe11800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789498716.232975:0:17091:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1789498716.233405:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075882e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e628490-3532-4bd6-bd50-78c84d98cfb9+3:2391:x1876424896164736:12345-192.168.204.17@tcp:39:umount.0 Request processed in 598us (1117us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789498716.233414:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 68 00000100:00080000:3.0:1789498716.233676:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789498716.234302:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498716.478068:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498716.605168:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876424916157440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498716.605263:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498716.605342:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916157440 00000100:00100000:3.0:1789498716.605351:0:18601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916157440 00000100:00100000:3.0:1789498716.605419:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789498716.605433:0:18601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876424916157440:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498716.605441:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075882ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916157568:0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789498716.605470:0:18601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789498716.605481:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498716.605522:0:19589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916157568 00000100:00100000:1.0:1789498716.605526:0:19589:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916157568 00000100:00100000:3.0:1789498716.605567:0:18601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876424916157440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498716.605576:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789498716.605590:0:19589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789498716.605599:0:19589:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075882ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916157568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789498716.605614:0:19589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789498716.605658:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876424916157440:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789498716.606372:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789498716.612719:0:19589:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075882ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916157568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7110us (7227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498716.612755:0:19589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789498716.617319:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075882ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916157568:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1789498717.052747:0:17845:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789498717.117884:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789498717.117912:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075882ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916157696:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789498717.117987:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498717.119795:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916157696 00000100:00100000:1.0:1789498717.119808:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916157696 00000100:00100000:1.0:1789498717.119884:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789498717.119895:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916157696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789498717.119940:0:17097:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1789498717.120023:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916157696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (2035us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498717.120030:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789498717.120175:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075882ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916157696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789498717.122763:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789498717.122791:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876424916157824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789498717.122870:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498717.124767:0:17832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916157824 00000100:00100000:1.0:1789498717.124782:0:17832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916157824 00000100:00100000:1.0:1789498717.124907:0:17832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789498717.124918:0:17832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876424916157824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789498717.124961:0:17832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789498717.125042:0:17832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876424916157824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (2172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498717.125049:0:17832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789498717.125136:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876424916157824:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789498717.499838:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498718.525226:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498718.554759:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:0.0:1789498718.554857:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:0.0:1789498718.559224:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498718.563309:0:17077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896164864 00000100:00100000:3.0:1789498718.563350:0:17077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896164864 00000100:00100000:3.0:1789498718.563443:0:17077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896165120 00000100:00100000:3.0:1789498718.563447:0:17077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896165120 00000100:00100000:1.0:1789498718.563764:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 6 00000100:00100000:1.0:1789498718.563794:0:17076:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076aa20d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d9110ca-e4e1-41f3-8b8d-d4ddfb2e552d+11:2395:x1876424896164864:12345-192.168.204.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789498718.563813:0:17076:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498718.563837:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa076813d7200/0x70d6b5fa1825deb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f0fb expref: 11 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498718.563863:0:17076:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498718.563937:0:17076:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076aa20d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d9110ca-e4e1-41f3-8b8d-d4ddfb2e552d+10:2395:x1876424896164864:12345-192.168.204.17@tcp:103:ldlm_bl.0 Request processed in 160us (9189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498718.563951:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 6 00000100:00100000:1.0:1789498718.564116:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 7 00000100:00100000:1.0:1789498718.564124:0:17076:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758804aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d9110ca-e4e1-41f3-8b8d-d4ddfb2e552d+9:2395:x1876424896165120:12345-192.168.204.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789498718.564134:0:17076:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498718.564144:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa076c20e0000/0x70d6b5fa1825df2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f16b expref: 9 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498718.564156:0:17076:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498718.564185:0:17076:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758804aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d9110ca-e4e1-41f3-8b8d-d4ddfb2e552d+8:2395:x1876424896165120:12345-192.168.204.17@tcp:103:ldlm_bl.0 Request processed in 62us (9327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498718.564199:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 7 00000100:00100000:1.0:1789498718.567779:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896164992 00000100:00100000:1.0:1789498718.567807:0:17076:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896164992 00000100:00100000:1.0:1789498718.567895:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 8 00000100:00100000:1.0:1789498718.567919:0:17076:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758804b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d9110ca-e4e1-41f3-8b8d-d4ddfb2e552d+8:2395:x1876424896164992:12345-192.168.204.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789498718.567939:0:17076:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498718.567980:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa076813d7800/0x70d6b5fa1825deb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f12c expref: 8 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498718.568007:0:17076:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498718.568081:0:17076:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758804b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d9110ca-e4e1-41f3-8b8d-d4ddfb2e552d+7:2395:x1876424896164992:12345-192.168.204.17@tcp:103:ldlm_bl.0 Request processed in 167us (8866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498718.568089:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 8 00000100:00100000:1.0:1789498718.568172:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498718.568210:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896165376 00000100:00100000:1.0:1789498718.568214:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896165376 00000100:00100000:1.0:1789498718.568273:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 69 00000100:00100000:1.0:1789498718.568280:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075882ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:009e7412-2a14-4c71-98d7-be20ea80e3db+6:2391:x1876424896165376:12345-192.168.204.17@tcp:39:umount.0 00000020:00000080:1.0:1789498718.568315:0:17090:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825dec6 00000020:00010000:1.0:1789498718.568323:0:17090:0:(genops.c:1920:obd_stale_export_put()) Put export ffffa075856df000: total 0 00000100:00080000:1.0:1789498718.568328:0:17090:0:(import.c:65:import_set_state_nolock()) ffffa075856da000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789498718.568352:0:17090:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00100000:1.0:1789498718.568893:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075882ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:009e7412-2a14-4c71-98d7-be20ea80e3db+5:2391:x1876424896165376:12345-192.168.204.17@tcp:39:umount.0 Request processed in 613us (720us total) trans 8589934629 rc 0/0 00000100:00100000:1.0:1789498718.569016:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 69 00000020:00010000:1.0:1789498718.569039:0:17078:0:(genops.c:1906:obd_stale_export_get()) Get export ffffa075856df000: total 0 00010000:00010000:1.0:1789498718.569088:0:17078:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa075856df000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789498718.569115:0:17078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa076bef6b000) 00010000:00010000:1.0:1789498718.569119:0:17078:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789498718.569125:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa076813d6800/0x70d6b5fa1825dfbb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f195 expref: 4 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498718.569147:0:17078:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa075856df000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789498718.569156:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498718.569158:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498718.569160:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789498718.569293:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498718.592327:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498718.592498:0:20242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896165504 00000100:00100000:2.0:1789498718.592511:0:20242:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896165504 00000100:00100000:2.0:1789498718.592646:0:20242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 70 00000100:00100000:2.0:1789498718.592658:0:20242:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:009e7412-2a14-4c71-98d7-be20ea80e3db+5:2391:x1876424896165504:12345-192.168.204.17@tcp:39:umount.0 00000020:00000080:2.0:1789498718.592710:0:20242:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825decd 00000100:00080000:2.0:1789498718.592722:0:20242:0:(import.c:65:import_set_state_nolock()) ffffa0758832b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789498718.592745:0:20242:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1789498718.592952:0:20242:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:009e7412-2a14-4c71-98d7-be20ea80e3db+3:2391:x1876424896165504:12345-192.168.204.17@tcp:39:umount.0 Request processed in 296us (638us total) trans 8589934594 rc 0/0 00010000:00010000:0.0:1789498718.593171:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498718.594659:0:20242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 70 00000100:00080000:3.0:1789498718.595304:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789498718.653099:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916158336:0@lo:400:kworker.0 00000100:00100000:2.0:1789498718.653128:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20dec396-e124-4c94-9424-ae01f240e87e:3644:1876424916157952:0@lo:400:kworker.0 00000100:00100000:0.0:1789498718.653225:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c1600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876424916158208:0@lo:400:kworker.0 00000100:00100000:1.0:1789498718.655096:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c1603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916158080:0@lo:400:kworker.0 00000100:00100000:2.0:1789498718.661212:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498718.661296:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876424916158464:0@lo:400:kworker.0 00000100:00100000:2.0:1789498718.661340:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498718.661374:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876424916158976:0@lo:400:kworker.0 00000100:00100000:2.0:1789498718.661399:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498718.661426:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1876424916159488:0@lo:400:kworker.0 00000100:00100000:2.0:1789498718.662886:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498718.662933:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789498718.662943:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876424916158848:0@lo:400:kworker.0 00000100:00100000:2.0:1789498718.663047:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498718.663070:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876424916159360:0@lo:400:kworker.0 00000100:00100000:2.0:1789498718.663090:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498718.663134:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916157952 00000100:00100000:2.0:1789498718.663144:0:17083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916157952 00000100:00100000:2.0:1789498718.663191:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789498718.663200:0:17083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc42b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20dec396-e124-4c94-9424-ae01f240e87e+24:3644:x1876424916157952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498718.663256:0:17083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc42b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:20dec396-e124-4c94-9424-ae01f240e87e+24:3644:x1876424916157952:12345-0@lo:400:kworker.0 Request processed in 58us (2053us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498718.663264:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789498718.663299:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916158464 00000100:00100000:2.0:1789498718.663303:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916158464 00000100:00100000:2.0:1789498718.663350:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916159488 00000100:00100000:2.0:1789498718.663354:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916159488 00000100:00100000:2.0:1789498718.663381:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916159360 00000100:00100000:2.0:1789498718.663384:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916159360 00000100:00100000:2.0:1789498718.663400:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789498718.663406:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876424916158464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498718.663444:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876424916158464:12345-0@lo:400:kworker.0 Request processed in 37us (2103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498718.663451:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789498718.663464:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789498718.663469:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876424916159488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498718.663501:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876424916159488:12345-0@lo:400:kworker.0 Request processed in 32us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498718.663507:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789498718.663517:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789498718.663521:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876424916159360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498718.663566:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876424916159360:12345-0@lo:400:kworker.0 Request processed in 44us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498718.663572:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789498718.663588:0:19084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916158976 00000100:00100000:2.0:1789498718.663591:0:19084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916158976 00000100:00100000:2.0:1789498718.663613:0:19084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916158848 00000100:00100000:2.0:1789498718.663616:0:19084:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916158848 00000100:00100000:2.0:1789498718.663638:0:19084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789498718.663645:0:19084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876424916158976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498718.663673:0:19084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876424916158976:12345-0@lo:400:kworker.0 Request processed in 29us (2273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498718.663689:0:19084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789498718.663699:0:19084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789498718.663704:0:19084:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586726d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876424916158848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498718.663727:0:19084:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586726d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876424916158848:12345-0@lo:400:kworker.0 Request processed in 23us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498718.663732:0:19084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789498718.664900:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498718.664968:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916158336 00000100:00100000:3.0:1789498718.664974:0:18598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916158336 00000100:00100000:3.0:1789498718.665005:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789498718.665014:0:18598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876424916158336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498718.665061:0:18598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876424916158336:12345-0@lo:400:kworker.0 Request processed in 48us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498718.665067:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1789498718.665103:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789498718.665108:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789498718.665111:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789498718.665114:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498718.665143:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916158336:0@lo:400:kworker.0 00000100:00100000:3.0:1789498718.665207:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876424916158848:0@lo:400:kworker.0 00010000:00080000:3.0:1789498718.665222:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa075874f7100 x1876424916159360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498718.665234:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876424916159360:0@lo:400:kworker.0 00000100:00100000:3.0:1789498718.665247:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876424916158976:0@lo:400:kworker.0 00000100:00100000:3.0:1789498718.665259:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1876424916159488:0@lo:400:kworker.0 00000100:00100000:3.0:1789498718.665269:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20dec396-e124-4c94-9424-ae01f240e87e:3644:1876424916157952:0@lo:400:kworker.0 00000100:00100000:3.0:1789498718.665298:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876424916158464:0@lo:400:kworker.0 00000100:00100000:3.0:1789498718.665409:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498718.665453:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896165760 00000100:00100000:3.0:1789498718.665457:0:17085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896165760 00000100:00100000:3.0:1789498718.665485:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 173 00000100:00100000:3.0:1789498718.665491:0:17085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc42b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d9110ca-e4e1-41f3-8b8d-d4ddfb2e552d+7:2391:x1876424896165760:12345-192.168.204.17@tcp:251:umount.0 00000020:00000080:3.0:1789498718.665526:0:17085:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825de64 00000020:00010000:3.0:1789498718.666003:0:17085:0:(genops.c:1920:obd_stale_export_put()) Put export ffffa075856dc800: total 0 00000100:00080000:3.0:1789498718.666010:0:17085:0:(import.c:65:import_set_state_nolock()) ffffa075856d8000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789498718.666071:0:17085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc42b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d9110ca-e4e1-41f3-8b8d-d4ddfb2e552d+3:2391:x1876424896165760:12345-192.168.204.17@tcp:251:umount.0 Request processed in 579us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498718.666078:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 173 00000020:00010000:3.0:1789498718.666153:0:18245:0:(genops.c:1906:obd_stale_export_get()) Get export ffffa075856dc800: total 0 00010000:00010000:3.0:1789498718.666267:0:18245:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa075856dc800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789498718.666307:0:18245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa076c20e1e00/0x70d6b5fa1825de6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f084 expref: 2 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498718.666321:0:18245:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa075856dc800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1789498718.666332:0:18245:0:(genops.c:885:class_export_put()) final put ffffa075856dc800/1d9110ca-e4e1-41f3-8b8d-d4ddfb2e552d 00010000:00010000:3.0:1789498718.666345:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498718.666346:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498718.666348:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789498718.666362:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffffa075856dc800/1d9110ca-e4e1-41f3-8b8d-d4ddfb2e552d for MGS 00000020:00000080:3.0:1789498718.666393:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa075856d8000 for MGS 00000100:00100000:0.0:1789498718.673309:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498718.673366:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876424916158720:0@lo:400:kworker.0 00000100:00100000:0.0:1789498718.673409:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498718.673432:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876424916159232:0@lo:400:kworker.0 00000100:00100000:0.0:1789498718.673473:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498718.673518:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876424916159744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498718.673566:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498718.673602:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916159744 00000100:00100000:0.0:1789498718.673611:0:18601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916159744 00000100:00100000:0.0:1789498718.673657:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789498718.673666:0:18601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876424916159744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789498718.673701:0:18601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1789498718.673847:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916158720 00000100:00100000:2.0:1789498718.673852:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916158720 00000100:00100000:2.0:1789498718.673883:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789498718.673890:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876424916158720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498718.673940:0:18601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876424916159744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 274us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498718.673947:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789498718.674008:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876424916159744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498718.674057:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916159232 00000100:00100000:0.0:1789498718.674061:0:17092:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916159232 00000100:00100000:0.0:1789498718.674100:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789498718.674106:0:17092:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876424916159232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498718.674142:0:17092:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876424916159232:12345-0@lo:400:kworker.0 Request processed in 36us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498718.674164:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1789498718.674184:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498718.674205:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876424916159232:0@lo:400:kworker.0 00000100:00100000:1.0:1789498718.674361:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498718.674409:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916158592:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789498718.674521:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498718.674571:0:19589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916158592 00000100:00100000:1.0:1789498718.674575:0:19589:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916158592 00000100:00100000:1.0:1789498718.674611:0:19589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789498718.674617:0:19589:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916158592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789498718.674630:0:19589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1789498718.674661:0:19589:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916158592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498718.674667:0:19589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789498718.674709:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916158592:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789498718.674717:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876424916159104:0@lo:400:kworker.0 00000100:00100000:1.0:1789498718.674755:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498718.674779:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916159104 00000100:00100000:1.0:1789498718.674793:0:17090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916159104 00000100:00100000:1.0:1789498718.674820:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789498718.674825:0:17090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876424916159104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498718.674855:0:17090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876424916159104:12345-0@lo:400:kworker.0 Request processed in 30us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498718.674860:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789498718.674886:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876424916159104:0@lo:400:kworker.0 00000100:00100000:1.0:1789498718.674892:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876424916159616:0@lo:400:kworker.0 00000100:00100000:1.0:1789498718.674910:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498718.674930:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916159616 00000100:00100000:1.0:1789498718.674934:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916159616 00000100:00100000:1.0:1789498718.674956:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789498718.674974:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876424916159616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498718.675001:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876424916159616:12345-0@lo:400:kworker.0 Request processed in 28us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498718.675015:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:1.0:1789498718.675041:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa075874f5500 x1876424916159616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498718.675050:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876424916159616:0@lo:400:kworker.0 00000100:00100000:1.0:1789498718.675083:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916158080 00000100:00100000:1.0:1789498718.675086:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916158080 00000100:00100000:1.0:1789498718.675101:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789498718.675106:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916158080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498718.675138:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916158080:12345-0@lo:400:kworker.0 Request processed in 32us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498718.675143:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789498718.675167:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c1603480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916158080:0@lo:400:kworker.0 00000100:00080000:0.0:1789498718.675330:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789498718.678102:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916158208 00000100:00100000:3.0:1789498718.678117:0:18598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916158208 00000100:00100000:3.0:1789498718.678211:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789498718.678222:0:18598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876424916158208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498718.678330:0:18598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876424916158208:12345-0@lo:400:kworker.0 Request processed in 110us (5030us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498718.678336:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1789498718.679867:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789498718.679930:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c1600a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876424916158208:0@lo:400:kworker.0 00000100:00100000:2.0:1789498718.686714:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876424916158720:12345-0@lo:400:kworker.0 Request processed in 12812us (13291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498718.686730:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789498718.686945:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876424916158720:0@lo:400:kworker.0 00010000:00010000:1.0:1789498719.549047:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498720.571729:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789498720.834452:0:20667:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789498720.846725:0:20667:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789498720.846817:0:20667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075875f5800/0x70d6b5fa1825da27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825da2e expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.846833:0:20667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075875f5800/0x70d6b5fa1825da27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825da2e expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.846840:0:20667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075875f5800/0x70d6b5fa1825da27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825da2e expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.846847:0:20667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.117@tcp lock: ffffa075875f5800/0x70d6b5fa1825da27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825da2e expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.846867:0:20667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789498720.846884:0:20667:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789498720.846913:0:20667:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789498720.846919:0:20667:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789498720.846925:0:20667:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789498720.846951:0:20667:0:(import.c:65:import_set_state_nolock()) ffffa076a014f000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1789498720.847692:0:18245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498720.847702:0:18245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.117@tcp lock: ffffa075875f5800/0x70d6b5fa1825da27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825da2e expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498720.847712:0:18245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075875f5800 already unused, calling callback (ffffffffc13e6c20) 10000000:00010000:0.0:1789498720.847716:0:18245:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.117@tcp lock: ffffa075875f5800/0x70d6b5fa1825da27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825da2e expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498720.847725:0:18245:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa075875f5800/0x70d6b5fa1825da27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x70d6b5fa1825da2e expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498720.847731:0:18245:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa075875f5800/0x70d6b5fa1825da27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x70d6b5fa1825da2e expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498720.847736:0:18245:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789498720.847750:0:18245:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789498720.847754:0:18245:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789498720.847783:0:18245:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.117@tcp lock: ffffa075875f5800/0x70d6b5fa1825da27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x70d6b5fa1825da2e expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498720.847800:0:18245:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789498720.847828:0:18245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.117@tcp lock: ffffa075875f5800/0x70d6b5fa1825da27 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x70d6b5fa1825da2e expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498720.847835:0:18245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa075875f5800/0x70d6b5fa1825da27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x70d6b5fa1825da2e expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498720.847849:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498720.847851:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498720.847852:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498720.847870:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876424916159872:0@lo:39:umount.0 00000100:00100000:2.0:1789498720.847904:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789498720.847920:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20dec396-e124-4c94-9424-ae01f240e87e:3644:1876424916160000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789498720.847938:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498720.847964:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498720.848031:0:19316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916159872 00000100:00100000:1.0:1789498720.848039:0:19316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916159872 00000100:00100000:1.0:1789498720.848094:0:19316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789498720.848104:0:19316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876424916159872:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789498720.848130:0:19316:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825da58 00000100:00080000:1.0:1789498720.848138:0:19316:0:(import.c:65:import_set_state_nolock()) ffffa07686756000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789498720.848177:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498720.848214:0:19316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3640:x1876424916159872:12345-0@lo:39:umount.0 Request processed in 112us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498720.848221:0:19316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:1.0:1789498720.848230:0:19316:0:(genops.c:885:class_export_put()) final put ffffa07686757800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:3.0:1789498720.848342:0:20121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916160000 00000100:00100000:3.0:1789498720.848346:0:20121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916160000 00000100:00100000:3.0:1789498720.848390:0:20121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789498720.848399:0:20121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586724700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20dec396-e124-4c94-9424-ae01f240e87e+24:3644:x1876424916160000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789498720.848410:0:20121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:2.0:1789498720.848421:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076a014f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:3.0:1789498720.848424:0:20121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa075875f4800/0x70d6b5fa1825da2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70d6b5fa1825da27 expref: 24 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498720.848435:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876424916159872:0@lo:39:umount.0 00010000:00010000:3.0:1789498720.848438:0:20121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:2.0:1789498720.848461:0:20667:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789498720.848465:0:20667:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789498720.848470:0:20667:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1789498720.848475:0:20121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586724700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20dec396-e124-4c94-9424-ae01f240e87e+23:3644:x1876424916160000:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498720.848483:0:20121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789498720.848509:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20dec396-e124-4c94-9424-ae01f240e87e:3644:1876424916160000:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1789498720.848751:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffffa07686757800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789498720.848797:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa07686756000 for lustre-MDT0000 00010000:00010000:2.0:1789498720.850264:0:20667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa0768bda8800/0x70d6b5fa1825d978 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825d97f expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.850280:0:20667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa0768bda8800/0x70d6b5fa1825d978 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825d97f expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.850287:0:20667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa0768bda8800/0x70d6b5fa1825d978 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825d97f expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.850294:0:20667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.117@tcp lock: ffffa0768bda8800/0x70d6b5fa1825d978 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825d97f expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.850315:0:20667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498720.850321:0:20667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c20e1400/0x70d6b5fa1825dd84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825dd8b expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498720.850334:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498720.850335:0:20667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c20e1400/0x70d6b5fa1825dd84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825dd8b expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498720.850343:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.117@tcp lock: ffffa0768bda8800/0x70d6b5fa1825d978 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825d97f expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498720.850352:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0768bda8800 already unused, calling callback (ffffffffc13e6c20) 10000000:00010000:0.0:1789498720.850356:0:17079:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.117@tcp lock: ffffa0768bda8800/0x70d6b5fa1825d978 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825d97f expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498720.850364:0:17079:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa0768bda8800/0x70d6b5fa1825d978 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x70d6b5fa1825d97f expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498720.850371:0:17079:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa0768bda8800/0x70d6b5fa1825d978 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x70d6b5fa1825d97f expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498720.850376:0:17079:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789498720.850385:0:17079:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1789498720.850412:0:17079:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.117@tcp lock: ffffa0768bda8800/0x70d6b5fa1825d978 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x70d6b5fa1825d97f expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498720.850418:0:17079:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789498720.850455:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.117@tcp lock: ffffa0768bda8800/0x70d6b5fa1825d978 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x70d6b5fa1825d97f expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498720.850462:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa0768bda8800/0x70d6b5fa1825d978 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x70d6b5fa1825d97f expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498720.850473:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498720.850475:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498720.850477:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498720.850643:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789498720.850660:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20dec396-e124-4c94-9424-ae01f240e87e:3643:1876424916160128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789498720.850724:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498720.850877:0:17077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916160128 00000100:00100000:0.0:1789498720.850885:0:17077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916160128 00000100:00100000:0.0:1789498720.850965:0:17077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789498720.850974:0:17077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20dec396-e124-4c94-9424-ae01f240e87e+23:3643:x1876424916160128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789498720.850985:0:17077:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498720.850999:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0768bda9a00/0x70d6b5fa1825d97f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70d6b5fa1825d978 expref: 23 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498720.851010:0:17077:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498720.851051:0:17077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20dec396-e124-4c94-9424-ae01f240e87e+22:3643:x1876424916160128:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498720.851058:0:17077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789498720.851261:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20dec396-e124-4c94-9424-ae01f240e87e:3643:1876424916160128:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789498720.852222:0:20667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c20e1400/0x70d6b5fa1825dd84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825dd8b expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.852233:0:20667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.117@tcp lock: ffffa076c20e1400/0x70d6b5fa1825dd84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825dd8b expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.852253:0:20667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498720.852262:0:20667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1571800/0x70d6b5fa1825df21 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825df28 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.852270:0:20667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1571800/0x70d6b5fa1825df21 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825df28 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.852277:0:20667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1571800/0x70d6b5fa1825df21 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825df28 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.852284:0:20667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.117@tcp lock: ffffa076c1571800/0x70d6b5fa1825df21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825df28 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.852297:0:20667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789498720.852309:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789498720.852315:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.117@tcp lock: ffffa076c20e1400/0x70d6b5fa1825dd84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825dd8b expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.852322:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c20e1400 already unused, calling callback (ffffffffc13e6c20) 10000000:00010000:2.0:1789498720.852334:0:17078:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.117@tcp lock: ffffa076c20e1400/0x70d6b5fa1825dd84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825dd8b expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.852343:0:17078:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa076c20e1400/0x70d6b5fa1825dd84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x70d6b5fa1825dd8b expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789498720.852350:0:17078:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa076c20e1400/0x70d6b5fa1825dd84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x70d6b5fa1825dd8b expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498720.852357:0:17078:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789498720.852359:0:17078:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789498720.852361:0:17078:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789498720.852387:0:17078:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.117@tcp lock: ffffa076c20e1400/0x70d6b5fa1825dd84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x70d6b5fa1825dd8b expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.852394:0:17078:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789498720.852412:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.117@tcp lock: ffffa076c20e1400/0x70d6b5fa1825dd84 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x70d6b5fa1825dd8b expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.852418:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa076c20e1400/0x70d6b5fa1825dd84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x70d6b5fa1825dd8b expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.852431:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498720.852434:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.117@tcp lock: ffffa076c1571800/0x70d6b5fa1825df21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825df28 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.852439:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c1571800 already unused, calling callback (ffffffffc13e6c20) 10000000:00010000:2.0:1789498720.852442:0:17078:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.117@tcp lock: ffffa076c1571800/0x70d6b5fa1825df21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825df28 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.852449:0:17078:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa076c1571800/0x70d6b5fa1825df21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x70d6b5fa1825df28 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789498720.852461:0:17078:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa076c1571800/0x70d6b5fa1825df21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x70d6b5fa1825df28 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498720.852466:0:17078:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789498720.852468:0:17078:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789498720.852470:0:17078:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789498720.852483:0:17078:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.117@tcp lock: ffffa076c1571800/0x70d6b5fa1825df21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x70d6b5fa1825df28 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.852488:0:17078:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789498720.852494:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.117@tcp lock: ffffa076c1571800/0x70d6b5fa1825df21 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x70d6b5fa1825df28 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.852502:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa076c1571800/0x70d6b5fa1825df21 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x70d6b5fa1825df28 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.852510:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498720.852511:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498720.852513:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498720.852523:0:20667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa0768bda8200/0x70d6b5fa1825d96a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825d971 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.852549:0:20667:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa0768bda8200/0x70d6b5fa1825d96a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825d971 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.852556:0:20667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa0768bda8200/0x70d6b5fa1825d96a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825d971 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.852563:0:20667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.117@tcp lock: ffffa0768bda8200/0x70d6b5fa1825d96a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825d971 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.852583:0:20667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789498720.852587:0:20667:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1789498720.852589:0:20667:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1789498720.852637:0:20667:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789498720.852641:0:20667:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789498720.852645:0:20667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789498720.852650:0:20667:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1789498720.852656:0:20667:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffffa075810df000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789498720.852662:0:20667:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffffa076c1586000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789498720.852666:0:20667:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffffa07588059800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789498720.852671:0:20667:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffffa076a014d000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789498720.852678:0:20667:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffffa075856df000 009e7412-2a14-4c71-98d7-be20ea80e3db 192.168.204.17@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:2.0:1789498720.852684:0:20667:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffffa075810df800 2e628490-3532-4bd6-bd50-78c84d98cfb9 192.168.204.17@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934624 stale:0 00000020:00080000:2.0:1789498720.852689:0:20667:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffffa075872e19c0) has exports, disconnecting them 00000020:00080000:2.0:1789498720.852693:0:20667:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffffa075810df000), last request at 1789498718 00000020:00000080:2.0:1789498720.852699:0:20667:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825dd53 00000100:00080000:2.0:1789498720.852715:0:20667:0:(import.c:65:import_set_state_nolock()) ffffa075810dc800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789498720.852765:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20dec396-e124-4c94-9424-ae01f240e87e:3641:1876424916160256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789498720.852815:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789498720.852968:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498720.852973:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.117@tcp lock: ffffa0768bda8200/0x70d6b5fa1825d96a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825d971 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.852980:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0768bda8200 already unused, calling callback (ffffffffc13e6c20) 10000000:00010000:2.0:1789498720.852983:0:17078:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.117@tcp lock: ffffa0768bda8200/0x70d6b5fa1825d96a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825d971 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.853000:0:17078:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa0768bda8200/0x70d6b5fa1825d96a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x70d6b5fa1825d971 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789498720.853007:0:17078:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa0768bda8200/0x70d6b5fa1825d96a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x70d6b5fa1825d971 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498720.853012:0:17078:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789498720.853015:0:17078:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789498720.853016:0:17078:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789498720.853030:0:17078:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.117@tcp lock: ffffa0768bda8200/0x70d6b5fa1825d96a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x70d6b5fa1825d971 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.853036:0:17078:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789498720.853054:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.117@tcp lock: ffffa0768bda8200/0x70d6b5fa1825d96a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x70d6b5fa1825d971 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.853061:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa0768bda8200/0x70d6b5fa1825d96a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x70d6b5fa1825d971 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.853138:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498720.853140:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498720.853141:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789498720.853155:0:20667:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffffa075810df000): rc 0 00000020:00000080:2.0:1789498720.853157:0:20667:0:(genops.c:885:class_export_put()) final put ffffa075810df000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789498720.853167:0:20667:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffffa076c1586000), last request at 1789498718 00000020:00000080:2.0:1789498720.853171:0:20667:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825dbf5 00000100:00080000:2.0:1789498720.853176:0:20667:0:(import.c:65:import_set_state_nolock()) ffffa076c1587800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789498720.853185:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789498720.853191:0:20667:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffffa076c1586000): rc 0 00000020:00000080:2.0:1789498720.853198:0:20667:0:(genops.c:885:class_export_put()) final put ffffa076c1586000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1789498720.853203:0:20667:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffffa07588059800), last request at 1789498645 00000020:00000080:2.0:1789498720.853206:0:20667:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825db46 00000100:00080000:2.0:1789498720.853209:0:20667:0:(import.c:65:import_set_state_nolock()) ffffa07588059000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789498720.853218:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789498720.853224:0:20667:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffffa07588059800): rc 0 00000020:00000080:2.0:1789498720.853226:0:20667:0:(genops.c:885:class_export_put()) final put ffffa07588059800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1789498720.853229:0:20667:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffffa076a014d000), last request at 1789498645 00000020:00000080:2.0:1789498720.853232:0:20667:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825daeb 00000100:00080000:2.0:1789498720.853235:0:20667:0:(import.c:65:import_set_state_nolock()) ffffa076a014a000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789498720.853242:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1789498720.853248:0:20667:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934629 00000020:00080000:2.0:1789498720.853317:0:20667:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffffa076a014d000): rc 0 00000004:00000080:2.0:1789498720.853322:0:20667:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb687856e7ae0 00000100:00080000:2.0:1789498720.853338:0:20667:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789498720.853342:0:20667:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789498720.854383:0:20667:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789498720.854407:0:20667:0:(import.c:65:import_set_state_nolock()) ffffa076bc354000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789498720.854456:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916160640:0@lo:39:umount.0 00000100:00100000:2.0:1789498720.854507:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498720.855702:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789498720.855723:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20dec396-e124-4c94-9424-ae01f240e87e:3644:1876424916160512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789498720.855781:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498720.863305:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916160256 00000100:00100000:2.0:1789498720.863319:0:17076:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916160256 00000100:00100000:3.0:1789498720.864325:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916160512 00000100:00100000:3.0:1789498720.864332:0:17075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916160512 00000100:00100000:1.0:1789498720.864383:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916160640 00000100:00100000:1.0:1789498720.864389:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916160640 00000100:00100000:3.0:1789498720.864417:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789498720.864432:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789498720.864434:0:17075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0768524b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20dec396-e124-4c94-9424-ae01f240e87e+23:3644:x1876424916160512:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789498720.864443:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876424916160640:12345-0@lo:39:umount.0 00010000:00010000:3.0:1789498720.864452:0:17075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:1.0:1789498720.864471:0:17097:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825db70 00010000:00010000:3.0:1789498720.864473:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0768bda9800/0x70d6b5fa1825d971 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70d6b5fa1825d96a expref: 23 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789498720.864481:0:17097:0:(import.c:65:import_set_state_nolock()) ffffa076b0721800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789498720.864494:0:17075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00000004:1.0:1789498720.864504:0:17097:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1789498720.864570:0:17075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0768524b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20dec396-e124-4c94-9424-ae01f240e87e+22:3644:x1876424916160512:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (8788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498720.864594:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789498720.864727:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3640:x1876424916160640:12345-0@lo:39:umount.0 Request processed in 287us (10219us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1789498720.864733:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:1.0:1789498720.864763:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498720.864799:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789498720.864808:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20dec396-e124-4c94-9424-ae01f240e87e:3641:1876424916160384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789498720.864840:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498720.864988:0:17077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916160384 00000100:00100000:0.0:1789498720.864993:0:17077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916160384 00000100:00100000:2.0:1789498720.865031:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789498720.865042:0:17076:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075877dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20dec396-e124-4c94-9424-ae01f240e87e+22:3641:x1876424916160256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789498720.865052:0:17076:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498720.865071:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa076c20e0e00/0x70d6b5fa1825dd8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70d6b5fa1825dd84 expref: 22 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498720.865085:0:17076:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498720.865118:0:17076:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075877dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20dec396-e124-4c94-9424-ae01f240e87e+21:3641:x1876424916160256:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (12302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498720.865125:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000020:00000080:0.0:1789498720.865134:0:15719:0:(genops.c:844:class_export_destroy()) destroying export ffffa075810df000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:2.0:1789498720.865174:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789498720.865185:0:15719:0:(genops.c:844:class_export_destroy()) destroying export ffffa076c1586000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:2.0:1789498720.865219:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20dec396-e124-4c94-9424-ae01f240e87e:3644:1876424916160512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789498720.865247:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20dec396-e124-4c94-9424-ae01f240e87e:3641:1876424916160256:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1789498720.865266:0:15719:0:(genops.c:844:class_export_destroy()) destroying export ffffa07588059800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789498720.865295:0:15719:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa075810dc800 for lustre-MDT0000 00000020:00000080:0.0:1789498720.865300:0:15719:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa076c1587800 for lustre-MDT0000 00000020:00000080:0.0:1789498720.865303:0:15719:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa07588059000 for lustre-MDT0000 00010000:00010000:0.0:1789498720.865315:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498720.865351:0:17077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789498720.865359:0:17077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20dec396-e124-4c94-9424-ae01f240e87e+20:3641:x1876424916160384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789498720.865366:0:17077:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498720.865376:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa076bc6d9400/0x70d6b5fa1825df28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70d6b5fa1825df21 expref: 20 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498720.865385:0:17077:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498720.865412:0:17077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20dec396-e124-4c94-9424-ae01f240e87e+19:3641:x1876424916160384:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498720.865417:0:17077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789498720.865582:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20dec396-e124-4c94-9424-ae01f240e87e:3641:1876424916160384:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789498720.866255:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076bc354000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789498720.866265:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916160640:0@lo:39:umount.0 00000100:00080000:1.0:1789498720.867193:0:20667:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789498720.867199:0:20667:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:1.0:1789498720.867218:0:20667:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789498720.867284:0:20667:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789498720.867308:0:20667:0:(import.c:65:import_set_state_nolock()) ffffa076bef76000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789498720.867329:0:20667:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789498720.867331:0:20667:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:1.0:1789498720.867362:0:20667:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789498720.867425:0:20667:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1789498720.867447:0:20667:0:(import.c:65:import_set_state_nolock()) ffffa076a9c39000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1789498720.867495:0:20667:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffffa075872e19c0) has no exports 00000100:00100000:2.0:1789498720.868018:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916160768:0@lo:9:umount.0 00000100:00100000:2.0:1789498720.868074:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498720.868097:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916160896:0@lo:9:umount.0 00000100:00100000:2.0:1789498720.868116:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498720.868205:0:20235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916160768 00000100:00100000:3.0:1789498720.868213:0:20235:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916160768 00000100:00100000:3.0:1789498720.868273:0:20235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916160896 00000100:00100000:3.0:1789498720.868277:0:20235:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916160896 00000100:00100000:3.0:1789498720.868297:0:20235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789498720.868307:0:20235:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076aa20d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1876424916160768:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789498720.868331:0:20235:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825dc3b 00000100:00080000:3.0:1789498720.868340:0:20235:0:(import.c:65:import_set_state_nolock()) ffffa075875a5000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789498720.868377:0:20235:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1789498720.868513:0:20235:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076aa20d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3640:x1876424916160768:12345-0@lo:9:umount.0 Request processed in 207us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498720.868520:0:20235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789498720.868558:0:20235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789498720.868566:0:20235:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1876424916160896:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789498720.868583:0:20235:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825dd92 00000100:00080000:3.0:1789498720.868589:0:20235:0:(import.c:65:import_set_state_nolock()) ffffa075810d9800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789498720.868610:0:20235:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1789498720.868682:0:20235:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3640:x1876424916160896:12345-0@lo:9:umount.0 Request processed in 116us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498720.868688:0:20235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:3.0:1789498720.868710:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498720.868714:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789498720.868735:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076bef76000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789498720.868761:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789498720.868772:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789498720.868775:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916160768:0@lo:9:umount.0 00000100:00080000:3.0:1789498720.868789:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076a9c39000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789498720.868794:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789498720.868796:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789498720.868798:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916160896:0@lo:9:umount.0 00000100:00080000:2.0:1789498720.868881:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789498720.868886:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:1.0:1789498720.891120:0:20667:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffffa075872e19c0) has no exports 00000020:00000080:1.0:1789498720.933877:0:20667:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825d9c5 00000020:00000080:1.0:1789498720.933892:0:20667:0:(genops.c:885:class_export_put()) final put ffffa07688c41800/lustre-QMT0000_UUID 00000020:01000000:1.0:1789498720.933941:0:20667:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1789498720.933951:0:20667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789498720.933961:0:20667:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789498720.933965:0:20667:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffffa07585734d40) has no exports 00000020:00000080:1.0:1789498720.934275:0:20667:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825d9be 00000020:00000080:1.0:1789498720.934281:0:20667:0:(genops.c:885:class_export_put()) final put ffffa076beb70800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789498720.934308:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffffa07688c41800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1789498720.934501:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffffa076beb70800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789498720.934730:0:20667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789498720.934858:0:20667:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789498720.934862:0:20667:0:(genops.c:885:class_export_put()) final put ffffa076beb72800/lustre-QMT0000_UUID 00000020:00000080:1.0:1789498720.934865:0:20667:0:(genops.c:844:class_export_destroy()) destroying export ffffa076beb72800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1789498720.934872:0:20667:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:0.0:1789498721.597898:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498721.725995:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789498721.726020:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916161024:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789498721.726105:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498721.726161:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916161024 00000100:00100000:1.0:1789498721.726170:0:18602:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916161024 00000100:00100000:1.0:1789498721.726223:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789498721.726233:0:18602:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916161024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789498721.726262:0:18602:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789498721.726302:0:18602:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916161024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498721.726308:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1789498721.726329:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789498721.726360:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916161024:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1789498721.728121:0:19413:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789498721.728134:0:19413:0:(genops.c:885:class_export_put()) final put ffffa075810dd800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789498721.728161:0:19413:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2e628490-3532-4bd6-bd50-78c84d98cfb9 00000020:00000080:0.0:1789498721.728163:0:19413:0:(genops.c:885:class_export_put()) final put ffffa075856db800/2e628490-3532-4bd6-bd50-78c84d98cfb9 00000020:00000080:2.0:1789498721.728269:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffffa075810dd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789498721.728323:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffffa075856db800/2e628490-3532-4bd6-bd50-78c84d98cfb9 for lustre-OST0001 00000020:00000080:2.0:1789498721.728341:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa075810d9800 for lustre-OST0001 00000020:00000080:2.0:1789498721.728346:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa075856d9800 for lustre-OST0001 00000001:00100000:0.0:1789498721.729755:0:17070:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789498721.729761:0:17070:0:(genops.c:885:class_export_put()) final put ffffa076a014d000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789498721.729788:0:17070:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 009e7412-2a14-4c71-98d7-be20ea80e3db 00000001:00080000:0.0:1789498721.729799:0:17070:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934629 is committed 00000020:00000080:0.0:1789498721.729802:0:17070:0:(genops.c:885:class_export_put()) final put ffffa075856df000/009e7412-2a14-4c71-98d7-be20ea80e3db 00000001:00100000:0.0:1789498721.729807:0:17070:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2e628490-3532-4bd6-bd50-78c84d98cfb9 00000001:00080000:0.0:1789498721.729824:0:17070:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:0.0:1789498721.729830:0:17070:0:(genops.c:885:class_export_put()) final put ffffa075810df800/2e628490-3532-4bd6-bd50-78c84d98cfb9 00000020:00000080:2.0:1789498721.730284:0:15719:0:(genops.c:844:class_export_destroy()) destroying export ffffa076a014d000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1789498721.730332:0:15719:0:(genops.c:844:class_export_destroy()) destroying export ffffa075856df000/009e7412-2a14-4c71-98d7-be20ea80e3db for lustre-MDT0000 00000020:00000080:2.0:1789498721.730361:0:15719:0:(genops.c:844:class_export_destroy()) destroying export ffffa075810df800/2e628490-3532-4bd6-bd50-78c84d98cfb9 for lustre-MDT0000 00000020:00000080:2.0:1789498721.730391:0:15719:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa076a014a000 for lustre-MDT0000 00000020:00000080:2.0:1789498721.730397:0:15719:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa075856da000 for lustre-MDT0000 00000020:00000080:2.0:1789498721.730408:0:15719:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa075810db000 for lustre-MDT0000 00000001:00100000:1.0:1789498721.730864:0:17823:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789498721.730873:0:17823:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:1.0:1789498721.730876:0:17823:0:(genops.c:885:class_export_put()) final put ffffa0758805e800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789498721.730895:0:17823:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 009e7412-2a14-4c71-98d7-be20ea80e3db 00000001:00080000:1.0:1789498721.730900:0:17823:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:1.0:1789498721.730902:0:17823:0:(genops.c:885:class_export_put()) final put ffffa075856de800/009e7412-2a14-4c71-98d7-be20ea80e3db 00000001:00100000:1.0:1789498721.730907:0:17823:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2e628490-3532-4bd6-bd50-78c84d98cfb9 00000001:00080000:1.0:1789498721.730911:0:17823:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:1.0:1789498721.730912:0:17823:0:(genops.c:885:class_export_put()) final put ffffa075810d8800/2e628490-3532-4bd6-bd50-78c84d98cfb9 00000020:00000080:2.0:1789498721.730964:0:15719:0:(genops.c:844:class_export_destroy()) destroying export ffffa0758805e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1789498721.730999:0:15719:0:(genops.c:844:class_export_destroy()) destroying export ffffa075856de800/009e7412-2a14-4c71-98d7-be20ea80e3db for lustre-MDT0001 00000020:00000080:2.0:1789498721.731019:0:15719:0:(genops.c:844:class_export_destroy()) destroying export ffffa075810d8800/2e628490-3532-4bd6-bd50-78c84d98cfb9 for lustre-MDT0001 00000020:00000080:2.0:1789498721.731039:0:15719:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa076b0721800 for lustre-MDT0001 00000020:00000080:2.0:1789498721.731042:0:15719:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa0758832b000 for lustre-MDT0001 00000020:00000080:2.0:1789498721.731047:0:15719:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa076bbe11800 for lustre-MDT0001 00000100:00100000:0.0:1789498722.238091:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789498722.238114:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876424916161152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789498722.238180:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498722.238994:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916161152 00000100:00100000:3.0:1789498722.239005:0:17096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916161152 00000100:00100000:3.0:1789498722.239060:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789498722.239069:0:17096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1876424916161152:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1789498722.239077:0:17096:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789498722.239136:0:17096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3642:x1876424916161152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (955us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789498722.239143:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:02020000:0.0:1789498722.239283:0:3642:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1789498722.248025:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789498722.248033:0:3642:0:(import.c:65:import_set_state_nolock()) ffffa076bc352000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789498722.249926:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789498722.267042:0:3642:0:(import.c:65:import_set_state_nolock()) ffffa076bc352000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789498722.267055:0:3642:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 479 00000100:00080000:0.0:1789498722.267071:0:3642:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffffa076bc352000 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:0.0:1789498722.267111:0:3642:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa075874f4a80 x1876424916161280/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789498722.268336:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876424916161280:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1789498722.268414:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498722.268507:0:17832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916161280 00000100:00100000:0.0:1789498722.268522:0:17832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916161280 00000100:00100000:0.0:1789498722.268582:0:17832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789498722.268589:0:17832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1876424916161280:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1789498722.268604:0:17832:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789498722.275056:0:17832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1876424916161280:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 6458us (6633us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789498722.275071:0:17832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1789498722.275752:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076bc352000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789498722.275758:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789498722.275762:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876424916161280:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:3.0:1789498722.621175:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789498722.939676:0:20667:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0758150c420 - data ffffa07690ab71b0/ffffa075880ee400 00000020:01000000:1.0:1789498722.939862:0:20667:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa076a0159060 - data ffffa076a7ac8e58/ffffa07685baec00 00000001:00000004:1.0:1789498722.952878:0:20667:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934629 00000100:00080000:0.0:1789498723.071018:0:20667:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789498723.071028:0:20667:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789498723.071043:0:20667:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffffa07586724e00 x1876424916160640/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789498730 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498723.071095:0:20667:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789498723.081742:0:20667:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789498723.081750:0:20667:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:0.0:1789498723.081764:0:20667:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789498723.081766:0:20667:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789498723.082387:0:17115:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789498723.082392:0:17115:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1789498723.082402:0:17115:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1789498723.083163:0:20667:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789498723.083167:0:20667:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:2.0:1789498723.083182:0:20667:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789498723.083184:0:20667:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789498723.085275:0:17117:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789498723.085282:0:17117:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:3.0:1789498723.085301:0:17117:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1789498723.087310:0:20667:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825d98d 00000020:00000080:2.0:1789498723.087320:0:20667:0:(genops.c:885:class_export_put()) final put ffffa076bc356800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789498723.087826:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffffa076bc356800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789498723.089507:0:20667:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825d9a2 00000020:00000080:3.0:1789498723.089517:0:20667:0:(genops.c:885:class_export_put()) final put ffffa07688c7a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789498723.089556:0:20667:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1789498723.089569:0:20667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789498723.089577:0:20667:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789498723.089582:0:20667:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffffa075872e4d40) has no exports 00000020:00000080:0.0:1789498723.089746:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffffa07688c7a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1789498723.090183:0:20667:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789498723.090192:0:20667:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825da04 00000020:00000080:3.0:1789498723.090196:0:20667:0:(genops.c:885:class_export_put()) final put ffffa076a9c39800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789498723.090246:0:20667:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789498723.090251:0:20667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789498723.090256:0:20667:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789498723.090259:0:20667:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffffa076906099c0) has no exports 00000020:00000080:3.0:1789498723.090265:0:20667:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825d9fd 00000020:00000080:3.0:1789498723.090269:0:20667:0:(genops.c:885:class_export_put()) final put ffffa076a9c3b800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789498723.095047:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffffa076a9c39800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789498723.098520:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffffa076a9c3b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1789498723.099374:0:20667:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789498723.099379:0:20667:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789498723.099384:0:20667:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:3.0:1789498723.099390:0:20667:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789498723.099393:0:20667:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789498723.099575:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa076a9c39000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789498723.099786:0:20667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789498723.099796:0:20667:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789498723.099801:0:20667:0:(genops.c:885:class_export_put()) final put ffffa076a9c38800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789498723.099804:0:20667:0:(genops.c:844:class_export_destroy()) destroying export ffffa076a9c38800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1789498723.099810:0:20667:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789498723.099917:0:20667:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825d9ef 00000020:00000080:3.0:1789498723.099924:0:20667:0:(genops.c:885:class_export_put()) final put ffffa076a9c3a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789498723.099938:0:20667:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789498723.099942:0:20667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789498723.099947:0:20667:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789498723.099950:0:20667:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffffa0769060cd40) has no exports 00000020:00000080:3.0:1789498723.099955:0:20667:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825d9e8 00000020:00000080:3.0:1789498723.099959:0:20667:0:(genops.c:885:class_export_put()) final put ffffa076bef75000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1789498723.100814:0:20667:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789498723.100819:0:20667:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789498723.100939:0:20667:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:3.0:1789498723.100944:0:20667:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789498723.100946:0:20667:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789498723.101042:0:20667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789498723.101049:0:20667:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1789498723.101062:0:20667:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1789498723.101068:0:20667:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825d9da 00000020:00000080:3.0:1789498723.101073:0:20667:0:(genops.c:885:class_export_put()) final put ffffa076bef75800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789498723.101077:0:20667:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1789498723.101080:0:20667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789498723.101083:0:20667:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789498723.101086:0:20667:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffffa07690608000) has no exports 00000020:00000080:3.0:1789498723.101090:0:20667:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825d9d3 00000020:00000080:3.0:1789498723.101092:0:20667:0:(genops.c:885:class_export_put()) final put ffffa076bc350800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789498723.101193:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffffa076a9c3a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789498723.101201:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffffa076bef75000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789498723.101205:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa076bef76000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789498723.101210:0:8:0:(genops.c:885:class_export_put()) final put ffffa076bef74000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789498723.101212:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffffa076bef74000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1789498723.101215:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789498723.101267:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffffa076bef75800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1789498723.101271:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffffa076bc350800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789498723.106739:0:20667:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1789498723.106748:0:20667:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789498723.106752:0:20667:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789498723.106759:0:20667:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789498723.106991:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa076bc354000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1789498723.118204:0:20667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789498723.118220:0:20667:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789498723.118226:0:20667:0:(genops.c:885:class_export_put()) final put ffffa07688c42000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789498723.118230:0:20667:0:(genops.c:844:class_export_destroy()) destroying export ffffa07688c42000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1789498723.118244:0:20667:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789498723.118369:0:20667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789498723.118373:0:20667:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789498723.118376:0:20667:0:(genops.c:885:class_export_put()) final put ffffa076bc351800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789498723.118378:0:20667:0:(genops.c:844:class_export_destroy()) destroying export ffffa076bc351800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789498723.118382:0:20667:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789498723.118448:0:20667:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825d9a9 00000020:00000080:0.0:1789498723.118456:0:20667:0:(genops.c:885:class_export_put()) final put ffffa07688c7e800/lustre-MDD0000_UUID 00000020:01000000:0.0:1789498723.118475:0:20667:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789498723.118479:0:20667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789498723.118483:0:20667:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789498723.118487:0:20667:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffffa075872e3380) has no exports 00000020:00000080:0.0:1789498723.118522:0:20667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789498723.118526:0:20667:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789498723.118550:0:20667:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825d9b0 00000020:00000080:0.0:1789498723.118555:0:20667:0:(genops.c:885:class_export_put()) final put ffffa07688c78000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789498723.118565:0:20667:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa07684c2f000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789498723.118568:0:20667:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa07684c2f000 3 00000020:01000004:0.0:1789498723.118571:0:20667:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa07684c2f000 from lustre-MDT0000 00000020:00000080:2.0:1789498723.118740:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffffa07688c7e800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1789498723.118746:0:8:0:(genops.c:885:class_export_put()) final put ffffa076981d5800/lustre-MDD0000_UUID 00000020:00000080:2.0:1789498723.118748:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffffa076981d5800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1789498723.118755:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1789498723.118808:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffffa07688c78000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789498723.118957:0:20667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789498723.118962:0:20667:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789498723.118964:0:20667:0:(genops.c:885:class_export_put()) final put ffffa076bc350000/lustre-MDT0000_UUID 00000020:00000080:0.0:1789498723.118967:0:20667:0:(genops.c:844:class_export_destroy()) destroying export ffffa076bc350000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789498723.118974:0:20667:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789498723.119006:0:20667:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1789498723.119010:0:20667:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789498723.119013:0:20667:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789498723.119016:0:20667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789498723.119019:0:20667:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789498723.119025:0:20667:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffffa075882b7800 20dec396-e124-4c94-9424-ae01f240e87e 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789498723.119030:0:20667:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffffa075866699c0) has exports, disconnecting them 00000020:00080000:0.0:1789498723.119034:0:20667:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffffa075882b7800), last request at 1789498630 00000020:00000080:0.0:1789498723.119050:0:20667:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825d955 00000020:00010000:0.0:1789498723.119053:0:20667:0:(genops.c:1920:obd_stale_export_put()) Put export ffffa075882b7800: total 0 00000100:00080000:0.0:1789498723.119058:0:20667:0:(import.c:65:import_set_state_nolock()) ffffa075882b2800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789498723.119080:0:20667:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffffa075882b7800): rc 0 00000020:00080000:0.0:1789498723.119084:0:20667:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffffa075866699c0) has no exports 00000100:00100000:0.0:1789498723.119166:0:17084:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffffa07683cf4e00:17084] 1 exiting: rc = 0 00000100:00100000:0.0:1789498723.119260:0:17085:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffffa076bc4b4a00:17085] 2 exiting: rc = 0 00000020:00010000:2.0:1789498723.119394:0:17078:0:(genops.c:1906:obd_stale_export_get()) Get export ffffa075882b7800: total 0 00010000:00010000:2.0:1789498723.119398:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498723.119424:0:17078:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa075882b7800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1789498723.119463:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa076bc6d8400/0x70d6b5fa1825df1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70d6b5fa1825df13 expref: 14 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498723.119480:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa075874a0600/0x70d6b5fa1825da90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70d6b5fa1825da89 expref: 13 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498723.119492:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa076bc6d8600/0x70d6b5fa1825dd3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70d6b5fa1825dd37 expref: 12 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498723.119501:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa075874a1e00/0x70d6b5fa1825d963 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70d6b5fa1825d95c expref: 11 pid: 17084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498723.119512:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa075875f5400/0x70d6b5fa1825dd7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70d6b5fa1825dd76 expref: 10 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498723.119525:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa075875f5000/0x70d6b5fa1825dbe0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70d6b5fa1825dbd9 expref: 9 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498723.119553:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa076bc6d9800/0x70d6b5fa1825df0c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70d6b5fa1825df05 expref: 8 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498723.119563:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa075875f5c00/0x70d6b5fa1825dd14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70d6b5fa1825dd0d expref: 7 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498723.119573:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa075874a0400/0x70d6b5fa1825dbb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70d6b5fa1825dbaf expref: 6 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498723.119607:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa076813d6000/0x70d6b5fa1825defe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70d6b5fa1825def7 expref: 5 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498723.119618:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa075875f4000/0x70d6b5fa1825da74 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70d6b5fa1825da6d expref: 4 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498723.119631:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa075874a0c00/0x70d6b5fa1825db31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70d6b5fa1825db2a expref: 3 pid: 17085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498723.119643:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa075875f4c00/0x70d6b5fa1825da82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x70d6b5fa1825da7b expref: 2 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498723.119653:0:17078:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa075882b7800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1789498723.119667:0:17078:0:(genops.c:885:class_export_put()) final put ffffa075882b7800/20dec396-e124-4c94-9424-ae01f240e87e 00010000:00010000:2.0:1789498723.119677:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498723.119679:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498723.119680:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789498723.119687:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffffa075882b7800/20dec396-e124-4c94-9424-ae01f240e87e for MGS 00000020:00000080:2.0:1789498723.119726:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa075882b2800 for MGS 00000100:00100000:2.0:1789498723.119760:0:17083:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffffa076a0bd5200:17083] 0 exiting: rc = 1 00000100:00100000:0.0:1789498723.119858:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.119865:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.119870:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.119875:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.119881:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.119893:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.119899:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.119905:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.119911:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.119917:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.119922:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.119928:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.119933:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.119938:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.119943:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.119948:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.119954:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.119959:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.119965:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.119971:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.119976:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.119981:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.119986:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.119991:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.119996:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120002:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120007:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120014:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120020:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120025:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120033:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120041:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120046:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120052:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120057:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120063:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120068:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120074:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120079:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120085:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120111:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120118:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120124:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120129:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120134:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120139:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120145:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120150:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120156:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120161:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120167:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120173:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120178:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120184:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120189:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120194:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120199:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120204:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120209:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120215:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120221:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120226:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120232:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498723.120237:0:20667:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1789498723.129928:0:20667:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa076bec7bb40 - data ffffa076897fcca8/ffffa076bbea2400 00000020:01000000:0.0:1789498723.130061:0:20667:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa07586552540 - data ffffa076a7a00000/ffffa076bedcf800 00000020:00000080:0.0:1789498723.130925:0:20667:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825d939 00000020:00000080:0.0:1789498723.130933:0:20667:0:(genops.c:885:class_export_put()) final put ffffa075882b4000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789498723.130947:0:20667:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa07684c2f000 from MGS, refs=2 00000020:01000004:0.0:1789498723.130951:0:20667:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa07684c2f000 2 00000020:01000004:0.0:1789498723.130954:0:20667:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa07684c2f000 from MGS 00000020:00000080:0.0:1789498723.130974:0:20667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789498723.130979:0:20667:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1789498723.130982:0:20667:0:(genops.c:885:class_export_put()) final put ffffa075882b3000/MGS 00000020:00000080:0.0:1789498723.130996:0:20667:0:(genops.c:844:class_export_destroy()) destroying export ffffa075882b3000/MGS for MGS 00000020:01000000:0.0:1789498723.131002:0:20667:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1789498723.131062:0:20667:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1789498723.131067:0:20667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789498723.131072:0:20667:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789498723.131079:0:20667:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffffa0768b4fe000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789498723.131085:0:20667:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffffa076beff0000) has exports, disconnecting them 00000020:00080000:0.0:1789498723.131089:0:20667:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffffa0768b4fe000), last request at 1789498630 00000020:00000080:0.0:1789498723.131093:0:20667:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825da3c 00000020:00080000:0.0:1789498723.131205:0:20667:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0768b4fe000): rc 0 00000020:00000080:0.0:1789498723.131210:0:20667:0:(genops.c:885:class_export_put()) final put ffffa0768b4fe000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789498723.131498:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffffa075882b4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789498723.131506:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffffa0768b4fe000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1789498723.310577:0:20667:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1789498723.310586:0:20667:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789498723.310590:0:20667:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789498723.310596:0:20667:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789498723.310625:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa076a014f000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789498723.310808:0:20667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789498723.310838:0:20667:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1789498723.310845:0:20667:0:(genops.c:885:class_export_put()) final put ffffa076a014f800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789498723.310848:0:20667:0:(genops.c:844:class_export_destroy()) destroying export ffffa076a014f800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1789498723.310858:0:20667:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1789498723.310945:0:20667:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa07684c2f000 1 00000020:00000080:2.0:1789498723.310951:0:20667:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825d92b 00000020:00000080:2.0:1789498723.310957:0:20667:0:(genops.c:885:class_export_put()) final put ffffa075882b4800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1789498723.310966:0:20667:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1789498723.310973:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffffa075882b4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789498723.310983:0:20667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789498723.310987:0:20667:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789498723.310990:0:20667:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffffa075872e0000) has no exports 00000020:00000080:0.0:1789498723.449399:0:20667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789498723.449412:0:20667:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789498723.449650:0:20667:0:(genops.c:885:class_export_put()) final put ffffa07684c2a000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789498723.449655:0:20667:0:(genops.c:844:class_export_destroy()) destroying export ffffa07684c2a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789498723.449666:0:20667:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789498723.449782:0:20667:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa07684c28800 00000020:02000400:0.0:1789498723.449837:0:20667:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1789498723.643710:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789498723.778100:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789498723.778107:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789498723.778111:0:8:0:(import.c:65:import_set_state_nolock()) ffffa076bc352000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789498723.778120:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 556 00000100:00080000:0.0:1789498723.778125:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789498723.778136:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffffa076bc352000 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:0.0:1789498723.778162:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa075874f4a80 x1876424916161536/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789498723.778285:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20dec396-e124-4c94-9424-ae01f240e87e:3642:1876424916161408:0@lo:400:kworker.0 00000400:00000100:1.0:1789498723.778332:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876424916161408 offset 0 length 224: 4 00000100:00100000:1.0:1789498723.778376:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876424916162048:0@lo:400:kworker.0 00000100:00100000:1.0:1789498723.778405:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498723.778432:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789498723.778437:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876424916161920:0@lo:400:kworker.0 00000100:00100000:1.0:1789498723.778457:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498723.778470:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876424916162432:0@lo:400:kworker.0 00000100:00100000:1.0:1789498723.778486:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498723.778507:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916161664:0@lo:400:kworker.0 00000100:00100000:1.0:1789498723.778528:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498723.778571:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876424916162176:0@lo:400:kworker.0 00000100:00100000:1.0:1789498723.778618:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498723.778634:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789498723.778639:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916161792:0@lo:400:kworker.0 00000100:00100000:1.0:1789498723.778656:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498723.778671:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876424916162304:0@lo:400:kworker.0 00000100:00100000:1.0:1789498723.778700:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498723.778725:0:20242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916162048 00000100:00100000:1.0:1789498723.778732:0:20242:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916162048 00000100:00100000:1.0:1789498723.778755:0:20242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916161920 00000100:00100000:1.0:1789498723.778757:0:20242:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916161920 00000100:00100000:1.0:1789498723.778763:0:20242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916162432 00000100:00100000:1.0:1789498723.778765:0:20242:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916162432 00000100:00100000:1.0:1789498723.778786:0:20242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916162176 00000100:00100000:1.0:1789498723.778788:0:20242:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916162176 00000100:00100000:1.0:1789498723.778798:0:20242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916162304 00000100:00100000:1.0:1789498723.778800:0:20242:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916162304 00000100:00100000:1.0:1789498723.778809:0:20242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789498723.778816:0:20242:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c1603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876424916162432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498723.778857:0:20242:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c1603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876424916162432:12345-0@lo:400:kworker.0 Request processed in 42us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498723.778864:0:20242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789498723.778879:0:20242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789498723.778884:0:20242:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9de7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876424916162176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498723.778906:0:20242:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9de7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876424916162176:12345-0@lo:400:kworker.0 Request processed in 22us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498723.778911:0:20242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789498723.778921:0:20242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789498723.778924:0:20242:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1876424916162048:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789498723.778935:0:20242:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789498723.778955:0:20242:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1876424916162048:12345-0@lo:400:kworker.0 Request processed in 30us (551us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789498723.778961:0:20242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789498723.778970:0:20242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789498723.778974:0:20242:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c1600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1876424916161920:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789498723.778977:0:20242:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789498723.778991:0:20242:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c1600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3642:x1876424916161920:12345-0@lo:400:kworker.0 Request processed in 17us (534us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789498723.778996:0:20242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789498723.779004:0:20242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789498723.779007:0:20242:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9de4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1876424916162304:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789498723.779011:0:20242:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789498723.779024:0:20242:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9de4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3643:x1876424916162304:12345-0@lo:400:kworker.0 Request processed in 16us (324us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789498723.779029:0:20242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789498723.779069:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916161664 00000100:00100000:1.0:1789498723.779072:0:18599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916161664 00000100:00100000:1.0:1789498723.779094:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916161792 00000100:00100000:1.0:1789498723.779096:0:18599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916161792 00000100:00100000:1.0:1789498723.779113:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789498723.779118:0:18599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076981b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916161664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498723.779144:0:18599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076981b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916161664:12345-0@lo:400:kworker.0 Request processed in 26us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498723.779150:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789498723.779158:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789498723.779163:0:18599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9de5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916161792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498723.779193:0:18599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9de5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916161792:12345-0@lo:400:kworker.0 Request processed in 30us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498723.779198:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1789498723.779232:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789498723.779236:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789498723.779238:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789498723.779267:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916161792:0@lo:400:kworker.0 00000100:00080000:1.0:1789498723.779276:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789498723.779280:0:3643:0:(import.c:65:import_set_state_nolock()) ffffa076bc788800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789498723.779284:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789498723.779288:0:3643:0:(import.c:65:import_set_state_nolock()) ffffa076bc788800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789498723.779291:0:3643:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 511 00000100:00080000:1.0:1789498723.779295:0:3643:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa076bc788800 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:1.0:1789498723.779309:0:3643:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa076a9de6680 x1876424916162688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789498723.779321:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876424916162304:0@lo:400:kworker.0 00000100:00100000:1.0:1789498723.779330:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916161664:0@lo:400:kworker.0 00010000:00080000:1.0:1789498723.779338:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffffa075874f5880 x1876424916162176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498723.779346:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876424916162176:0@lo:400:kworker.0 00000100:00100000:1.0:1789498723.779370:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876424916162560:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789498723.779392:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789498723.779410:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789498723.779418:0:3642:0:(import.c:65:import_set_state_nolock()) ffffa076c1585800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789498723.779421:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789498723.779424:0:3642:0:(import.c:65:import_set_state_nolock()) ffffa076c1585800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789498723.779427:0:3642:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 479 00000100:00080000:1.0:1789498723.779432:0:3642:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffffa076c1585800 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:1.0:1789498723.779443:0:3642:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa076a9de5c00 x1876424916162816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789498723.779451:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876424916161920:0@lo:400:kworker.0 00010000:00080000:1.0:1789498723.779462:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffffa075874f7480 x1876424916162432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498723.779469:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876424916162432:0@lo:400:kworker.0 00000100:00080000:1.0:1789498723.779476:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789498723.779479:0:3642:0:(import.c:65:import_set_state_nolock()) ffffa075856d8800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789498723.779482:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789498723.779484:0:3642:0:(import.c:65:import_set_state_nolock()) ffffa075856d8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789498723.779487:0:3642:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 495 00000100:00080000:1.0:1789498723.779491:0:3642:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa075856d8800 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:1.0:1789498723.779499:0:3642:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa076a9de7800 x1876424916162944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789498723.779508:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876424916162048:0@lo:400:kworker.0 00000100:00100000:1.0:1789498723.779529:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916162560 00000100:00100000:1.0:1789498723.779548:0:18601:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916162560 00000100:00100000:1.0:1789498723.779574:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789498723.779579:0:18601:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9de5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876424916162560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789498723.779601:0:18601:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1789498723.779630:0:18601:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9de5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876424916162560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498723.779636:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789498723.779662:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876424916162560:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789498723.780414:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876424916161536:0@lo:38:kworker.0 00000100:00100000:0.0:1789498723.780453:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498723.780479:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1876424916162688:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1789498723.780496:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498723.780557:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876424916162816:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1789498723.780575:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498723.783398:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916161536 00000100:00100000:1.0:1789498723.783410:0:17097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916161536 00000100:00100000:1.0:1789498723.783450:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789498723.783464:0:17097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1876424916161536:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789498723.783487:0:17097:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789498723.791004:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1876424916162944:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1789498723.791071:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498723.798447:0:20242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916162688 00000100:00100000:2.0:1789498723.798466:0:20242:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916162688 00000100:00100000:2.0:1789498723.798559:0:20242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916162816 00000100:00100000:2.0:1789498723.798563:0:20242:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916162816 00000100:00100000:2.0:1789498723.798590:0:20242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789498723.798599:0:20242:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1876424916162688:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1789498723.798623:0:20242:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789498723.798719:0:20242:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1876424916162688:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 119us (18220us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789498723.798727:0:20242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789498723.798745:0:20242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789498723.798750:0:20242:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1876424916162816:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1789498723.798759:0:20242:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789498723.798784:0:20242:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1876424916162816:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 33us (18207us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789498723.798789:0:20242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1789498723.801216:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076bc788800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789498723.801229:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789498723.801234:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1876424916162688:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1789498723.801252:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076c1585800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789498723.801255:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789498723.801258:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876424916162816:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1789498723.801308:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916162944 00000100:00100000:0.0:1789498723.801315:0:17091:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916162944 00000100:00100000:0.0:1789498723.801351:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789498723.801358:0:17091:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1876424916162944:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1789498723.801376:0:17091:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789498723.801433:0:17091:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1876424916162944:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 74us (10361us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789498723.801440:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1789498723.801468:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa075856d8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789498723.801472:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789498723.801475:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1876424916162944:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1789498723.816081:0:17097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1876424916161536:12345-0@lo:38:kworker.0 Request processed in 32610us (35621us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789498723.816106:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1789498723.816716:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076bc352000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789498723.816723:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789498723.816727:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876424916161536:0@lo:38:kworker.0 00010000:00010000:3.0:1789498724.669655:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498725.691684:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498726.723240:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498726.844220:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916163072:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789498726.844291:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498726.844353:0:19589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916163072 00000100:00100000:1.0:1789498726.844361:0:19589:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916163072 00000100:00100000:1.0:1789498726.844421:0:19589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789498726.844431:0:19589:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9de4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916163072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789498726.844465:0:19589:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789498726.844509:0:19589:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9de4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916163072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498726.844516:0:19589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1789498726.844563:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789498726.844638:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916163072:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1789498726.853352:0:18594:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789498726.853363:0:18594:0:(genops.c:885:class_export_put()) final put ffffa075875a6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789498726.853436:0:15719:0:(genops.c:844:class_export_destroy()) destroying export ffffa075875a6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789498726.853489:0:15719:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa075875a5000 for lustre-OST0000 00000040:00080000:1.0:1789498727.294498:0:17845:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:3.0:1789498727.408572:0:20868:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789498727.424252:0:20868:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1789498727.424316:0:20868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa0768bda8e00/0x70d6b5fa1825db2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825db31 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498727.424333:0:20868:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa0768bda8e00/0x70d6b5fa1825db2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825db31 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498727.424342:0:20868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa0768bda8e00/0x70d6b5fa1825db2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825db31 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498727.424350:0:20868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.117@tcp lock: ffffa0768bda8e00/0x70d6b5fa1825db2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825db31 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498727.424381:0:20868:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789498727.424387:0:20868:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789498727.424414:0:20868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789498727.424439:0:20868:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789498727.424445:0:20868:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789498727.424451:0:20868:0:(import.c:65:import_set_state_nolock()) ffffa076c1585800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789498727.424456:0:20868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789498727.424458:0:20868:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789498727.424461:0:20868:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789498727.424478:0:18245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498727.424487:0:18245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.117@tcp lock: ffffa0768bda8e00/0x70d6b5fa1825db2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825db31 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498727.424496:0:18245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0768bda8e00 already unused, calling callback (ffffffffc13e6c20) 10000000:00010000:1.0:1789498727.424500:0:18245:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.117@tcp lock: ffffa0768bda8e00/0x70d6b5fa1825db2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825db31 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498727.424509:0:18245:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa0768bda8e00/0x70d6b5fa1825db2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x70d6b5fa1825db31 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789498727.424517:0:18245:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa0768bda8e00/0x70d6b5fa1825db2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x70d6b5fa1825db31 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498727.424522:0:18245:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789498727.424524:0:18245:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789498727.424527:0:18245:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789498727.424606:0:18245:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.117@tcp lock: ffffa0768bda8e00/0x70d6b5fa1825db2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x70d6b5fa1825db31 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498727.424622:0:18245:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789498727.424659:0:18245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.117@tcp lock: ffffa0768bda8e00/0x70d6b5fa1825db2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x70d6b5fa1825db31 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498727.424667:0:18245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa0768bda8e00/0x70d6b5fa1825db2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x70d6b5fa1825db31 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498727.424679:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498727.424681:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498727.424690:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498727.424704:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20dec396-e124-4c94-9424-ae01f240e87e:3644:1876424916163200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789498727.424775:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498727.424881:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916163200 00000100:00100000:1.0:1789498727.424889:0:17076:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916163200 00000100:00100000:1.0:1789498727.424933:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789498727.424941:0:17076:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3644:x1876424916163200:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789498727.424948:0:17076:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789498727 with bad export cookie 8130886263015594325 00010000:00010000:3.0:1789498727.427564:0:20868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1570e00/0x70d6b5fa1825da89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825da90 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498727.427588:0:20868:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1570e00/0x70d6b5fa1825da89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825da90 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498727.427597:0:20868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1570e00/0x70d6b5fa1825da89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825da90 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498727.427604:0:20868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.117@tcp lock: ffffa076c1570e00/0x70d6b5fa1825da89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825da90 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498727.427651:0:20868:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498727.427658:0:20868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075875f4400/0x70d6b5fa1825dd76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825dd7d expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498727.427665:0:20868:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075875f4400/0x70d6b5fa1825dd76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825dd7d expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498727.427671:0:20868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075875f4400/0x70d6b5fa1825dd76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825dd7d expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498727.427677:0:20868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.117@tcp lock: ffffa075875f4400/0x70d6b5fa1825dd76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825dd7d expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498727.427706:0:20868:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789498727.427713:0:20868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8800/0x70d6b5fa1825df13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825df1a expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498727.427720:0:20868:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8800/0x70d6b5fa1825df13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825df1a expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498727.427727:0:20868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8800/0x70d6b5fa1825df13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825df1a expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498727.427734:0:20868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8800/0x70d6b5fa1825df13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825df1a expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498727.427736:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789498727.427746:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.117@tcp lock: ffffa076c1570e00/0x70d6b5fa1825da89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825da90 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498727.427754:0:20868:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789498727.427757:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c1570e00 already unused, calling callback (ffffffffc13e6c20) 00010000:00010000:3.0:1789498727.427762:0:20868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825da7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825da82 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498727.427763:0:17078:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.117@tcp lock: ffffa076c1570e00/0x70d6b5fa1825da89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825da90 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498727.427784:0:20868:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825da7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825da82 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498727.427786:0:17078:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa076c1570e00/0x70d6b5fa1825da89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x70d6b5fa1825da90 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498727.427801:0:20868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825da7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825da82 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498727.427803:0:17078:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa076c1570e00/0x70d6b5fa1825da89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x70d6b5fa1825da90 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498727.427934:0:20868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825da7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825da82 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498727.428013:0:17078:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789498727.428020:0:17078:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1789498727.428030:0:20868:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1789498727.428035:0:20868:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1789498727.428045:0:20868:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:0.0:1789498727.428058:0:17078:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.117@tcp lock: ffffa076c1570e00/0x70d6b5fa1825da89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x70d6b5fa1825da90 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498727.428067:0:17078:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000004:3.0:1789498727.428079:0:20868:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1789498727.428085:0:20868:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1789498727.428090:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789498727.428096:0:20868:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00010000:00010000:0.0:1789498727.428101:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.117@tcp lock: ffffa076c1570e00/0x70d6b5fa1825da89 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x70d6b5fa1825da90 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789498727.428104:0:20868:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffffa075856df800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1789498727.428116:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa076c1570e00/0x70d6b5fa1825da89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x70d6b5fa1825da90 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789498727.428118:0:20868:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffffa0758719c000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789498727.428132:0:20868:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffffa076bc790000) has exports, disconnecting them 00000020:00080000:3.0:1789498727.428138:0:20868:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffffa075856df800), last request at 1789498723 00010000:00010000:0.0:1789498727.428146:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000020:00000080:3.0:1789498727.428147:0:20868:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825dd68 00010000:00010000:0.0:1789498727.428153:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.117@tcp lock: ffffa075875f4400/0x70d6b5fa1825dd76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825dd7d expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498727.428160:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075875f4400 already unused, calling callback (ffffffffc13e6c20) 10000000:00010000:0.0:1789498727.428164:0:17078:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.117@tcp lock: ffffa075875f4400/0x70d6b5fa1825dd76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825dd7d expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789498727.428166:0:20868:0:(import.c:65:import_set_state_nolock()) ffffa075856dc000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789498727.428177:0:17078:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa075875f4400/0x70d6b5fa1825dd76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x70d6b5fa1825dd7d expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498727.428184:0:17078:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa075875f4400/0x70d6b5fa1825dd76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x70d6b5fa1825dd7d expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498727.428189:0:17078:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789498727.428192:0:17078:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789498727.428194:0:17078:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789498727.428210:0:17078:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.117@tcp lock: ffffa075875f4400/0x70d6b5fa1825dd76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x70d6b5fa1825dd7d expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498727.428217:0:17078:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:3.0:1789498727.428218:0:20868:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffffa075856df800): rc 0 00000020:00000080:3.0:1789498727.428224:0:20868:0:(genops.c:885:class_export_put()) final put ffffa075856df800/lustre-MDT0001-lwp-OST0001_UUID 00010000:00010000:0.0:1789498727.428227:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.117@tcp lock: ffffa075875f4400/0x70d6b5fa1825dd76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x70d6b5fa1825dd7d expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498727.428235:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa075875f4400/0x70d6b5fa1825dd76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x70d6b5fa1825dd7d expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789498727.428238:0:20868:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffffa0758719c000), last request at 1789498723 00000020:00000080:3.0:1789498727.428244:0:20868:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825dc0a 00000100:00080000:3.0:1789498727.428251:0:20868:0:(import.c:65:import_set_state_nolock()) ffffa0758719e800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789498727.428259:0:20868:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0758719c000): rc 0 00000020:00000080:3.0:1789498727.428263:0:20868:0:(genops.c:885:class_export_put()) final put ffffa0758719c000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1789498727.428271:0:20868:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb68781d87ae0 00010000:00010000:0.0:1789498727.428272:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789498727.428278:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8800/0x70d6b5fa1825df13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825df1a expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498727.428285:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076bc6d8800 already unused, calling callback (ffffffffc13e6c20) 10000000:00010000:0.0:1789498727.428288:0:17078:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8800/0x70d6b5fa1825df13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825df1a expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789498727.428290:0:20868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789498727.428300:0:20868:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffffa0758819ea00 x1876424916161152/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789498738 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498727.428311:0:20868:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:0.0:1789498727.428418:0:17078:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8800/0x70d6b5fa1825df13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x70d6b5fa1825df1a expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498727.428425:0:17078:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8800/0x70d6b5fa1825df13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x70d6b5fa1825df1a expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498727.428430:0:17078:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789498727.428432:0:17078:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789498727.428434:0:17078:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789498727.428514:0:17078:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8800/0x70d6b5fa1825df13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x70d6b5fa1825df1a expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498727.428521:0:17078:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789498727.428559:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8800/0x70d6b5fa1825df13 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x70d6b5fa1825df1a expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498727.428710:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20dec396-e124-4c94-9424-ae01f240e87e:3643:1876424916163584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789498727.428791:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498727.428922:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916163584 00000100:00100000:2.0:1789498727.428930:0:17075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916163584 00000100:00100000:2.0:1789498727.428973:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789498727.428987:0:17075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586727480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3643:x1876424916163584:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789498727.428993:0:17075:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789498727 with bad export cookie 8130886263015594325 00000100:00100000:2.0:1789498727.429038:0:17075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586727480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3643:x1876424916163584:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (247us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789498727.429051:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1789498727.429090:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.117@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789498727.429093:0:3643:0:(import.c:65:import_set_state_nolock()) ffffa076981d3000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789498727.429097:0:3643:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:0.0:1789498727.429130:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8800/0x70d6b5fa1825df13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x70d6b5fa1825df1a expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498727.429147:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498727.429151:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825da7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825da82 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498727.429165:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a0000 already unused, calling callback (ffffffffc13e6c20) 10000000:00010000:0.0:1789498727.429168:0:17078:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825da7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825da82 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498727.429176:0:17078:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825da7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x70d6b5fa1825da82 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498727.429183:0:17078:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825da7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x70d6b5fa1825da82 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498727.429188:0:17078:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789498727.429190:0:17078:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789498727.429192:0:17078:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:3.0:1789498727.429492:0:20868:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789498727.429498:0:20868:0:(import.c:65:import_set_state_nolock()) ffffa076bc352000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1789498727.448778:0:3643:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.117@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789498727.448784:0:3643:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789498727.448797:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffffa075874f7b80 x1876424916161408/t0(0) o400->MGC192.168.204.117@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789498739 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498727.448811:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffffa076a9de5f80 x1876424916163200/t0(0) o103->MGC192.168.204.117@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789498743 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498727.448820:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffffa075874f5880 x1876424916163584/t0(0) o103->MGC192.168.204.117@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789498743 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789498727.448837:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789498727.448840:0:3643:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789498727.448841:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789498727.451729:0:3643:0:(import.c:65:import_set_state_nolock()) ffffa076981d3000 MGS: changing import state from DISCONN to CONNECTING 00000020:00000080:1.0:1789498727.454925:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffffa075856df800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1789498727.455075:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffffa0758719c000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1789498727.455119:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa075856dc000 for lustre-MDT0001 00000020:00000080:1.0:1789498727.455124:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa0758719e800 for lustre-MDT0001 00010000:00010000:1.0:1789498727.455210:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789498727.455382:0:20868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789498727.455387:0:20868:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1789498727.455406:0:20868:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789498727.455488:0:20868:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789498727.455507:0:20868:0:(import.c:65:import_set_state_nolock()) ffffa0758719c800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789498727.455529:0:20868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789498727.455555:0:20868:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1789498727.455564:0:20868:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789498727.455853:0:20868:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789498727.455865:0:20868:0:(import.c:65:import_set_state_nolock()) ffffa0768b708000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789498727.455914:0:20868:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffffa076bc790000) has no exports 00000100:00100000:1.0:1789498727.456072:0:17076:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3644:x1876424916163200:12345-0@lo:103:ldlm_bl.0 Request processed in 31126us (31292us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789498727.456089:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1789498727.456234:0:17078:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825da7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x70d6b5fa1825da82 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498727.456245:0:17078:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:2.0:1789498727.456246:0:3643:0:(import.c:545:import_select_connection()) MGC192.168.204.117@tcp: connect to NID 0@lo last attempt 464 00000100:00080000:2.0:1789498727.456260:0:3643:0:(import.c:666:import_select_connection()) MGC192.168.204.117@tcp: import ffffa076981d3000 using connection 192.168.204.117@tcp/0@lo 00010000:00010000:0.0:1789498727.456260:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825da7b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x70d6b5fa1825da82 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498727.456271:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825da7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x70d6b5fa1825da82 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498727.456748:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876424916163712:0@lo:9:umount.0 00000100:00100000:0.0:1789498727.456796:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498727.456825:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876424916163840:0@lo:9:umount.0 00000100:00100000:0.0:1789498727.456842:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789498727.456870:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498727.456891:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20dec396-e124-4c94-9424-ae01f240e87e:0:1876424916163328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789498727.456907:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789498727.456913:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:20dec396-e124-4c94-9424-ae01f240e87e:0:1876424916163456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789498727.456936:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:20dec396-e124-4c94-9424-ae01f240e87e:3642:1876424916161408:0@lo:400:kworker.0 00000100:00100000:0.0:1789498727.456945:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876424916161152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789498727.456979:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20dec396-e124-4c94-9424-ae01f240e87e:0:1876424916163968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789498727.456990:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:20dec396-e124-4c94-9424-ae01f240e87e:3644:1876424916163200:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789498727.457008:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498727.457011:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498727.457023:0:3643:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa07586724a80 x1876424916164096/t0(0) o250->MGC192.168.204.117@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789498727.457054:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:20dec396-e124-4c94-9424-ae01f240e87e:3640:1876424916164096:0@lo:250:ptlrpcd_00_02.0 00010000:00010000:0.0:1789498727.457074:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1789498727.457079:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876424916164096 offset 0 length 520: 4 00000100:00100000:2.0:1789498727.457115:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:20dec396-e124-4c94-9424-ae01f240e87e:3643:1876424916163584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789498727.457137:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916163712 00000100:00100000:1.0:1789498727.457146:0:18600:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916163712 00000100:00100000:1.0:1789498727.457194:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916163840 00000100:00100000:1.0:1789498727.457197:0:18600:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916163840 00000100:00100000:1.0:1789498727.457236:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789498727.457244:0:18600:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876424916163712:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789498727.457266:0:18600:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825dc34 00000100:00080000:1.0:1789498727.457274:0:18600:0:(import.c:65:import_set_state_nolock()) ffffa07588329800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789498727.457568:0:18600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1789498727.457775:0:18600:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3640:x1876424916163712:12345-0@lo:9:umount.0 Request processed in 531us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498727.457783:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789498727.457797:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789498727.457803:0:18600:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876424916163840:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789498727.457836:0:18600:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825dd99 00000100:00080000:1.0:1789498727.457842:0:18600:0:(import.c:65:import_set_state_nolock()) ffffa075810db800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789498727.457863:0:18600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1789498727.457936:0:18600:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3640:x1876424916163840:12345-0@lo:9:umount.0 Request processed in 133us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498727.457943:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:1.0:1789498727.457966:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498727.457971:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789498727.458210:0:17086:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789498727.458242:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa0758719c800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789498727.458260:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789498727.458263:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789498727.458267:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876424916163712:0@lo:9:umount.0 00000100:00080000:2.0:1789498727.458278:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa0768b708000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789498727.458453:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789498727.459444:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789498727.459451:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876424916163840:0@lo:9:umount.0 00000020:00080000:3.0:1789498727.465989:0:20868:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffffa076bc790000) has no exports 00000020:01000000:2.0:1789498727.506785:0:20868:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0758150cb40 - data ffffa076a7897000/ffffa07586614400 00000020:01000000:2.0:1789498727.506967:0:20868:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa076a0159660 - data ffffa076a7813870/ffffa076a76cf400 00000001:00000004:2.0:1789498727.518730:0:20868:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1789498727.574170:0:20868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789498727.574180:0:20868:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789498727.574188:0:20868:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789498727.578981:0:20868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789498727.578990:0:20868:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1789498727.579702:0:20868:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789498727.579706:0:20868:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789498727.585706:0:17833:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789498727.585714:0:17833:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1789498727.585751:0:17833:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1789498727.586440:0:20868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789498727.586445:0:20868:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:1.0:1789498727.586459:0:20868:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789498727.586461:0:20868:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789498727.587089:0:17835:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789498727.587093:0:17835:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1789498727.587101:0:17835:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1789498727.595002:0:20868:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825da9e 00000020:00000080:0.0:1789498727.595077:0:20868:0:(genops.c:885:class_export_put()) final put ffffa0758571d800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789498727.595446:0:20398:0:(genops.c:844:class_export_destroy()) destroying export ffffa0758571d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789498727.595936:0:20868:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825dab3 00000020:00000080:1.0:1789498727.595943:0:20868:0:(genops.c:885:class_export_put()) final put ffffa075880b9000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789498727.595960:0:20868:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1789498727.595965:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789498727.595973:0:20868:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789498727.595976:0:20868:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffffa07586668000) has no exports 00000004:01000000:1.0:1789498727.596243:0:20868:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789498727.596252:0:20868:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825db07 00000020:00000080:1.0:1789498727.596257:0:20868:0:(genops.c:885:class_export_put()) final put ffffa076c15a0800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789498727.596261:0:20868:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1789498727.596265:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789498727.596270:0:20868:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789498727.596272:0:20868:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffffa076a01f8000) has no exports 00000020:00000080:1.0:1789498727.596278:0:20868:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825db00 00000020:00000080:1.0:1789498727.596281:0:20868:0:(genops.c:885:class_export_put()) final put ffffa0768b70e000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789498727.596419:0:20398:0:(genops.c:844:class_export_destroy()) destroying export ffffa075880b9000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1789498727.596425:0:20398:0:(genops.c:844:class_export_destroy()) destroying export ffffa076c15a0800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1789498727.596429:0:20398:0:(genops.c:844:class_export_destroy()) destroying export ffffa0768b70e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789498727.596747:0:20868:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1789498727.596752:0:20868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789498727.596756:0:20868:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1789498727.596762:0:20868:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789498727.596764:0:20868:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789498727.597091:0:20398:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa0768b708000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789498727.597136:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789498727.597145:0:20868:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789498727.597149:0:20868:0:(genops.c:885:class_export_put()) final put ffffa076c15a7800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789498727.597152:0:20868:0:(genops.c:844:class_export_destroy()) destroying export ffffa076c15a7800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1789498727.597169:0:20868:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789498727.597676:0:20868:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825daf2 00000020:00000080:0.0:1789498727.597683:0:20868:0:(genops.c:885:class_export_put()) final put ffffa076c15a2000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1789498727.597700:0:20868:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1789498727.597704:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789498727.597709:0:20868:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789498727.597712:0:20868:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffffa076bc7919c0) has no exports 00000020:00000080:0.0:1789498727.597718:0:20868:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825dae4 00000020:00000080:0.0:1789498727.597721:0:20868:0:(genops.c:885:class_export_put()) final put ffffa07587198800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789498727.598091:0:20398:0:(genops.c:844:class_export_destroy()) destroying export ffffa076c15a2000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1789498727.598099:0:20398:0:(genops.c:844:class_export_destroy()) destroying export ffffa07587198800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789498727.598675:0:20868:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1789498727.598680:0:20868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789498727.598684:0:20868:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1789498727.598688:0:20868:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789498727.598690:0:20868:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789498727.598731:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789498727.598738:0:20868:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1789498727.598750:0:20868:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1789498727.598756:0:20868:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825dad6 00000020:00000080:0.0:1789498727.598761:0:20868:0:(genops.c:885:class_export_put()) final put ffffa076c15a1000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1789498727.598766:0:20868:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1789498727.598782:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789498727.598786:0:20868:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789498727.598789:0:20868:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffffa0769060b380) has no exports 00000020:00000080:0.0:1789498727.598793:0:20868:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825dacf 00000020:00000080:0.0:1789498727.598796:0:20868:0:(genops.c:885:class_export_put()) final put ffffa076bc356000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789498727.599741:0:20398:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa0758719c800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1789498727.599749:0:20398:0:(genops.c:885:class_export_put()) final put ffffa07587143800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789498727.599752:0:20398:0:(genops.c:844:class_export_destroy()) destroying export ffffa07587143800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1789498727.599756:0:20398:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789498727.599841:0:20398:0:(genops.c:844:class_export_destroy()) destroying export ffffa076c15a1000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1789498727.599856:0:20398:0:(genops.c:844:class_export_destroy()) destroying export ffffa076bc356000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1789498727.600577:0:20868:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1789498727.600582:0:20868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789498727.600585:0:20868:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789498727.600589:0:20868:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789498727.600676:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789498727.600684:0:20868:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789498727.600706:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789498727.600709:0:20868:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789498727.600713:0:20868:0:(genops.c:885:class_export_put()) final put ffffa07689bac000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789498727.600716:0:20868:0:(genops.c:844:class_export_destroy()) destroying export ffffa07689bac000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1789498727.600721:0:20868:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789498727.600864:0:20868:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825daba 00000020:00000080:1.0:1789498727.600870:0:20868:0:(genops.c:885:class_export_put()) final put ffffa075880bd800/lustre-MDD0001_UUID 00000020:00000080:3.0:1789498727.600895:0:20398:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa076bc352000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1789498727.600901:0:20398:0:(genops.c:885:class_export_put()) final put ffffa076c15a3000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789498727.600903:0:20398:0:(genops.c:844:class_export_destroy()) destroying export ffffa076c15a3000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1789498727.600907:0:20398:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789498727.603355:0:20398:0:(genops.c:844:class_export_destroy()) destroying export ffffa075880bd800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1789498727.603780:0:20868:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1789498727.603787:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789498727.603794:0:20868:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789498727.603799:0:20868:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffffa076bc793380) has no exports 00000020:00000080:1.0:1789498727.603841:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789498727.603848:0:20868:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1789498727.603852:0:20868:0:(genops.c:885:class_export_put()) final put ffffa07587147000/lustre-MDD0001_UUID 00000020:00000080:1.0:1789498727.603855:0:20868:0:(genops.c:844:class_export_destroy()) destroying export ffffa07587147000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1789498727.603859:0:20868:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1789498727.604007:0:20868:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825dac1 00000020:00000080:1.0:1789498727.605343:0:20868:0:(genops.c:885:class_export_put()) final put ffffa075880bf800/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1789498727.605368:0:20868:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa076a9c3f800 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1789498727.605375:0:20868:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa076a9c3f800 2 00000020:01000004:1.0:1789498727.605378:0:20868:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa076a9c3f800 from lustre-MDT0001 00000020:00000080:3.0:1789498727.605630:0:20398:0:(genops.c:844:class_export_destroy()) destroying export ffffa075880bf800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789498727.606177:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789498727.606187:0:20868:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1789498727.606190:0:20868:0:(genops.c:885:class_export_put()) final put ffffa07587142800/lustre-MDT0001_UUID 00000020:00000080:1.0:1789498727.606193:0:20868:0:(genops.c:844:class_export_destroy()) destroying export ffffa07587142800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1789498727.606202:0:20868:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1789498727.606271:0:20868:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1789498727.606275:0:20868:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1789498727.606279:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789498727.606283:0:20868:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789498727.606298:0:20868:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffffa07588058800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789498727.606303:0:20868:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffffa076beff19c0) has exports, disconnecting them 00000020:00080000:1.0:1789498727.606308:0:20868:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffffa07588058800), last request at 1789498645 00000020:00000080:1.0:1789498727.606313:0:20868:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825db3f 00000020:00080000:1.0:1789498727.606326:0:20868:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffffa07588058800): rc 0 00000020:00000080:1.0:1789498727.606330:0:20868:0:(genops.c:885:class_export_put()) final put ffffa07588058800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1789498727.607374:0:20398:0:(genops.c:844:class_export_destroy()) destroying export ffffa07588058800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1789498727.644626:0:20868:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1789498727.644636:0:20868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789498727.644640:0:20868:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789498727.644649:0:20868:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789498727.644686:0:20398:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa076c1585800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1789498727.644885:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789498727.644895:0:20868:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1789498727.644902:0:20868:0:(genops.c:885:class_export_put()) final put ffffa076a0149800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1789498727.644906:0:20868:0:(genops.c:844:class_export_destroy()) destroying export ffffa076a0149800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1789498727.644920:0:20868:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1789498727.645016:0:20868:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa076a9c3f800 1 00000020:00000080:3.0:1789498727.645022:0:20868:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825da66 00000020:00000080:3.0:1789498727.645028:0:20868:0:(genops.c:885:class_export_put()) final put ffffa07682997800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1789498727.645038:0:20868:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1789498727.645046:0:20398:0:(genops.c:844:class_export_destroy()) destroying export ffffa07682997800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789498727.645068:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789498727.645074:0:20868:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789498727.645077:0:20868:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffffa075857319c0) has no exports 00000020:00000080:3.0:1789498727.723899:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789498727.723912:0:20868:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1789498727.723918:0:20868:0:(genops.c:885:class_export_put()) final put ffffa076bef71800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789498727.723931:0:20868:0:(genops.c:844:class_export_destroy()) destroying export ffffa076bef71800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1789498727.723937:0:20868:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1789498727.724053:0:20868:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa076bef70800 00000020:01000000:3.0:1789498727.724074:0:20868:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1789498727.724077:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789498727.724080:0:20868:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789498727.724084:0:20868:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffffa07585730000) has no exports 00000100:00100000:1.0:1789498727.724368:0:17092:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffffa076a9d25e00:17092] 2 exiting: rc = 0 00000100:00100000:2.0:1789498727.725144:0:19316:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffffa07587282a00:19316] 3 exiting: rc = 0 00000100:00100000:2.0:1789498727.725224:0:17090:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffffa07683cf5e00:17090] 0 exiting: rc = 1 00000100:00100000:2.0:1789498727.725288:0:20242:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffffa076bbefa600:20242] 4 exiting: rc = 0 00000100:00100000:0.0:1789498727.725307:0:17091:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffffa076a9d24e00:17091] 1 exiting: rc = 0 00000100:00100000:3.0:1789498727.725520:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725556:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725566:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725572:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725579:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725588:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725598:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725605:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725622:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725628:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725633:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725641:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725646:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725651:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725656:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725661:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725667:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725673:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725678:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725684:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725690:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725697:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725704:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725711:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725720:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725729:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725739:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725762:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725793:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725800:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725844:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725851:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725857:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725862:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725867:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725873:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725878:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725884:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725889:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725894:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725903:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725908:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725913:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725919:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725924:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725929:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725933:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725939:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725944:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725950:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725965:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725971:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725976:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725982:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725987:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725992:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.725996:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.726001:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.726005:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.726018:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.726024:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.726029:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.726041:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.726047:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.744191:0:17093:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffffa076a9d24600:17093] 0 exiting: rc = 1 00000100:00100000:0.0:1789498727.744460:0:17094:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffffa076a9d25400:17094] 1 exiting: rc = 0 00000100:00100000:3.0:1789498727.744752:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.744763:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.744774:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.744782:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.744790:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.744798:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.744806:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.744815:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.744822:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.744830:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.744837:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.744845:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.744852:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.744859:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.744867:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.744874:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.744882:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.744888:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.744896:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.744907:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.744918:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.744924:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.744929:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.744934:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.744948:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745115:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745127:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745134:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745141:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745149:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745157:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745178:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745188:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745209:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745216:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745224:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745233:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745240:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745247:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745254:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745261:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745267:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745274:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745280:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745289:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745299:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745307:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745311:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745316:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745321:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745331:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745338:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745343:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745469:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745477:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745484:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745492:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745499:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745507:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745515:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745523:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745682:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745693:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.745699:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.746867:0:17096:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffffa076851bfe00:17096] 0 exiting: rc = 1 00000100:00100000:1.0:1789498727.747110:0:17097:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffffa076851be200:17097] 1 exiting: rc = 0 00000100:00100000:0.0:1789498727.747263:0:17832:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffffa076b0431200:17832] 2 exiting: rc = 0 00000100:00100000:3.0:1789498727.747410:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747423:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747432:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747440:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747457:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747466:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747479:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747490:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747496:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747502:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747507:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747519:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747525:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747556:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747577:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747655:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747661:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747667:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747673:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747680:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747685:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747691:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747696:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747702:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747708:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747713:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747734:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747741:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747746:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747752:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747758:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747763:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747769:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747775:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747781:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747786:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747793:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747799:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747818:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747831:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747836:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747842:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747847:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747852:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747858:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747863:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747869:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747874:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747880:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747886:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747905:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747911:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747916:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747921:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747926:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747932:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747937:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747943:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.747948:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.748055:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.748067:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.748075:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.748083:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.748091:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.759480:0:17099:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffffa076839c2600:17099] 1 exiting: rc = 0 00000100:00100000:0.0:1789498727.759748:0:17098:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffffa076a9d25800:17098] 0 exiting: rc = 1 00000100:00100000:3.0:1789498727.760128:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760138:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760145:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760151:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760169:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760178:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760185:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760192:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760198:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760205:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760221:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760232:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760242:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760251:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760257:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760262:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760267:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760279:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760284:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760290:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760294:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760298:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760303:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760307:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760311:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760316:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760321:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760325:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760330:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760335:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760340:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760344:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760350:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760455:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760466:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760472:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760479:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760485:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760491:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760498:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760505:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760512:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760519:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760525:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760719:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760733:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760738:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760745:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760755:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760765:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760774:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760782:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760787:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760791:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760796:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760801:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760902:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760910:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760917:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760923:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760929:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760936:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760942:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.760950:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.765617:0:17101:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffffa07682ce3600:17101] 1 exiting: rc = 0 00000100:00100000:0.0:1789498727.765665:0:17100:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffffa076839c2a00:17100] 0 exiting: rc = 1 00000100:00100000:1.0:1789498727.765861:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.765924:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.765932:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.765939:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.765946:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.765953:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.765972:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.765982:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.765990:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.765997:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766002:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766141:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766150:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766198:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766206:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766212:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766218:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766223:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766229:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766235:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766240:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766258:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766263:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766269:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766275:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766280:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766285:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766290:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766295:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766299:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766304:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766309:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766314:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766319:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766325:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766329:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766335:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766340:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766345:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766350:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766355:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766360:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766365:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766370:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766375:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766379:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766384:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766389:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766395:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766400:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766470:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766481:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766488:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766496:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766504:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766511:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766527:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766562:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766571:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766578:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766584:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766591:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766602:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.766625:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789498727.767107:0:17102:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffffa07687671000:17102] 0 exiting: rc = 1 00000100:00100000:3.0:1789498727.767459:0:17103:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffffa07687670600:17103] 1 exiting: rc = 0 00000100:00100000:1.0:1789498727.767842:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.767852:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.767860:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.767868:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.767877:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.767885:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.767892:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.767899:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.767908:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.767915:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.767924:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.767935:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.767946:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.767952:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.767957:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.767962:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.767967:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.767973:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.767979:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.767984:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.767995:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768031:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768038:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768045:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768052:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768060:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768067:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768083:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768091:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768100:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768109:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768117:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768125:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768132:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768140:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768149:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768157:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768167:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768175:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768182:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768192:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768201:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768206:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768211:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768215:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768220:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768227:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768232:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768237:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768284:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768293:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768301:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768307:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768313:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768320:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768328:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768334:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768342:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768426:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768437:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768445:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768451:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768463:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.768469:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498727.770875:0:17105:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffffa076c15ef200:17105] 1 exiting: rc = 0 00000100:00100000:1.0:1789498727.771342:0:17106:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffffa076c15ee600:17106] 2 exiting: rc = 0 00000100:00100000:0.0:1789498727.771717:0:17104:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffffa076c15efa00:17104] 0 exiting: rc = 1 00000100:00100000:1.0:1789498727.771849:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.771858:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.771863:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.771869:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.771874:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.771880:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.771885:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.771890:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.771896:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.771901:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.771907:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.771912:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.771918:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.771924:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.771930:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.771936:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.771942:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.771948:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.772326:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.772340:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.772348:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.772354:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.772360:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.772366:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.772387:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.772394:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.772400:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1789498727.772939:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498727.773040:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773051:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773058:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773064:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773070:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773089:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773095:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773102:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773108:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773114:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773120:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773125:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773131:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773138:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773143:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773148:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773155:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773222:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773229:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773234:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773239:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773260:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773268:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773274:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773279:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773285:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773291:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773297:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773303:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773310:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773316:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773322:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773328:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773333:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773338:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773346:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498727.773354:0:20868:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789498727.779260:0:20868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789498727.779282:0:20868:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1789498727.779288:0:20868:0:(genops.c:885:class_export_put()) final put ffffa076981d1000/MDS_uuid 00000020:00000080:2.0:1789498727.779293:0:20868:0:(genops.c:844:class_export_destroy()) destroying export ffffa076981d1000/MDS_uuid for MDS 00000020:01000000:2.0:1789498727.779302:0:20868:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1789498727.779468:0:20868:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1789498728.832065:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789498728.891800:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 20dec396-e124-4c94-9424-ae01f240e87e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789498728.891811:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 20dec396-e124-4c94-9424-ae01f240e87e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789498728.891813:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789498728.891816:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789498728.891820:0:8:0:(import.c:65:import_set_state_nolock()) ffffa075856d8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789498728.891828:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 558 00000100:00080000:2.0:1789498728.891834:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789498728.891847:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa075856d8800 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:2.0:1789498728.891882:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa07586724700 x1876424916164224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789498728.891942:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1876424916164224:0@lo:38:kworker.0 00000400:00000100:1.0:1789498728.892007:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876424916164224 offset 0 length 520: 4 00000100:00080000:2.0:1789498728.892156:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789498728.892159:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789498728.892161:0:8:0:(import.c:65:import_set_state_nolock()) ffffa076bc788800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789498728.892165:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 558 00000100:00080000:2.0:1789498728.892169:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789498728.892174:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa076bc788800 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:2.0:1789498728.892187:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa07586725500 x1876424916164480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789498728.896506:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876424916164352:0@lo:400:kworker.0 00000400:00000100:3.0:1789498728.896600:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876424916164352 offset 0 length 224: 4 00000100:00100000:1.0:1789498728.900962:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1876424916164480:0@lo:38:kworker.0 00000400:00000100:1.0:1789498728.901049:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876424916164480 offset 0 length 520: 4 00000100:00100000:2.0:1789498728.903174:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789498728.903193:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876424916164608:0@lo:400:kworker.0 00000400:00000100:2.0:1789498728.903410:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876424916164608 offset 0 length 224: 4 00010000:00010000:1.0:1789498729.856721:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498730.876005:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498731.899980:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789498731.969383:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 20dec396-e124-4c94-9424-ae01f240e87e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789498731.969391:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 20dec396-e124-4c94-9424-ae01f240e87e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789498731.969394:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789498731.969408:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789498731.969459:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789498731.969462:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789498731.974802:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1876424916164864:0@lo:400:kworker.0 00000400:00000100:0.0:1789498731.974877:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876424916164864 offset 0 length 224: 4 00000100:00100000:0.0:1789498731.974950:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789498731.974956:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876424916164736:0@lo:400:kworker.0 00000400:00000100:0.0:1789498731.974972:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876424916164736 offset 0 length 224: 4 00000020:01000004:1.0:1789498732.297041:0:21069:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789498732.320898:0:21069:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1789498732.320952:0:21069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1570000/0x70d6b5fa1825dbd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825dbe0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498732.320968:0:21069:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1570000/0x70d6b5fa1825dbd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825dbe0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498732.320994:0:21069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1570000/0x70d6b5fa1825dbd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825dbe0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498732.321003:0:21069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.117@tcp lock: ffffa076c1570000/0x70d6b5fa1825dbd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825dbe0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498732.321033:0:21069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789498732.321045:0:21069:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789498732.321085:0:21069:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789498732.321110:0:21069:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffffa07586724700 x1876424916164224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789498743 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498732.321157:0:21069:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789498732.321164:0:21069:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789498732.321170:0:21069:0:(import.c:65:import_set_state_nolock()) ffffa075856d8800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789498732.321174:0:21069:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789498732.321178:0:21069:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffffa07586724700 x1876424916164224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789498743 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498732.321186:0:21069:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789498732.321189:0:21069:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00010000:00010000:2.0:1789498732.321334:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498732.321342:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.117@tcp lock: ffffa076c1570000/0x70d6b5fa1825dbd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825dbe0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498732.321361:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c1570000 already unused, calling callback (ffffffffc13e6c20) 10000000:00010000:2.0:1789498732.321365:0:17079:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.117@tcp lock: ffffa076c1570000/0x70d6b5fa1825dbd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825dbe0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498732.321374:0:17079:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa076c1570000/0x70d6b5fa1825dbd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x70d6b5fa1825dbe0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789498732.321382:0:17079:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa076c1570000/0x70d6b5fa1825dbd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x70d6b5fa1825dbe0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498732.321388:0:17079:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789498732.321391:0:17079:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789498732.321394:0:17079:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789498732.321406:0:17079:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa076981d3000 00010000:00010000:2.0:1789498732.321410:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.117@tcp lock: ffffa076c1570000/0x70d6b5fa1825dbd9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x70d6b5fa1825dbe0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498732.321417:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa076c1570000/0x70d6b5fa1825dbd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x70d6b5fa1825dbe0 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498732.321431:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498732.321433:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498732.321435:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498732.321506:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1876424916164224:0@lo:38:kworker.0 00000100:00080000:1.0:1789498732.323053:0:21069:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789498732.323067:0:21069:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffffa07586727100 x1876424916164352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498744 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498732.323669:0:21069:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffffa076a9de6a00 x1876424916164736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498747 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498732.323683:0:21069:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789498732.323689:0:21069:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789498732.323713:0:21069:0:(import.c:65:import_set_state_nolock()) ffffa075875a4800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789498732.324963:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1876424916164992:0@lo:39:umount.0 00000400:00000100:2.0:1789498732.325022:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876424916164992 offset 0 length 224: 4 00000100:00100000:0.0:1789498732.325381:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876424916164736:0@lo:400:kworker.0 00000100:00100000:3.0:1789498732.328383:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876424916164352:0@lo:400:kworker.0 00010000:00010000:1.0:1789498732.923892:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789498733.508975:0:18594:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789498733.508984:0:18594:0:(genops.c:885:class_export_put()) final put ffffa0758832d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789498733.509097:0:20398:0:(genops.c:844:class_export_destroy()) destroying export ffffa0758832d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789498733.509145:0:20398:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa07588329800 for lustre-OST0000 00000001:00100000:1.0:1789498733.513744:0:19413:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789498733.513753:0:19413:0:(genops.c:885:class_export_put()) final put ffffa075810dc000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789498733.513847:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffffa075810dc000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789498733.513919:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa075810db800 for lustre-OST0001 00010000:00010000:3.0:1789498733.948761:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789498734.012942:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) 20dec396-e124-4c94-9424-ae01f240e87e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789498734.012968:0:20398:0:(pinger.c:247:ptlrpc_pinger_process_import()) 20dec396-e124-4c94-9424-ae01f240e87e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789498734.012971:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789498734.012974:0:20398:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789498734.014058:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876424916165120:0@lo:400:kworker.0 00000400:00000100:0.0:1789498734.014115:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876424916165120 offset 0 length 224: 4 00010000:00010000:2.0:1789498734.972044:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498735.997211:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498737.022568:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498737.468431:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789498727/real 1789498727] req@ffffa07586724a80 x1876424916164096/t0(0) o250->MGC192.168.204.117@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789498737 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498737.468464:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa07586724a80 x1876424916164096/t0(0) o250->MGC192.168.204.117@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789498737 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789498737.468483:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076981d3000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789498737.468507:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1789498737.468511:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:20dec396-e124-4c94-9424-ae01f240e87e:3640:1876424916164096:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:0.0:1789498737.468780:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) 20dec396-e124-4c94-9424-ae01f240e87e->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789498737.468785:0:20398:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1789498737.468788:0:20398:0:(import.c:65:import_set_state_nolock()) ffffa076981d3000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789498737.468793:0:20398:0:(import.c:545:import_select_connection()) MGC192.168.204.117@tcp: connect to NID 0@lo last attempt 561 00000100:00080000:0.0:1789498737.468798:0:20398:0:(import.c:630:import_select_connection()) MGC192.168.204.117@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789498737.468809:0:20398:0:(import.c:666:import_select_connection()) MGC192.168.204.117@tcp: import ffffa076981d3000 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:0.0:1789498737.468852:0:20398:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa075874f4e00 x1876424916165248/t0(0) o250->MGC192.168.204.117@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789498737.468884:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789498737.468888:0:20398:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789498737.469025:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876424916165376:0@lo:400:kworker.0 00000400:00000100:3.0:1789498737.469101:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876424916165376 offset 0 length 224: 4 00000100:00100000:2.0:1789498737.469254:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:20dec396-e124-4c94-9424-ae01f240e87e:3640:1876424916165248:0@lo:250:kworker.0 00000400:00000100:2.0:1789498737.469274:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876424916165248 offset 0 length 520: 4 00010000:00010000:2.0:1789498738.043656:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498739.068203:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498740.093091:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498741.116609:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498742.139819:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498742.587742:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789498732/real 1789498732] req@ffffa076a9de7100 x1876424916164992/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789498742 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498742.587774:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa076a9de7100 x1876424916164992/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789498742 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789498742.587795:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa075875a4800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789498742.587816:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1876424916164992:0@lo:39:umount.0 00000100:00080000:1.0:1789498742.588019:0:21069:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789498742.588025:0:21069:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789498742.588050:0:21069:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789498742.590360:0:21069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa0768bda9000/0x70d6b5fa1825dbaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825dbb6 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498742.590381:0:21069:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa0768bda9000/0x70d6b5fa1825dbaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825dbb6 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498742.590389:0:21069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa0768bda9000/0x70d6b5fa1825dbaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825dbb6 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498742.591278:0:21069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.117@tcp lock: ffffa0768bda9000/0x70d6b5fa1825dbaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825dbb6 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498742.591313:0:21069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498742.591333:0:21069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1570600/0x70d6b5fa1825df05 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825df0c expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498742.591341:0:21069:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1570600/0x70d6b5fa1825df05 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825df0c expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498742.591347:0:21069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1570600/0x70d6b5fa1825df05 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825df0c expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498742.591354:0:21069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.117@tcp lock: ffffa076c1570600/0x70d6b5fa1825df05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825df0c expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498742.591379:0:21069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789498742.591384:0:21069:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1789498742.591414:0:21069:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1789498742.591418:0:21069:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1789498742.591423:0:21069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789498742.591439:0:21069:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789498742.591443:0:21069:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffffa076a01fb380) has no exports 00000020:00080000:1.0:1789498742.591466:0:21069:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffffa076a01fb380) has no exports 00010000:00010000:2.0:1789498742.591812:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789498742.591820:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.117@tcp lock: ffffa0768bda9000/0x70d6b5fa1825dbaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825dbb6 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498742.591835:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0768bda9000 already unused, calling callback (ffffffffc13e6c20) 10000000:00010000:2.0:1789498742.591839:0:17079:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.117@tcp lock: ffffa0768bda9000/0x70d6b5fa1825dbaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825dbb6 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498742.591848:0:17079:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa0768bda9000/0x70d6b5fa1825dbaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x70d6b5fa1825dbb6 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789498742.591855:0:17079:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa0768bda9000/0x70d6b5fa1825dbaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x70d6b5fa1825dbb6 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498742.591860:0:17079:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789498742.591863:0:17079:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1789498742.591866:0:17079:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1789498742.591880:0:17079:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa076981d3000 00010000:00010000:2.0:1789498742.591884:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.117@tcp lock: ffffa0768bda9000/0x70d6b5fa1825dbaf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x70d6b5fa1825dbb6 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498742.591891:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa0768bda9000/0x70d6b5fa1825dbaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x70d6b5fa1825dbb6 expref: -99 pid: 18593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498742.591913:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498742.591916:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.117@tcp lock: ffffa076c1570600/0x70d6b5fa1825df05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825df0c expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498742.591926:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c1570600 already unused, calling callback (ffffffffc13e6c20) 10000000:00010000:2.0:1789498742.591928:0:17079:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.117@tcp lock: ffffa076c1570600/0x70d6b5fa1825df05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825df0c expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498742.591934:0:17079:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa076c1570600/0x70d6b5fa1825df05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x70d6b5fa1825df0c expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789498742.591946:0:17079:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa076c1570600/0x70d6b5fa1825df05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x70d6b5fa1825df0c expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498742.591952:0:17079:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789498742.591954:0:17079:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789498742.591956:0:17079:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789498742.591962:0:17079:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa076981d3000 00010000:00010000:2.0:1789498742.591965:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.117@tcp lock: ffffa076c1570600/0x70d6b5fa1825df05 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x70d6b5fa1825df0c expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498742.591971:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa076c1570600/0x70d6b5fa1825df05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x70d6b5fa1825df0c expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498742.591983:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498742.591985:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498742.591987:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498742.592002:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789498742.602209:0:21069:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa076bc4690c0 - data ffffa07689711d80/ffffa075867e2000 00000020:01000000:1.0:1789498742.602381:0:21069:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa076bec7b420 - data ffffa076a7a7e360/ffffa07586730400 00100000:10000000:1.0:1789498742.613245:0:21069:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789498742.624562:0:21069:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825dbc4 00000020:00000080:3.0:1789498742.624575:0:21069:0:(genops.c:885:class_export_put()) final put ffffa0758832a800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1789498742.624596:0:21069:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa076c15a6000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1789498742.624600:0:21069:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa076c15a6000 2 00000020:01000004:3.0:1789498742.624603:0:21069:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa076c15a6000 from lustre-OST0000 00000020:00000080:3.0:1789498742.624625:0:21069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789498742.624634:0:21069:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1789498742.624636:0:21069:0:(genops.c:885:class_export_put()) final put ffffa0758832d000/lustre-OST0000_UUID 00000020:00000080:3.0:1789498742.624639:0:21069:0:(genops.c:844:class_export_destroy()) destroying export ffffa0758832d000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1789498742.624645:0:21069:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1789498742.624695:0:21069:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1789498742.624699:0:21069:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789498742.624703:0:21069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789498742.624708:0:21069:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789498742.624715:0:21069:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffffa075856db000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789498742.624731:0:21069:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffffa076beff3380) has exports, disconnecting them 00000020:00080000:3.0:1789498742.624737:0:21069:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffffa075856db000), last request at 1789498661 00000020:00000080:3.0:1789498742.624741:0:21069:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825dbee 00000020:00000080:2.0:1789498742.624741:0:20398:0:(genops.c:844:class_export_destroy()) destroying export ffffa0758832a800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00080000:3.0:1789498742.624749:0:21069:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffffa075856db000): rc 0 00000020:00000080:3.0:1789498742.624753:0:21069:0:(genops.c:885:class_export_put()) final put ffffa075856db000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789498742.624776:0:20398:0:(genops.c:844:class_export_destroy()) destroying export ffffa075856db000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789498742.628860:0:21069:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789498742.628870:0:21069:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789498742.628875:0:21069:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789498742.628882:0:21069:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789498742.629070:0:21069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789498742.629080:0:21069:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1789498742.629088:0:21069:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789498742.629093:0:21069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789498742.629097:0:21069:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789498742.629104:0:21069:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffffa0758832c000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789498742.629124:0:21069:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffffa075876f99c0) has exports, disconnecting them 00000020:00080000:2.0:1789498742.629129:0:21069:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffffa0758832c000), last request at 1789498661 00000020:00000080:2.0:1789498742.629133:0:21069:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825dc03 00000020:00080000:2.0:1789498742.629151:0:21069:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0758832c000): rc 0 00000020:00000080:2.0:1789498742.629171:0:21069:0:(genops.c:885:class_export_put()) final put ffffa0758832c000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1789498742.629376:0:20398:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa075856d8800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789498742.629385:0:20398:0:(genops.c:885:class_export_put()) final put ffffa075856d9000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789498742.629387:0:20398:0:(genops.c:844:class_export_destroy()) destroying export ffffa075856d9000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789498742.630806:0:20398:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789498742.630895:0:20398:0:(genops.c:844:class_export_destroy()) destroying export ffffa0758832c000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1789498742.633651:0:21069:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789498742.633660:0:21069:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789498742.633665:0:21069:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789498742.633671:0:21069:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789498742.633699:0:20398:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa075875a4800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1789498742.633881:0:21069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789498742.633890:0:21069:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1789498742.633895:0:21069:0:(genops.c:885:class_export_put()) final put ffffa076c1586800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1789498742.633899:0:21069:0:(genops.c:844:class_export_destroy()) destroying export ffffa076c1586800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1789498742.633905:0:21069:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1789498742.633971:0:21069:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa076c15a6000 1 00000020:00000080:1.0:1789498742.633977:0:21069:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825dba1 00000020:00000080:1.0:1789498742.633983:0:21069:0:(genops.c:885:class_export_put()) final put ffffa0758805e000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1789498742.633992:0:21069:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1789498742.634000:0:20398:0:(genops.c:844:class_export_destroy()) destroying export ffffa0758805e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789498742.634009:0:21069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789498742.634014:0:21069:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789498742.634017:0:21069:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffffa0758666cd40) has no exports 00000020:00000080:1.0:1789498742.660678:0:21069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789498742.660694:0:21069:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789498742.660700:0:21069:0:(genops.c:885:class_export_put()) final put ffffa07581546000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789498742.660705:0:21069:0:(genops.c:844:class_export_destroy()) destroying export ffffa07581546000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789498742.660718:0:21069:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789498742.660872:0:21069:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa07581540000 00000020:02000400:1.0:1789498742.660918:0:21069:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:2.0:1789498742.716299:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) 20dec396-e124-4c94-9424-ae01f240e87e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789498742.716310:0:20398:0:(pinger.c:247:ptlrpc_pinger_process_import()) 20dec396-e124-4c94-9424-ae01f240e87e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789498742.716313:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789498742.716325:0:20398:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789498742.716424:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876424916165504:0@lo:400:kworker.0 00000400:00000100:2.0:1789498742.716492:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876424916165504 offset 0 length 224: 4 00010000:00010000:2.0:1789498743.164342:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498743.611863:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789498728/real 1789498728] req@ffffa07586725500 x1876424916164480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789498743 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498743.611897:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa07586725500 x1876424916164480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789498743 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789498743.611918:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076bc788800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789498743.611952:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789498743.611957:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1876424916164480:0@lo:38:kworker.0 00000100:00080000:1.0:1789498743.612082:0:15719:0:(pinger.c:229:ptlrpc_pinger_process_import()) 20dec396-e124-4c94-9424-ae01f240e87e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789498743.612087:0:15719:0:(pinger.c:247:ptlrpc_pinger_process_import()) 20dec396-e124-4c94-9424-ae01f240e87e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789498743.612090:0:15719:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789498743.612093:0:15719:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789498743.612095:0:15719:0:(import.c:65:import_set_state_nolock()) ffffa076bc788800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789498743.612100:0:15719:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 563 00000100:00080000:1.0:1789498743.612106:0:15719:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789498743.612118:0:15719:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa076bc788800 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:1.0:1789498743.612150:0:15719:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa076a9de6d80 x1876424916165632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789498743.612219:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1876424916165760:0@lo:400:kworker.0 00000400:00000100:1.0:1789498743.612265:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876424916165760 offset 0 length 224: 4 00000100:00100000:3.0:1789498743.612369:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1876424916165632:0@lo:38:kworker.0 00000400:00000100:3.0:1789498743.612392:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876424916165632 offset 0 length 520: 4 00000100:00000400:1.0:1789498744.189598:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789498728/real 1789498728] req@ffffa07586727b80 x1876424916164608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789498744 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1789498744.191912:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498744.232157:0:3641:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffffa07586727b80 x1876424916164608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789498744 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789498744.232174:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0758722b000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789498744.232178:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789498744.247496:0:3641:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:1.0:1789498744.247565:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) 20dec396-e124-4c94-9424-ae01f240e87e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789498744.247571:0:20398:0:(pinger.c:247:ptlrpc_pinger_process_import()) 20dec396-e124-4c94-9424-ae01f240e87e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789498744.247574:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789498744.247577:0:20398:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789498744.247579:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789498744.247582:0:20398:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789498744.247586:0:20398:0:(import.c:65:import_set_state_nolock()) ffffa0758722b000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789498744.247596:0:20398:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 511 00000100:00080000:1.0:1789498744.247613:0:20398:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffffa0758722b000 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:1.0:1789498744.247656:0:20398:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa076a9de4a80 x1876424916165888/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789498744.247767:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1876424916165888:0@lo:38:kworker.0 00000400:00000100:1.0:1789498744.247821:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876424916165888 offset 0 length 520: 4 00000100:00100000:1.0:1789498744.247906:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876424916164608:0@lo:400:kworker.0 00010000:00010000:1.0:1789498745.212193:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498746.236117:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789498746.336149:0:21272:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789498746.351006:0:21272:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1789498746.351102:0:21272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075874a0800/0x70d6b5fa1825dd37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825dd3e expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498746.351120:0:21272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075874a0800/0x70d6b5fa1825dd37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825dd3e expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498746.351128:0:21272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075874a0800/0x70d6b5fa1825dd37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825dd3e expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498746.351151:0:21272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.117@tcp lock: ffffa075874a0800/0x70d6b5fa1825dd37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825dd3e expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498746.351170:0:21272:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789498746.351176:0:21272:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789498746.351203:0:21272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789498746.351216:0:21272:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffffa076a9de6d80 x1876424916165632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789498763 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498746.351255:0:21272:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789498746.351262:0:21272:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789498746.351267:0:21272:0:(import.c:65:import_set_state_nolock()) ffffa076bc788800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789498746.351273:0:21272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789498746.351277:0:21272:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffffa076a9de6d80 x1876424916165632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789498763 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498746.351283:0:21272:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789498746.351286:0:21272:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:0.0:1789498746.352051:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1876424916165632:0@lo:38:kworker.0 00000100:00080000:1.0:1789498746.353077:0:21272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789498746.353089:0:21272:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffffa076a9de7480 x1876424916164864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498747 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498746.353106:0:21272:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffffa07586725180 x1876424916165120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498750 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498746.353132:0:21272:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffffa075874f7b80 x1876424916165376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498753 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498746.353143:0:21272:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffffa07586724a80 x1876424916165504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498758 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498746.353159:0:21272:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffffa076a9de4000 x1876424916165760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498759 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498746.353183:0:21272:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffffa076a9de4a80 x1876424916165888/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789498754 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498746.353193:0:21272:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1789498746.353225:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876424916165504:0@lo:400:kworker.0 00000100:00080000:1.0:1789498746.353265:0:21272:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789498746.353271:0:21272:0:(import.c:65:import_set_state_nolock()) ffffa0758722b000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789498746.353277:0:21272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789498746.353281:0:21272:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffffa076a9de7480 x1876424916164864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498747 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498746.353289:0:21272:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffffa07586725180 x1876424916165120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498750 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498746.353296:0:21272:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffffa075874f7b80 x1876424916165376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498753 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498746.353302:0:21272:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffffa076a9de4000 x1876424916165760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498759 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498746.353309:0:21272:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffffa076a9de4a80 x1876424916165888/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789498754 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498746.353315:0:21272:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789498746.353317:0:21272:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:3.0:1789498746.353366:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876424916165120:0@lo:400:kworker.0 00000100:00100000:3.0:1789498746.353402:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876424916165376:0@lo:400:kworker.0 00010000:00010000:2.0:1789498746.353473:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498746.353482:0:17079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.117@tcp lock: ffffa075874a0800/0x70d6b5fa1825dd37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825dd3e expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498746.353492:0:17079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a0800 already unused, calling callback (ffffffffc13e6c20) 10000000:00010000:2.0:1789498746.353496:0:17079:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.117@tcp lock: ffffa075874a0800/0x70d6b5fa1825dd37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825dd3e expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498746.353507:0:17079:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa075874a0800/0x70d6b5fa1825dd37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x70d6b5fa1825dd3e expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789498746.353515:0:17079:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa075874a0800/0x70d6b5fa1825dd37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x70d6b5fa1825dd3e expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498746.353555:0:17079:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789498746.353557:0:17079:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789498746.353560:0:17079:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789498746.353574:0:17079:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa076981d3000 00010000:00010000:2.0:1789498746.353578:0:17079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.117@tcp lock: ffffa075874a0800/0x70d6b5fa1825dd37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x70d6b5fa1825dd3e expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498746.353585:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa075874a0800/0x70d6b5fa1825dd37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x70d6b5fa1825dd3e expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498746.353597:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498746.353599:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498746.353600:0:17079:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498746.354102:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1876424916165760:0@lo:400:kworker.0 00000100:00100000:0.0:1789498746.354119:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1876424916164864:0@lo:400:kworker.0 00000100:00100000:0.0:1789498746.354153:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1876424916165888:0@lo:38:kworker.0 00010000:00010000:1.0:1789498746.356494:0:21272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075874a1c00/0x70d6b5fa1825dd0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825dd14 expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498746.356515:0:21272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075874a1c00/0x70d6b5fa1825dd0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825dd14 expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498746.356523:0:21272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075874a1c00/0x70d6b5fa1825dd0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825dd14 expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498746.357351:0:21272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.117@tcp lock: ffffa075874a1c00/0x70d6b5fa1825dd0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825dd14 expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498746.357388:0:21272:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498746.357398:0:21272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1571000/0x70d6b5fa1825def7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825defe expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498746.357405:0:21272:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1571000/0x70d6b5fa1825def7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825defe expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498746.357411:0:21272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1571000/0x70d6b5fa1825def7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825defe expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498746.357416:0:21272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.117@tcp lock: ffffa076c1571000/0x70d6b5fa1825def7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x70d6b5fa1825defe expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498746.357434:0:21272:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789498746.357439:0:21272:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1789498746.357470:0:21272:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1789498746.357474:0:21272:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1789498746.357480:0:21272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789498746.357486:0:21272:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789498746.357490:0:21272:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffffa07587274d40) has no exports 00000020:00080000:1.0:1789498746.357517:0:21272:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffffa07587274d40) has no exports 00010000:00010000:3.0:1789498746.357683:0:18245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789498746.357690:0:18245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.117@tcp lock: ffffa075874a1c00/0x70d6b5fa1825dd0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825dd14 expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498746.357698:0:18245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a1c00 already unused, calling callback (ffffffffc13e6c20) 10000000:00010000:3.0:1789498746.357702:0:18245:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.117@tcp lock: ffffa075874a1c00/0x70d6b5fa1825dd0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825dd14 expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498746.357712:0:18245:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa075874a1c00/0x70d6b5fa1825dd0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x70d6b5fa1825dd14 expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789498746.357719:0:18245:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa075874a1c00/0x70d6b5fa1825dd0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x70d6b5fa1825dd14 expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498746.357725:0:18245:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789498746.357728:0:18245:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1789498746.357730:0:18245:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1789498746.357743:0:18245:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa076981d3000 00010000:00010000:3.0:1789498746.357747:0:18245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.117@tcp lock: ffffa075874a1c00/0x70d6b5fa1825dd0d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x70d6b5fa1825dd14 expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498746.357750:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498746.357756:0:17078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.117@tcp lock: ffffa076c1571000/0x70d6b5fa1825def7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825defe expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498746.357763:0:17078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c1571000 already unused, calling callback (ffffffffc13e6c20) 00010000:00010000:3.0:1789498746.357765:0:18245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa075874a1c00/0x70d6b5fa1825dd0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x70d6b5fa1825dd14 expref: -99 pid: 19412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789498746.357766:0:17078:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.117@tcp lock: ffffa076c1571000/0x70d6b5fa1825def7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x70d6b5fa1825defe expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498746.357774:0:17078:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa076c1571000/0x70d6b5fa1825def7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x70d6b5fa1825defe expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789498746.357779:0:17078:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa076c1571000/0x70d6b5fa1825def7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x70d6b5fa1825defe expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498746.357784:0:17078:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789498746.357785:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498746.357787:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789498746.357787:0:17078:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1789498746.357789:0:18245:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789498746.357793:0:17078:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789498746.357800:0:17078:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa076981d3000 00010000:00010000:2.0:1789498746.357803:0:17078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.117@tcp lock: ffffa076c1571000/0x70d6b5fa1825def7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x70d6b5fa1825defe expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498746.357809:0:17078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa076c1571000/0x70d6b5fa1825def7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x70d6b5fa1825defe expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498746.357824:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498746.357825:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498746.357827:0:17078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789498746.361134:0:21272:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa076bec7bd20 - data ffffa076897c7af8/ffffa076bbea0800 00000020:01000000:1.0:1789498746.362973:0:21272:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0758150cc00 - data ffffa076a7ba7510/ffffa076b04c7c00 00100000:10000000:1.0:1789498746.373583:0:21272:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789498746.382467:0:21272:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825dd22 00000020:00000080:0.0:1789498746.382481:0:21272:0:(genops.c:885:class_export_put()) final put ffffa0758722c000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789498746.382503:0:21272:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa076bc78b800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789498746.382507:0:21272:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa076bc78b800 2 00000020:01000004:0.0:1789498746.382510:0:21272:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa076bc78b800 from lustre-OST0001 00000020:00000080:0.0:1789498746.382565:0:21272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789498746.382576:0:21272:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789498746.382579:0:21272:0:(genops.c:885:class_export_put()) final put ffffa0758722e800/lustre-OST0001_UUID 00000020:00000080:0.0:1789498746.382582:0:21272:0:(genops.c:844:class_export_destroy()) destroying export ffffa0758722e800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789498746.382588:0:21272:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1789498746.382701:0:21272:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 20dec396-e124-4c94-9424-ae01f240e87e->MGS 00010000:00010000:0.0:1789498746.382718:0:21272:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa075874a0200/0x70d6b5fa1825da6d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x70d6b5fa1825da74 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498746.382732:0:21272:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa075874a0200/0x70d6b5fa1825da6d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x70d6b5fa1825da74 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498746.382740:0:21272:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789498746.382743:0:21272:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789498746.382746:0:21272:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789498746.382759:0:21272:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa076981d3000 00010000:00010000:0.0:1789498746.382764:0:21272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa075874a0200/0x70d6b5fa1825da6d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x70d6b5fa1825da74 expref: -99 pid: 17822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498746.382779:0:21272:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa076c1570c00/0x70d6b5fa1825d95c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x70d6b5fa1825d963 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498746.382801:0:21272:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa076c1570c00/0x70d6b5fa1825d95c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x70d6b5fa1825d963 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498746.382805:0:21272:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789498746.382808:0:21272:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789498746.382810:0:21272:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789498746.382819:0:21272:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa076981d3000 00010000:00010000:0.0:1789498746.382822:0:21272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa076c1570c00/0x70d6b5fa1825d95c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x70d6b5fa1825d963 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789498746.382839:0:21272:0:(import.c:65:import_set_state_nolock()) ffffa076981d3000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789498746.382844:0:21272:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789498746.382846:0:21272:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789498746.382847:0:21272:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789498746.382852:0:21272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789498746.382864:0:21272:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffffa075874f4e00 x1876424916165248/t0(0) o250->MGC192.168.204.117@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789498752 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000080:3.0:1789498746.383041:0:15719:0:(genops.c:844:class_export_destroy()) destroying export ffffa0758722c000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:0.0:1789498746.383097:0:21272:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789498746.383100:0:21272:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:2.0:1789498746.383315:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:20dec396-e124-4c94-9424-ae01f240e87e:3640:1876424916165248:0@lo:250:kworker.0 10000000:01000000:0.0:1789498746.383404:0:21272:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789498746.383411:0:21272:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825d947 00000020:00000080:0.0:1789498746.383416:0:21272:0:(genops.c:885:class_export_put()) final put ffffa076981d0800/20dec396-e124-4c94-9424-ae01f240e87e 00000020:01000000:0.0:1789498746.383431:0:21272:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.117@tcp (flags='') 00000020:00000080:0.0:1789498746.383437:0:21272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789498746.383441:0:21272:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.117@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789498746.383445:0:21272:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffffa07585733380) has no exports 00000020:00000080:3.0:1789498746.383501:0:15719:0:(genops.c:844:class_export_destroy()) destroying export ffffa076981d0800/20dec396-e124-4c94-9424-ae01f240e87e for MGC192.168.204.117@tcp 10000000:01000000:2.0:1789498746.383562:0:17088:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1789498746.383793:0:21272:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.117@tcp: client import never connected 00000100:00080000:0.0:1789498746.383796:0:21272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789498746.383798:0:21272:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789498746.383800:0:21272:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789498746.383813:0:21272:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789498746.383909:0:21272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789498746.383915:0:21272:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.117@tcp (uuid 20dec396-e124-4c94-9424-ae01f240e87e) 00000020:01000000:0.0:1789498746.383920:0:21272:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789498746.383923:0:21272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789498746.383926:0:21272:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789498746.383930:0:21272:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffffa075810da800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789498746.383936:0:21272:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffffa075876fb380) has exports, disconnecting them 00000020:00080000:0.0:1789498746.383940:0:21272:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffffa075810da800), last request at 1789498677 00000020:00000080:0.0:1789498746.383944:0:21272:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825dd4c 00000020:00080000:0.0:1789498746.383954:0:21272:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffffa075810da800): rc 0 00000020:00000080:0.0:1789498746.383958:0:21272:0:(genops.c:885:class_export_put()) final put ffffa075810da800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789498746.384137:0:15719:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa076981d3000 for MGC192.168.204.117@tcp 00000020:00000080:3.0:1789498746.384144:0:15719:0:(genops.c:885:class_export_put()) final put ffffa076981d6000/20dec396-e124-4c94-9424-ae01f240e87e 00000020:00000080:3.0:1789498746.384146:0:15719:0:(genops.c:844:class_export_destroy()) destroying export ffffa076981d6000/20dec396-e124-4c94-9424-ae01f240e87e for MGC192.168.204.117@tcp 00000020:01000000:3.0:1789498746.384150:0:15719:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.117@tcp (20dec396-e124-4c94-9424-ae01f240e87e) 00000020:00000080:3.0:1789498746.385872:0:15719:0:(genops.c:844:class_export_destroy()) destroying export ffffa075810da800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789498746.398221:0:21272:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789498746.398231:0:21272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789498746.398236:0:21272:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789498746.398254:0:21272:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789498746.398492:0:21272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789498746.398501:0:21272:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1789498746.398509:0:21272:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789498746.398514:0:21272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789498746.398518:0:21272:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789498746.398526:0:21272:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffffa075856dd800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789498746.398560:0:21272:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffffa075872719c0) has exports, disconnecting them 00000020:00080000:0.0:1789498746.398566:0:21272:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffffa075856dd800), last request at 1789498677 00000020:00000080:0.0:1789498746.398570:0:21272:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825dd61 00000020:00080000:0.0:1789498746.398584:0:21272:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffffa075856dd800): rc 0 00000020:00000080:0.0:1789498746.398589:0:21272:0:(genops.c:885:class_export_put()) final put ffffa075856dd800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1789498746.398858:0:15719:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa076bc788800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789498746.398866:0:15719:0:(genops.c:885:class_export_put()) final put ffffa075875a2800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789498746.398869:0:15719:0:(genops.c:844:class_export_destroy()) destroying export ffffa075875a2800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789498746.398885:0:15719:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789498746.399609:0:15719:0:(genops.c:844:class_export_destroy()) destroying export ffffa075856dd800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1789498746.402623:0:21272:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789498746.402631:0:21272:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789498746.402635:0:21272:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789498746.402644:0:21272:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789498746.402723:0:17079:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1789498746.402887:0:18245:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:3.0:1789498746.402977:0:15719:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffffa0758722b000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1789498746.403120:0:17078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1789498746.403287:0:17074:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffffa076a0bd5600:17074] 1 exiting: rc = 0 00000100:00100000:1.0:1789498746.405353:0:17073:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffffa076a0bd4200:17073] 0 exiting: rc = 1 00000100:00100000:2.0:1789498746.405584:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.405849:0:17075:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffffa076a0bd4800:17075] 0 exiting: rc = 1 00000100:00100000:2.0:1789498746.405922:0:17077:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffffa076beb28c00:17077] 2 exiting: rc = 0 00000100:00100000:2.0:1789498746.405993:0:20121:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffffa07588264600:20121] 3 exiting: rc = 0 00000100:00100000:1.0:1789498746.406557:0:17076:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffffa076beb29600:17076] 1 exiting: rc = 0 00000100:00100000:2.0:1789498746.406863:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.406870:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.406886:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.406893:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.406899:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.406906:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.406911:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.406916:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.406921:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.406935:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.406941:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.406946:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.406952:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.406957:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.406962:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.406968:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.406974:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.406979:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.406985:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.406990:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.406995:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407000:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407005:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407011:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407017:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407023:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407028:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407032:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407037:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407042:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407047:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407052:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407057:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407062:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407067:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407072:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407077:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407082:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407088:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407092:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407097:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407102:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407107:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407112:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407124:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407129:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407134:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407139:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407143:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407147:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407152:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407157:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407161:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407166:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407170:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407175:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407179:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407184:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407189:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407193:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407198:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407202:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407207:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.407212:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789498746.410218:0:21272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789498746.410236:0:21272:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1789498746.410255:0:21272:0:(genops.c:885:class_export_put()) final put ffffa07587229000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1789498746.410259:0:21272:0:(genops.c:844:class_export_destroy()) destroying export ffffa07587229000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1789498746.410265:0:21272:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1789498746.410339:0:21272:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa076bc78b800 1 00000020:00000080:2.0:1789498746.410345:0:21272:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x70d6b5fa1825dd06 00000020:00000080:2.0:1789498746.410352:0:21272:0:(genops.c:885:class_export_put()) final put ffffa076bc78e000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1789498746.410761:0:21272:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1789498746.410766:0:21272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789498746.410771:0:21272:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789498746.410775:0:21272:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffffa0758666b380) has no exports 00000020:00000080:3.0:1789498746.413644:0:15719:0:(genops.c:844:class_export_destroy()) destroying export ffffa076bc78e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789498746.455300:0:21272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789498746.455313:0:21272:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1789498746.455319:0:21272:0:(genops.c:885:class_export_put()) final put ffffa076bc789000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1789498746.455324:0:21272:0:(genops.c:844:class_export_destroy()) destroying export ffffa076bc789000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1789498746.455335:0:21272:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1789498746.455951:0:21272:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa076bc78f800 00000020:01000000:1.0:1789498746.455974:0:21272:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1789498746.455979:0:21272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789498746.455984:0:21272:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789498746.455988:0:21272:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffffa076beff4d40) has no exports 00000020:00000080:1.0:1789498746.456009:0:21272:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789498746.456015:0:21272:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1789498746.456018:0:21272:0:(genops.c:885:class_export_put()) final put ffffa0758805f000/OSS_uuid 00000020:00000080:1.0:1789498746.456021:0:21272:0:(genops.c:844:class_export_destroy()) destroying export ffffa0758805f000/OSS_uuid for OSS 00000020:01000000:1.0:1789498746.456024:0:21272:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1789498746.456101:0:18600:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffffa076a76d1400:18600] 2 exiting: rc = 0 00000100:00100000:1.0:1789498746.456182:0:18599:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffffa07586687000:18599] 1 exiting: rc = 0 00000100:00100000:1.0:1789498746.456226:0:19084:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffffa07586735a00:19084] 3 exiting: rc = 0 00000100:00080000:0.0:1789498746.456357:0:17086:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1789498746.456473:0:20235:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffffa076bbe2c200:20235] 4 exiting: rc = 0 00000100:00100000:3.0:1789498746.457123:0:18598:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffffa076a76d0600:18598] 0 exiting: rc = 1 00000100:00100000:1.0:1789498746.457377:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457385:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457391:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457396:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457411:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457417:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457422:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457428:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457434:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457439:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457444:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457450:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457455:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457461:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457477:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457482:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457488:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457493:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457497:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457502:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457507:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457512:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457517:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457522:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457527:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457912:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457921:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457927:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457933:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457940:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457945:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457949:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457954:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457960:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457965:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457971:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457977:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457983:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457988:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457994:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.457999:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.458004:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.458010:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.458015:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.458020:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.458026:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.458032:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.458038:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.458043:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.458058:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.458064:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.458070:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.458075:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.458080:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.458086:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.458091:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.458096:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.458101:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.458106:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.458112:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.458117:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.458122:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.458127:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.458133:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.461849:0:19589:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffffa07588294800:19589] 2 exiting: rc = 0 00000100:00100000:1.0:1789498746.462266:0:18601:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffffa07587577e00:18601] 0 exiting: rc = 1 00000100:00100000:2.0:1789498746.462341:0:18602:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffffa076b0538400:18602] 1 exiting: rc = 0 00000100:00100000:1.0:1789498746.462467:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.462475:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.462480:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.462484:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.462490:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.462495:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.462499:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.462503:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.462508:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.462512:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.462517:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.462522:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.462527:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.462993:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463000:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463006:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463011:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463018:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463024:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463044:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463049:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463054:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463058:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463063:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463068:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463074:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463080:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463085:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463091:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463096:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463101:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463107:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463111:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463116:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463121:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463127:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463132:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463137:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463143:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463148:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463152:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463158:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463163:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463168:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463173:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463178:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463185:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463190:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463195:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463200:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463206:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463211:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463216:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463221:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463235:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463240:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463255:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463260:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463265:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463272:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463277:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463282:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463287:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789498746.463293:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.465308:0:18604:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffffa075872aa600:18604] 1 exiting: rc = 0 00000100:00100000:2.0:1789498746.465474:0:18603:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffffa076b0538c00:18603] 0 exiting: rc = 1 00000100:00100000:1.0:1789498746.465856:0:18605:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffffa076a9d7a800:18605] 2 exiting: rc = 0 00000100:00100000:2.0:1789498746.466106:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466121:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466127:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466133:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466139:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466145:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466151:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466157:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466163:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466169:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466175:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466180:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466186:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466192:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466197:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466202:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466207:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466214:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466221:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466227:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466232:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466237:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466257:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466264:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466270:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466293:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466301:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466307:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466314:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466320:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466326:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466333:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466339:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466346:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466361:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466368:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466374:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466380:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466386:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466391:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466398:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466404:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466409:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466428:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466434:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466439:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466445:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466456:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466462:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466485:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466492:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466497:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466502:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466509:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466514:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466519:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466524:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466546:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466563:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466579:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466586:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466592:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466598:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.466610:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.474369:0:18607:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffffa07587664c00:18607] 1 exiting: rc = 0 00000100:00100000:0.0:1789498746.474482:0:18606:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffffa076a01ef400:18606] 0 exiting: rc = 1 00000100:00100000:2.0:1789498746.474789:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.474797:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.474802:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.474808:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.474813:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.474828:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.474833:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.474848:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.474854:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.474859:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.474865:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.474870:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.474969:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.474974:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.474979:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.474985:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.474989:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.474994:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475000:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475005:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475010:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475016:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475021:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475025:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475030:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475035:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475039:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475044:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475049:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475053:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475058:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475063:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475068:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475072:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475076:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475081:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475086:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475091:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475095:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475100:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475111:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475116:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475121:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475126:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475131:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475136:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475141:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475146:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475151:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475156:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475160:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475165:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475169:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475174:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475179:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475183:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475188:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475192:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475197:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475201:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475206:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475210:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475215:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789498746.475220:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.476855:0:18609:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffffa0768b483600:18609] 1 exiting: rc = 0 00000100:00100000:2.0:1789498746.477212:0:18608:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffffa076a76d9e00:18608] 0 exiting: rc = 1 00000100:00100000:3.0:1789498746.477370:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.477412:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.477420:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.477427:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.477435:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.477441:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.477447:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.477454:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.477461:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.477467:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.477473:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.477478:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.477484:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.477504:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.477511:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.477517:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.477522:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.477558:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.477565:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.477572:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.477578:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.477584:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.477855:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.477865:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.477980:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478006:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478013:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478019:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478025:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478031:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478036:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478042:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478047:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478053:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478058:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478064:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478079:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478097:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478103:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478109:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478114:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478119:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478125:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478130:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478135:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478140:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478145:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478151:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478156:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478175:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478182:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478190:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478196:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478201:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478207:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478214:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478220:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478225:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478231:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478237:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478259:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478267:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478342:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789498746.478360:0:21272:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789498746.502410:0:21272:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1789498772.471504:0:22036:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg417-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789498789.114307:0:22637:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789498789.114312:0:22637:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1789498789.114314:0:22637:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789498789.114442:0:22637:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa0758605a000 00000020:01000004:3.0:1789498789.114457:0:22637:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789498789.114464:0:22637:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789498789.114476:0:22637:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffffa076bc7919c0) 00000020:00000080:3.0:1789498789.118188:0:22637:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789498789.235023:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789498789.247224:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789498789.259325:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1789498789.269031:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1789498789.269622:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789498789.270880:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789498789.271202:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1789498789.271743:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1789498789.272023:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789498789.272290:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1789498789.273271:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789498789.273843:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789498789.274132:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1789498789.274808:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789498789.275098:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1789498789.281743:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1789498789.282565:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1789498789.283104:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1789498789.283360:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1789498789.283789:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1789498789.284074:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1789498789.284283:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1789498789.284668:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1789498789.284929:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1789498789.285126:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1789498789.285318:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1789498789.289151:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1789498789.289787:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1789498789.290074:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1789498789.290339:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1789498789.290917:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1789498789.291136:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1789498789.291345:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1789498789.291882:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1789498789.292270:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1789498789.292960:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1789498789.293468:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1789498789.293965:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1789498789.294235:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1789498789.294629:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1789498789.294987:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1789498789.295253:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1789498789.295698:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1789498789.296065:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1789498789.296330:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1789498789.302722:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1789498789.306457:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1789498789.325344:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1789498789.327408:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1789498789.327788:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1789498789.328314:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1789498789.329071:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1789498789.329354:0:22637:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:1.0:1789498789.331411:0:22637:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789498789.331702:0:22637:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789498789.331711:0:22637:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789498789.331722:0:22637:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x70d6b5fa1825e1ba 00000020:01000004:1.0:1789498789.331730:0:22637:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1789498789.331735:0:22637:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789498789.331740:0:22637:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0758605a000 from MGS 00000020:01000004:1.0:1789498789.331744:0:22637:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789498789.331754:0:22637:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffffa076a01f99c0) 00000020:00000080:1.0:1789498789.331768:0:22637:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789498789.331833:0:22637:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0758605a000 from MGS, refs=2 00080000:01000000:1.0:1789498789.331838:0:22637:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789498789.331860:0:22637:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x70d6b5fa1825e1c8 00000100:00100000:1.0:1789498789.331953:0:22637:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789498789.332080:0:22637:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789498789.332085:0:22637:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789498789.333026:0:22637:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789498789.333034:0:22637:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789498789.334572:0:22637:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789498789.334770:0:22637:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789498789.334776:0:22637:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789498789.336264:0:22637:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789498789.336275:0:22637:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789498789.337117:0:22637:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789498789.337126:0:22637:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789498789.338834:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498789.338838:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498789.338839:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498789.339123:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498789.339125:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498789.339127:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498789.340331:0:22637:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789498789.344706:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789498789.353311:0:22637:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1789498789.354201:0:22649:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789498789.354262:0:22637:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789498789.354307:0:22637:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789498789.355170:0:22637:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789498789.355529:0:22637:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789498789.355764:0:22637:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789498789.355773:0:22637:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789498789.356486:0:22637:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789498789.356493:0:22637:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789498789.358088:0:22637:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789498789.358098:0:22637:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789498789.359099:0:22637:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789498789.359125:0:22637:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.117@tcp' 00000020:01000004:0.0:1789498789.359128:0:22637:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789498789.359160:0:22637:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.117@tcp (typ=mgc) 00000020:00000080:0.0:1789498789.359174:0:22637:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.117@tcp (ffffa075876f8000) 00000020:00000080:0.0:1789498789.359193:0:22637:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789498789.359275:0:22637:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa076bbf3b000@MGC192.168.204.117@tcp: add connection 192.168.204.117@tcp at head 00010000:00010000:0.0:1789498789.359442:0:22637:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.117@tcp-0 is initialized 00000040:01000000:0.0:1789498789.359449:0:22637:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.117@tcp ctxt 1 is initialized 00000100:00080000:2.0:1789498789.361264:0:22654:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1789498789.368692:0:22655:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789498789.368797:0:22637:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.117@tcp (uuid 39f24317-e976-4eca-a2df-96def568323f) 00000020:00000080:0.0:1789498789.368831:0:22637:0:(genops.c:1384:class_connect()) connect: client 39f24317-e976-4eca-a2df-96def568323f, cookie 0x70d6b5fa1825e1d6 00000100:00080000:0.0:1789498789.368844:0:22637:0:(import.c:545:import_select_connection()) MGC192.168.204.117@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789498789.368856:0:22637:0:(import.c:666:import_select_connection()) MGC192.168.204.117@tcp: import ffffa076bbf3b000 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:0.0:1789498789.368899:0:22637:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa075874f5500 x1876424916166016/t0(0) o250->MGC192.168.204.117@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789498789.368931:0:22637:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 39f24317-e976-4eca-a2df-96def568323f->MGS 00000020:01000004:0.0:1789498789.368960:0:22637:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789498789.368967:0:22637:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789498789.368985:0:22637:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffffa075876fcd40) 00000020:00000080:0.0:1789498789.369001:0:22637:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789498789.372256:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:39f24317-e976-4eca-a2df-96def568323f:3640:1876424916166016:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789498789.372351:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498789.372493:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916166016 00000100:00100000:1.0:1789498789.372503:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916166016 00000100:00100000:1.0:1789498789.372604:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789498789.372614:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3640:x1876424916166016:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1789498789.372641:0:22650:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 39f24317-e976-4eca-a2df-96def568323f@0@lo t0 exp 0000000000000000 cur 623 last 0 00000020:00000080:1.0:1789498789.372674:0:22650:0:(genops.c:1384:class_connect()) connect: client 39f24317-e976-4eca-a2df-96def568323f, cookie 0x70d6b5fa1825e1e4 00000100:00080000:1.0:1789498789.372996:0:22650:0:(import.c:65:import_set_state_nolock()) ffffa0768b71f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789498789.373071:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+5:3640:x1876424916166016:12345-0@lo:250:mount.lustre.0 Request processed in 456us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498789.373080:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789498789.373128:0:3640:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.117@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789498789.373140:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.117@tcp: connect to target with instance 0 00000100:00080000:1.0:1789498789.373151:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.117@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789498789.373157:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789498789.373161:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076bbf3b000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789498789.373164:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789498789.373183:0:3640:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789498789.373190:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:39f24317-e976-4eca-a2df-96def568323f:3640:1876424916166016:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789498789.381230:0:22637:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789498789.381477:0:22637:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789498789.381484:0:22637:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789498789.384470:0:22637:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789498789.384483:0:22637:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789498789.388166:0:22637:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789498789.388181:0:22637:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789498789.389271:0:22637:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789498789.389478:0:22637:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789498789.389484:0:22637:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789498789.390296:0:22637:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789498789.390304:0:22637:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789498789.427404:0:22637:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789498789.427992:0:22637:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789498789.428006:0:22637:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789498789.429209:0:22637:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789498789.429218:0:22637:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789498789.430092:0:22637:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789498789.430282:0:22637:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789498789.430288:0:22637:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789498789.430961:0:22637:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789498789.430969:0:22637:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789498789.431495:0:22637:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789498789.431666:0:22637:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789498789.431670:0:22637:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789498789.432151:0:22637:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789498789.432158:0:22637:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789498789.433056:0:22637:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789498789.433232:0:22637:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789498789.433237:0:22637:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789498789.434289:0:22637:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789498789.434298:0:22637:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789498789.463988:0:22637:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789498789.464199:0:22637:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789498789.464205:0:22637:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789498789.467973:0:22637:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789498789.467989:0:22637:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789498789.469369:0:22637:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789498789.469381:0:22637:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789498789.478123:0:22637:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789498789.478160:0:22637:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1789498789.478167:0:22637:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.117@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789498789.478268:0:22637:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.117@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789498789.478299:0:22637:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.117@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1789498789.478303:0:22637:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789498789.478305:0:22637:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789498789.478307:0:22637:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789498789.478308:0:22637:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789498789.478309:0:22637:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789498789.478310:0:22637:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789498789.478312:0:22637:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789498789.478313:0:22637:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789498789.478315:0:22637:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789498789.478316:0:22637:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789498789.478319:0:22637:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1789498789.478321:0:22637:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789498789.478322:0:22637:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789498789.478324:0:22637:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789498789.478325:0:22637:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789498789.478326:0:22637:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789498789.478327:0:22637:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789498789.478329:0:22637:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789498789.478329:0:22637:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789498789.478330:0:22637:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789498789.478331:0:22637:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789498789.478368:0:22637:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789498789.478392:0:22637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916166144:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789498789.478858:0:22637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498789.480161:0:22637:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a0983180 going to sleep for 11 seconds 00000100:00100000:2.0:1789498789.483202:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916166144 00000100:00100000:2.0:1789498789.483218:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916166144 00000100:00100000:2.0:1789498789.483276:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789498789.483288:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+5:22637:x1876424916166144:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789498789.483356:0:22653:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789498789.483359:0:22653:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789498789.483363:0:22653:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789498789.488687:0:22674:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789498789.489585:0:22653:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:0.0:1789498789.493517:0:22675:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1789498789.493526:0:22675:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1789498789.493614:0:22675:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1789498789.493620:0:22675:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1789498789.493829:0:22675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1789498789.495178:0:22653:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789498789.495191:0:22653:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789498789.501062:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+5:22637:x1876424916166144:12345-0@lo:253:mount.lustre.0 Request processed in 17757us (22187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498789.501075:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789498789.501284:0:22637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916166144:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789498789.501303:0:22637:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789498789.501307:0:22637:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789498789.501308:0:22637:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789498789.501310:0:22637:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789498789.501311:0:22637:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789498789.501313:0:22637:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789498789.501314:0:22637:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789498789.501316:0:22637:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789498789.501317:0:22637:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789498789.501319:0:22637:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789498789.501320:0:22637:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789498789.501341:0:22637:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0758605a000 from lustre-MDT0000 10000000:01000000:0.0:1789498789.501371:0:22637:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789498789.501373:0:22637:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789498789.501378:0:22637:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffffa075876f8000 10000000:01000000:0.0:1789498789.501384:0:22637:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789498789.501393:0:22637:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa075876f8000 from 1 10000000:01000000:0.0:1789498789.501396:0:22637:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789498789.501455:0:22637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9000/0x70d6b5fa1825e1eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498789.501467:0:22637:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9000/0x70d6b5fa1825e1eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498789.501477:0:22637:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9000/0x70d6b5fa1825e1eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498789.501496:0:22637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916166272:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789498789.501615:0:22637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498789.501660:0:22637:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a0983900 going to sleep for 11 seconds 00000100:00100000:1.0:1789498789.502998:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916166272 00000100:00100000:1.0:1789498789.503011:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916166272 00000100:00100000:1.0:1789498789.503065:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789498789.503073:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+5:22637:x1876424916166272:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789498789.503089:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498789.503107:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa075857b1800/0x70d6b5fa1825e1f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e1eb expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498789.503137:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa075857b1800/0x70d6b5fa1825e1f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e1eb expref: 6 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498789.503150:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa075857b1800/0x70d6b5fa1825e1f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e1eb expref: 6 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498789.503159:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa075857b1800, rc 0) 00000100:00100000:1.0:1789498789.503226:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+6:22637:x1876424916166272:12345-0@lo:101:mount.lustre.0 Request processed in 153us (1611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498789.503232:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789498789.503332:0:22637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916166272:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789498789.503369:0:22637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9000/0x70d6b5fa1825e1eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e1f2 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498789.503382:0:22637:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9000/0x70d6b5fa1825e1eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e1f2 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498789.503587:0:22637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916166400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789498789.503623:0:22637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498789.503651:0:22637:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a0983900 going to sleep for 11 seconds 00000100:00100000:3.0:1789498789.504571:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916166400 00000100:00100000:3.0:1789498789.504578:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916166400 00000100:00100000:3.0:1789498789.504621:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789498789.504630:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+6:22637:x1876424916166400:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498789.504842:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+6:22637:x1876424916166400:12345-0@lo:501:mount.lustre.0 Request processed in 212us (1218us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789498789.504849:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789498789.504890:0:22637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916166400:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789498789.504924:0:22637:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789498789.504938:0:22637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9000/0x70d6b5fa1825e1eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e1f2 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498789.504963:0:22637:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9000/0x70d6b5fa1825e1eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e1f2 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498789.504972:0:22637:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0758605a000 10000000:01000000:3.0:1789498789.504977:0:22637:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789498789.504982:0:22637:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffffa0758605a000 10000000:01000000:3.0:1789498789.504984:0:22637:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789498789.504988:0:22637:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffffa0758605a000 from 1 10000000:01000000:3.0:1789498789.504991:0:22637:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789498789.505015:0:22637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075874a1a00/0x70d6b5fa1825e1f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498789.505023:0:22637:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa075874a1a00/0x70d6b5fa1825e1f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498789.505031:0:22637:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa075874a1a00/0x70d6b5fa1825e1f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498789.505046:0:22637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916166528:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789498789.505074:0:22637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498789.505107:0:22637:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a9c1c780 going to sleep for 11 seconds 00000100:00100000:1.0:1789498789.505298:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916166528 00000100:00100000:1.0:1789498789.505303:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916166528 00000100:00100000:1.0:1789498789.505322:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789498789.505328:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+6:22637:x1876424916166528:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789498789.505343:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498789.505354:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa075857b1000/0x70d6b5fa1825e200 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e1f9 expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498789.505373:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa075857b1000/0x70d6b5fa1825e200 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e1f9 expref: 7 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498789.505381:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa075857b1000/0x70d6b5fa1825e200 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e1f9 expref: 7 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498789.505389:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa075857b1000, rc 0) 00000100:00100000:1.0:1789498789.505497:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+7:22637:x1876424916166528:12345-0@lo:101:mount.lustre.0 Request processed in 168us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498789.505503:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789498789.506027:0:22637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916166528:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789498789.506111:0:22637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa075874a1a00/0x70d6b5fa1825e1f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e200 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498789.506123:0:22637:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa075874a1a00/0x70d6b5fa1825e1f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e200 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498789.506221:0:22637:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789498789.506272:0:22637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075874a1a00/0x70d6b5fa1825e1f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e200 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498789.506281:0:22637:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa075874a1a00/0x70d6b5fa1825e1f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e200 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498789.506289:0:22637:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789498789.506294:0:22637:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789498789.506299:0:22637:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffffa0758605a000 10000000:01000000:3.0:1789498789.506302:0:22637:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789498789.506305:0:22637:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789498789.506308:0:22637:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789498789.506327:0:22637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075874a1c00/0x70d6b5fa1825e207 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498789.506334:0:22637:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa075874a1c00/0x70d6b5fa1825e207 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498789.506353:0:22637:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa075874a1c00/0x70d6b5fa1825e207 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498789.506368:0:22637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916166656:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789498789.506423:0:22637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498789.506452:0:22637:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a9c1c780 going to sleep for 11 seconds 00000100:00100000:1.0:1789498789.506573:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916166656 00000100:00100000:1.0:1789498789.506578:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916166656 00000100:00100000:1.0:1789498789.506615:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789498789.506622:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+7:22637:x1876424916166656:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789498789.506631:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498789.506640:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa075857b1e00/0x70d6b5fa1825e20e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e207 expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498789.506655:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa075857b1e00/0x70d6b5fa1825e20e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e207 expref: 8 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498789.506663:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa075857b1e00/0x70d6b5fa1825e20e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e207 expref: 8 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498789.506671:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa075857b1e00, rc 0) 00000100:00100000:1.0:1789498789.506774:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+8:22637:x1876424916166656:12345-0@lo:101:mount.lustre.0 Request processed in 151us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498789.506781:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789498789.507289:0:22637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916166656:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789498789.507303:0:22637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa075874a1c00/0x70d6b5fa1825e207 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e20e expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498789.507319:0:22637:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa075874a1c00/0x70d6b5fa1825e207 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e20e expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498789.507950:0:22637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916166784:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498789.507992:0:22637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498789.508026:0:22637:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a9c1c780 going to sleep for 11 seconds 00000100:00100000:0.0:1789498789.508185:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916166784 00000100:00100000:0.0:1789498789.508190:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916166784 00000100:00100000:0.0:1789498789.508229:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789498789.508237:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+8:22637:x1876424916166784:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789498789.508399:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+9:22637:x1876424916166784:12345-0@lo:501:mount.lustre.0 Request processed in 162us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498789.508419:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789498789.508763:0:22637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916166784:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498789.508797:0:22637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916166912:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789498789.508837:0:22637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498789.508859:0:22637:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a9c1c780 going to sleep for 11 seconds 00000100:00100000:2.0:1789498789.509310:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916166912 00000100:00100000:2.0:1789498789.509316:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916166912 00000100:00100000:2.0:1789498789.509867:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789498789.509882:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+9:22637:x1876424916166912:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789498789.510703:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+9:22637:x1876424916166912:12345-0@lo:503:mount.lustre.0 Request processed in 822us (1862us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498789.510713:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789498789.510860:0:22637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916166912:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789498789.520438:0:22676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39f24317-e976-4eca-a2df-96def568323f:22676:1876424916167040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789498789.520529:0:22676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498789.522907:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916167040 00000100:00100000:1.0:1789498789.522918:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916167040 00000100:00100000:1.0:1789498789.523071:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789498789.523082:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+9:22676:x1876424916167040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789498789.523297:0:22676:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a013c780 going to sleep for 11 seconds 00000100:00100000:1.0:1789498789.523977:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+9:22676:x1876424916167040:12345-0@lo:502:llog_process_th.0 Request processed in 893us (3445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498789.523987:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789498789.524408:0:22676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39f24317-e976-4eca-a2df-96def568323f:22676:1876424916167040:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789498789.524461:0:22676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498789.524472:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498789.524475:0:22676:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789498789.524480:0:22676:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789498789.524483:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789498789.524498:0:22676:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffffa075872719c0) 00000020:00000080:2.0:1789498789.524513:0:22676:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789498789.524518:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789498789.524681:0:22676:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789498789.524690:0:22676:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x70d6b5fa1825e21c 00000020:00000080:2.0:1789498789.524898:0:22676:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789498789.524903:0:22676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498789.524906:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498789.524907:0:22676:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789498789.524910:0:22676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498789.524913:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498789.524915:0:22676:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789498789.524918:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789498789.524925:0:22676:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffffa07587273380) 00000020:00000080:2.0:1789498789.524936:0:22676:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789498789.524940:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789498789.524942:0:22676:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789498789.524945:0:22676:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789498789.524951:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789498789.524992:0:22676:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0758605a000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789498789.525113:0:22676:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffffa07587270000) 00000020:00000080:2.0:1789498789.525122:0:22676:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789498789.525173:0:22676:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789498789.525179:0:22676:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x70d6b5fa1825e231 00000020:00000080:2.0:1789498789.525266:0:22676:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789498789.525272:0:22676:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789498789.525277:0:22676:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x70d6b5fa1825e238 00080000:01000000:2.0:1789498789.525288:0:22676:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789498789.525292:0:22676:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x70d6b5fa1825e23f 00010000:00010000:3.0:1789498789.608524:0:22676:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789498789.616171:0:22676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934629 00000001:00080000:3.0:1789498789.621428:0:22676:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789498789.624316:0:22676:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffffa076bc794d40) 00000020:00000080:3.0:1789498789.624354:0:22676:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789498789.625664:0:22676:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789498789.625884:0:22676:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x70d6b5fa1825e24d 00000020:00000080:1.0:1789498789.628758:0:22676:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789498789.641103:0:22676:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x70d6b5fa1825e254 00000020:00000080:0.0:1789498789.641581:0:22676:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789498789.641593:0:22676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789498789.641600:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498789.641602:0:22676:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789498789.641605:0:22676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789498789.641608:0:22676:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1789498789.641610:0:22676:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789498789.641611:0:22676:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789498789.641613:0:22676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789498789.641615:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498789.641616:0:22676:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789498789.641624:0:22676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789498789.641628:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498789.641630:0:22676:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789498789.641633:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789498789.641819:0:22676:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789498789.641844:0:22676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789498789.641848:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498789.641849:0:22676:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789498789.641852:0:22676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789498789.641855:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498789.641856:0:22676:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1789498789.641859:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789498789.641865:0:22676:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.117@tcp to nid 0x20000c0a8cc75 (192.168.204.117@tcp) 00000020:00000080:0.0:1789498789.641893:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789498789.641909:0:22676:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffffa075876fb380) 00000020:00000080:0.0:1789498789.641923:0:22676:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1789498789.641928:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789498789.641993:0:22676:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1789498789.642000:0:22676:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789498789.642008:0:22676:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x70d6b5fa1825e262 00010000:00080000:0.0:1789498789.642127:0:22676:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa076bbf39000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.117@tcp at head 00010000:00010000:0.0:1789498789.644906:0:22676:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1789498789.646812:0:22676:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789498789.646827:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789498789.646867:0:22676:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789498789.646897:0:22676:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x70d6b5fa1825e269 00000100:00080000:1.0:1789498789.646910:0:22676:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789498789.646925:0:22676:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffffa076bbf39000 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:1.0:1789498789.646972:0:22676:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa076a9de5880 x1876424916167168/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789498789.647004:0:22676:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789498789.647344:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916167168:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1789498789.647504:0:22676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:3.0:1789498789.647506:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1789498789.647508:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498789.647510:0:22676:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1789498789.647513:0:22676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789498789.647523:0:22676:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1789498789.647525:0:22676:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789498789.647527:0:22676:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789498789.647528:0:22676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789498789.647551:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498789.647553:0:22676:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789498789.647557:0:22676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789498789.647562:0:22676:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789498789.647565:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498789.647566:0:22676:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789498789.647570:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789498789.647573:0:22676:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.117@tcp to nid 0x20000c0a8cc75 (192.168.204.117@tcp) 00000020:01000000:1.0:1789498789.647593:0:22676:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789498789.647596:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789498789.647609:0:22676:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffffa076a01fcd40) 00000020:00000080:1.0:1789498789.647622:0:22676:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1789498789.647628:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789498789.647693:0:22676:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789498789.647701:0:22676:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789498789.647707:0:22676:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x70d6b5fa1825e277 00010000:00080000:1.0:1789498789.647735:0:22676:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa076b06fb000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.117@tcp at head 00000100:00100000:2.0:1789498789.647838:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916167168 00000100:00100000:2.0:1789498789.647847:0:22663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916167168 00000100:00100000:2.0:1789498789.647927:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789498789.647937:0:22663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1876424916167168:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1789498789.647955:0:22663:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00010000:1.0:1789498789.648192:0:22676:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1789498789.649665:0:22676:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789498789.651931:0:22676:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789498789.658072:0:22676:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789498789.659271:0:22676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1789498789.665687:0:22676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:1.0:1789498789.666306:0:22682:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789498789.666311:0:22682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789498789.667389:0:22676:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789498789.667416:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789498789.667467:0:22676:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789498789.667493:0:22676:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x70d6b5fa1825e27e 00000100:00080000:0.0:1789498789.667506:0:22676:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789498789.667517:0:22676:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa076b06fb000 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:2.0:1789498789.667865:0:22663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1876424916167168:12345-0@lo:38:llog_process_th.0 Request processed in 19926us (20357us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789498789.667878:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789498789.667892:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076bbf39000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789498789.667897:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789498789.667901:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916167168:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789498789.668188:0:22676:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa076a9de4e00 x1876424916167296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789498789.668217:0:22676:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1789498789.668263:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916167296:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789498789.668299:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876424916167296 offset 0 length 520: 4 00000020:01000000:1.0:1789498789.668312:0:22676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498789.668317:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498789.668319:0:22676:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789498789.668322:0:22676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789498789.668326:0:22676:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1789498789.668327:0:22676:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789498789.668329:0:22676:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789498789.668330:0:22676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789498789.668332:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498789.668334:0:22676:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789498789.668336:0:22676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789498789.668341:0:22676:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789498789.668344:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498789.668346:0:22676:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789498789.668349:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789498789.668352:0:22676:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.117@tcp to nid 0x20000c0a8cc75 (192.168.204.117@tcp) 00000020:01000000:1.0:1789498789.668375:0:22676:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789498789.668393:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789498789.668417:0:22676:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffffa076a01fb380) 00000020:00000080:1.0:1789498789.668434:0:22676:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1789498789.668441:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789498789.668688:0:22676:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789498789.668696:0:22676:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1789498789.668702:0:22676:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x70d6b5fa1825e28c 00010000:00080000:1.0:1789498789.668735:0:22676:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa076beb13800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.117@tcp at head 00010000:00010000:1.0:1789498789.668984:0:22676:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1789498789.669520:0:22676:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789498789.669747:0:22676:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789498789.674938:0:22676:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789498789.675491:0:22676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1789498789.675846:0:22676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:1.0:1789498789.677360:0:22684:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789498789.677375:0:22684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789498789.680926:0:22676:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789498789.680943:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789498789.680996:0:22676:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789498789.681020:0:22676:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x70d6b5fa1825e293 00000100:00080000:3.0:1789498789.681034:0:22676:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789498789.681713:0:22676:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa076beb13800 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:3.0:1789498789.681762:0:22676:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa075883d8e00 x1876424916167424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789498789.681802:0:22676:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789498789.681885:0:22676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789498789.681891:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498789.681893:0:22676:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789498789.681897:0:22676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789498789.681902:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498789.681903:0:22676:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789498789.681906:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789498789.681908:0:22676:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789498789.681911:0:22676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789498789.681913:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498789.681915:0:22676:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789498789.681917:0:22676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789498789.681920:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498789.681921:0:22676:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789498789.681925:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789498789.681963:0:22676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883d9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39f24317-e976-4eca-a2df-96def568323f:22676:1876424916167552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789498789.683159:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916167424:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789498789.683212:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876424916167424 offset 0 length 520: 4 00000100:00100000:3.0:1789498789.684710:0:22676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498789.684768:0:22676:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a9c1c840 going to sleep for 11 seconds 00000100:00100000:2.0:1789498789.685140:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916167552 00000100:00100000:2.0:1789498789.685149:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916167552 00000100:00100000:2.0:1789498789.685202:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789498789.685212:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+9:22676:x1876424916167552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789498789.685388:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+9:22676:x1876424916167552:12345-0@lo:502:llog_process_th.0 Request processed in 176us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498789.685396:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789498789.685647:0:22676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883d9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39f24317-e976-4eca-a2df-96def568323f:22676:1876424916167552:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789498789.685689:0:22676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789498789.685697:0:22676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498789.685709:0:22676:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789498789.685714:0:22676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1789498789.686181:0:22637:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1789498789.686206:0:22637:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789498789.686232:0:22637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075874a1c00/0x70d6b5fa1825e207 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e20e expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498789.686244:0:22637:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa075874a1c00/0x70d6b5fa1825e207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e20e expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498789.686254:0:22637:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0758605a000 from 1 10000000:01000000:1.0:1789498789.686257:0:22637:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789498789.686290:0:22637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075857b0c00/0x70d6b5fa1825e29a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498789.686299:0:22637:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa075857b0c00/0x70d6b5fa1825e29a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498789.686309:0:22637:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa075857b0c00/0x70d6b5fa1825e29a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498789.686340:0:22637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916167680:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789498789.686380:0:22637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498789.686431:0:22637:0:(client.c:2716:ptlrpc_set_wait()) set ffffa0758753d000 going to sleep for 11 seconds 00000100:00100000:2.0:1789498789.686956:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916167680 00000100:00100000:2.0:1789498789.686965:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916167680 00000100:00100000:2.0:1789498789.686999:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789498789.687007:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+9:22637:x1876424916167680:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789498789.687019:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498789.687674:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa076c1570200/0x70d6b5fa1825e2a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e29a expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498789.687711:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa076c1570200/0x70d6b5fa1825e2a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e29a expref: 10 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498789.687744:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa076c1570200/0x70d6b5fa1825e2a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e29a expref: 10 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498789.687755:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa076c1570200, rc 0) 00000100:00100000:2.0:1789498789.687958:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+10:22637:x1876424916167680:12345-0@lo:101:mount.lustre.0 Request processed in 951us (1576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498789.687966:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789498789.688242:0:22637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916167680:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789498789.688263:0:22637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa075857b0c00/0x70d6b5fa1825e29a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e2a1 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498789.688286:0:22637:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa075857b0c00/0x70d6b5fa1825e29a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e2a1 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498789.689647:0:22637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916167808:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789498789.689736:0:22637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498789.690077:0:22637:0:(client.c:2716:ptlrpc_set_wait()) set ffffa0758753d000 going to sleep for 11 seconds 00000100:00100000:1.0:1789498789.695139:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916167808 00000100:00100000:1.0:1789498789.695162:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916167808 00000100:00100000:1.0:1789498789.695250:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789498789.695261:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+10:22637:x1876424916167808:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789498789.695295:0:22651:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789498789.699670:0:22651:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789498789.699852:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+10:22637:x1876424916167808:12345-0@lo:256:mount.lustre.0 Request processed in 4588us (10111us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498789.699866:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789498789.700015:0:22637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916167808:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789498789.700718:0:22637:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789498789.700736:0:22637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075857b0c00/0x70d6b5fa1825e29a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e2a1 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498789.700749:0:22637:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa075857b0c00/0x70d6b5fa1825e29a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e2a1 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498789.700759:0:22637:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0758605a000 from 1 10000000:01000000:3.0:1789498789.700761:0:22637:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789498789.700805:0:22637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075874a1400/0x70d6b5fa1825e2a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498789.700813:0:22637:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa075874a1400/0x70d6b5fa1825e2a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498789.700823:0:22637:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa075874a1400/0x70d6b5fa1825e2a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498789.700850:0:22637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916167936:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789498789.700906:0:22637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498789.700959:0:22637:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a9c1c840 going to sleep for 11 seconds 00000100:00100000:1.0:1789498789.701606:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916167936 00000100:00100000:1.0:1789498789.701618:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916167936 00000100:00100000:1.0:1789498789.701685:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789498789.701695:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+10:22637:x1876424916167936:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789498789.701713:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498789.701732:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa075857b0200/0x70d6b5fa1825e2af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e2a8 expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498789.701759:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa075857b0200/0x70d6b5fa1825e2af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e2a8 expref: 11 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498789.701770:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa075857b0200/0x70d6b5fa1825e2af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e2a8 expref: 11 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498789.701793:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa075857b0200, rc 0) 00000100:00100000:1.0:1789498789.701854:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+11:22637:x1876424916167936:12345-0@lo:101:mount.lustre.0 Request processed in 160us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498789.701861:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789498789.701983:0:22637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916167936:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789498789.702000:0:22637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa075874a1400/0x70d6b5fa1825e2a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e2af expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498789.702016:0:22637:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa075874a1400/0x70d6b5fa1825e2a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e2af expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498789.702099:0:22637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916168064:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789498789.702133:0:22637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498789.702169:0:22637:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a013c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498789.702325:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916168064 00000100:00100000:1.0:1789498789.702330:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916168064 00000100:00100000:1.0:1789498789.702362:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789498789.702368:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+11:22637:x1876424916168064:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789498789.702764:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+11:22637:x1876424916168064:12345-0@lo:501:mount.lustre.0 Request processed in 395us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498789.702771:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789498789.702847:0:22637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916168064:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789498789.702877:0:22637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916168192:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789498789.702919:0:22637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498789.702946:0:22637:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a013c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789498789.702998:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916168192 00000100:00100000:2.0:1789498789.703003:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916168192 00000100:00100000:2.0:1789498789.703047:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789498789.703055:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+11:22637:x1876424916168192:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789498789.703143:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+11:22637:x1876424916168192:12345-0@lo:503:mount.lustre.0 Request processed in 88us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498789.703150:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789498789.703273:0:22637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916168192:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789498789.704004:0:22686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39f24317-e976-4eca-a2df-96def568323f:22686:1876424916168320:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789498789.704132:0:22686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498789.704157:0:22686:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a013c780 going to sleep for 11 seconds 00000100:00100000:2.0:1789498789.704208:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916168320 00000100:00100000:2.0:1789498789.704214:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916168320 00000100:00100000:2.0:1789498789.704253:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789498789.704261:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+11:22686:x1876424916168320:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789498789.706141:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+11:22686:x1876424916168320:12345-0@lo:502:llog_process_th.0 Request processed in 1869us (1998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498789.706157:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789498789.706358:0:22686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39f24317-e976-4eca-a2df-96def568323f:22686:1876424916168320:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789498789.706416:0:22686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789498789.706433:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498789.706443:0:22686:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789498789.706451:0:22686:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0758605a000 00000020:00000080:0.0:1789498789.706454:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789498789.706462:0:22686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789498789.706465:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498789.706466:0:22686:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789498789.706469:0:22686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789498789.706472:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498789.706484:0:22686:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789498789.706489:0:22686:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0758605a000 00000020:00000080:0.0:1789498789.706491:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789498789.706591:0:22686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789498789.706595:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498789.706597:0:22686:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789498789.706599:0:22686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789498789.706602:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498789.706603:0:22686:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789498789.706607:0:22686:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0758605a000 00000020:00000080:0.0:1789498789.706609:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789498789.706631:0:22686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789498789.706634:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498789.706635:0:22686:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789498789.706638:0:22686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789498789.706640:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789498789.706641:0:22686:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789498789.706644:0:22686:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0758605a000 00000020:00000080:0.0:1789498789.706646:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789498789.706702:0:22686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39f24317-e976-4eca-a2df-96def568323f:22686:1876424916168448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789498789.706759:0:22686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498789.706804:0:22686:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076828fe6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498789.707089:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916168448 00000100:00100000:3.0:1789498789.707097:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916168448 00000100:00100000:3.0:1789498789.707143:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789498789.707153:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+11:22686:x1876424916168448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789498789.707278:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+11:22686:x1876424916168448:12345-0@lo:502:llog_process_th.0 Request processed in 126us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498789.707290:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789498789.707576:0:22686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39f24317-e976-4eca-a2df-96def568323f:22686:1876424916168448:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789498789.707604:0:22686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498789.707609:0:22686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498789.707611:0:22686:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789498789.707615:0:22686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789498789.709026:0:22637:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789498789.709079:0:22637:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789498789.709101:0:22637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075874a1400/0x70d6b5fa1825e2a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e2af expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498789.709116:0:22637:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa075874a1400/0x70d6b5fa1825e2a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e2af expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498789.709184:0:22637:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789498789.709188:0:22637:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0758605a000 10000000:01000000:3.0:1789498789.709191:0:22637:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0758605a000 10000000:01000000:3.0:1789498789.709195:0:22637:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789498789.709201:0:22637:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0758605a000 from 1 10000000:01000000:3.0:1789498789.709204:0:22637:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789498789.709249:0:22637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075874a1600/0x70d6b5fa1825e2b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498789.709258:0:22637:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa075874a1600/0x70d6b5fa1825e2b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498789.709272:0:22637:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa075874a1600/0x70d6b5fa1825e2b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498789.709298:0:22637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916168576:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789498789.709372:0:22637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498789.710025:0:22637:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a9c1c180 going to sleep for 11 seconds 00000100:00100000:0.0:1789498789.712312:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916168576 00000100:00100000:0.0:1789498789.712333:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916168576 00000100:00100000:0.0:1789498789.712429:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789498789.712445:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+11:22637:x1876424916168576:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789498789.712467:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498789.712490:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa076bc6d9600/0x70d6b5fa1825e2bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e2b6 expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498789.712522:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa076bc6d9600/0x70d6b5fa1825e2bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e2b6 expref: 12 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498789.712572:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa076bc6d9600/0x70d6b5fa1825e2bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e2b6 expref: 12 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498789.712583:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa076bc6d9600, rc 0) 00000100:00100000:0.0:1789498789.712683:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+12:22637:x1876424916168576:12345-0@lo:101:mount.lustre.0 Request processed in 242us (3312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498789.712691:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789498789.717587:0:22637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916168576:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789498789.717626:0:22637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa075874a1600/0x70d6b5fa1825e2b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e2bd expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498789.717660:0:22637:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa075874a1600/0x70d6b5fa1825e2b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e2bd expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498789.717769:0:22637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916168704:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498789.717880:0:22637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498789.718029:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916168704 00000100:00100000:3.0:1789498789.718049:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916168704 00000100:00100000:3.0:1789498789.718090:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789498789.718099:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+12:22637:x1876424916168704:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498789.718232:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+12:22637:x1876424916168704:12345-0@lo:501:mount.lustre.0 Request processed in 134us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498789.718240:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789498789.718285:0:22637:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a9c1c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789498789.718300:0:22637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916168704:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498789.718331:0:22637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916168832:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789498789.718368:0:22637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498789.718380:0:22637:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a9c1c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789498789.718392:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916168832 00000100:00100000:3.0:1789498789.718395:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916168832 00000100:00100000:3.0:1789498789.718424:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789498789.718431:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+12:22637:x1876424916168832:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789498789.718512:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+12:22637:x1876424916168832:12345-0@lo:503:mount.lustre.0 Request processed in 81us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498789.718519:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789498789.718594:0:22637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916168832:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789498789.721329:0:22688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39f24317-e976-4eca-a2df-96def568323f:22688:1876424916168960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789498789.724199:0:22688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498789.724305:0:22688:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a9c1ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498789.724934:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916168960 00000100:00100000:1.0:1789498789.724947:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916168960 00000100:00100000:1.0:1789498789.725004:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789498789.725016:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+12:22688:x1876424916168960:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789498789.725222:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+12:22688:x1876424916168960:12345-0@lo:502:llog_process_th.0 Request processed in 208us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498789.725230:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789498789.726200:0:22688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39f24317-e976-4eca-a2df-96def568323f:22688:1876424916168960:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1789498789.726288:0:22688:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789498789.726305:0:22688:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffffa076bc790000) 00000020:00000080:3.0:1789498789.726329:0:22688:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1789498789.727713:0:22688:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0758605a000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789498789.727723:0:22688:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0758605a000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789498789.727727:0:22688:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0758605a000 4 00010000:00080000:3.0:1789498789.727769:0:22688:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa07682991800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.117@tcp at head 00010000:00010000:3.0:1789498789.757198:0:22688:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1789498789.757471:0:22688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789498789.757522:0:22688:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789498789.760672:0:22688:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x70d6b5fa1825e2cb 00000100:00080000:3.0:1789498789.760701:0:22688:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789498789.760719:0:22688:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffffa07682991800 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:3.0:1789498789.760774:0:22688:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa075883d9500 x1876424916169088/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789498789.760849:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876424916169088:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789498789.760942:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498789.761049:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916169088 00000100:00100000:3.0:1789498789.761058:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916169088 00000100:00100000:3.0:1789498789.761101:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789498789.761109:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1876424916169088:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789498789.761185:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1876424916169088:12345-0@lo:38:llog_process_th.0 Request processed in 76us (243us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789498789.761194:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789498789.761241:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789498789.761251:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa07682991800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789498789.761269:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789498789.761273:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876424916169088:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789498789.761325:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789498789.761330:0:20398:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789498789.761332:0:20398:0:(import.c:65:import_set_state_nolock()) ffffa076bbf39000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789498789.761337:0:20398:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 623 00000100:00080000:3.0:1789498789.761340:0:20398:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789498789.761346:0:20398:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffffa076bbf39000 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:3.0:1789498789.761359:0:20398:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa075883da680 x1876424916169344/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789498789.761372:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789498789.761376:0:20398:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789498789.761379:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789498789.761382:0:20398:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789498789.766501:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39f24317-e976-4eca-a2df-96def568323f:3641:1876424916169216:0@lo:400:kworker.0 00000100:00100000:3.0:1789498789.766613:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498789.766722:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916169216 00000100:00100000:3.0:1789498789.766731:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916169216 00000100:00100000:3.0:1789498789.766780:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789498789.766798:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+12:3641:x1876424916169216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498789.766858:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+12:3641:x1876424916169216:12345-0@lo:400:kworker.0 Request processed in 63us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498789.766866:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789498789.766914:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916169344:0@lo:38:kworker.0 00000100:00100000:3.0:1789498789.766944:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498789.766986:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916169344 00000100:00100000:3.0:1789498789.766991:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916169344 00000100:00100000:3.0:1789498789.767013:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789498789.767018:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1876424916169344:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789498789.767053:0:22664:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789498789.767091:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1876424916169344:12345-0@lo:38:kworker.0 Request processed in 72us (146us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789498789.767098:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789498789.767139:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39f24317-e976-4eca-a2df-96def568323f:3641:1876424916169216:0@lo:400:kworker.0 00000100:00080000:3.0:1789498789.767167:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076bbf39000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789498789.767173:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789498789.767176:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916169344:0@lo:38:kworker.0 00000100:00080000:3.0:1789498789.767190:0:22688:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789498789.767217:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789498789.767221:0:20398:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789498789.767224:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789498789.767227:0:20398:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789498789.770949:0:22688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883da680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39f24317-e976-4eca-a2df-96def568323f:22688:1876424916169472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789498789.771080:0:22688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498789.771130:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916169472 00000100:00100000:3.0:1789498789.771140:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916169472 00000100:00100000:3.0:1789498789.771183:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789498789.771192:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+12:22688:x1876424916169472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789498789.771429:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+12:22688:x1876424916169472:12345-0@lo:502:llog_process_th.0 Request processed in 237us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498789.771437:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789498789.771491:0:22688:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a0983900 going to sleep for 11 seconds 00000100:00100000:3.0:1789498789.771520:0:22688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883da680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39f24317-e976-4eca-a2df-96def568323f:22688:1876424916169472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789498789.771606:0:22688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883da680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39f24317-e976-4eca-a2df-96def568323f:22688:1876424916169600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789498789.771644:0:22688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498789.771671:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916169600 00000100:00100000:3.0:1789498789.771676:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916169600 00000100:00100000:3.0:1789498789.771702:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789498789.771709:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+12:22688:x1876424916169600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789498789.771772:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+12:22688:x1876424916169600:12345-0@lo:502:llog_process_th.0 Request processed in 62us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498789.771779:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789498789.771807:0:22688:0:(client.c:2716:ptlrpc_set_wait()) set ffffa075874bd540 going to sleep for 11 seconds 00000100:00100000:3.0:1789498789.771818:0:22688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883da680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:39f24317-e976-4eca-a2df-96def568323f:22688:1876424916169600:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789498789.771838:0:22688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789498789.773509:0:22637:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789498789.773586:0:22637:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789498789.773606:0:22637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075874a1600/0x70d6b5fa1825e2b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e2bd expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498789.773627:0:22637:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa075874a1600/0x70d6b5fa1825e2b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e2bd expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789498789.773689:0:22637:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789498789.773691:0:22637:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789498789.773693:0:22637:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789498789.773694:0:22637:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789498789.773695:0:22637:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789498789.773698:0:22637:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789498789.773700:0:22637:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789498789.773701:0:22637:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789498789.773703:0:22637:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789498789.773705:0:22637:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789498789.773708:0:22637:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1789498789.773711:0:22637:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789498789.773713:0:22637:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789498789.773714:0:22637:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789498789.773715:0:22637:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789498789.773716:0:22637:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789498789.773717:0:22637:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789498789.773718:0:22637:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789498789.773719:0:22637:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789498789.773720:0:22637:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789498789.773722:0:22637:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789498789.773752:0:22637:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789498789.773781:0:22637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586727480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916169728:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789498789.773871:0:22637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498789.773912:0:22637:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076ab3e2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789498789.774514:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916169728 00000100:00100000:3.0:1789498789.774526:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916169728 00000100:00100000:3.0:1789498789.774617:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789498789.774645:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+12:22637:x1876424916169728:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789498789.774685:0:22653:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789498789.774702:0:22653:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789498789.802986:0:22653:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789498789.803013:0:22653:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789498789.803834:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+12:22637:x1876424916169728:12345-0@lo:253:mount.lustre.0 Request processed in 29187us (29957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498789.803849:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 20000000:01000000:3.0:1789498789.804969:0:22674:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789498789.804978:0:22674:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789498789.805008:0:22674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa075874a1800/0x70d6b5fa1825e2d2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498789.805030:0:22674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa076c1570200/0x70d6b5fa1825e2a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e29a expref: 11 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498789.805047:0:22674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa075874a1800/0x70d6b5fa1825e2d2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498789.805096:0:22674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa076c1570200/0x70d6b5fa1825e2a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70d6b5fa1825e29a expref: 11 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498789.805114:0:22674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa076c1570200/0x70d6b5fa1825e2a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70d6b5fa1825e29a expref: 11 pid: 22653 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498789.805133:0:22674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883da680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22674:1876424916169856:0@lo:104: 00000100:00100000:3.0:1789498789.805189:0:22674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498789.805374:0:22674:0:(client.c:2716:ptlrpc_set_wait()) set ffffa075874bd540 going to sleep for 11 seconds 00000100:00100000:2.0:1789498789.806004:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916169856 00000100:00100000:2.0:1789498789.806015:0:22641:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916169856 00000100:00100000:2.0:1789498789.806088:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789498789.806099:0:22641:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39f24317-e976-4eca-a2df-96def568323f+3:22674:x1876424916169856:12345-0@lo:104: 00010000:00010000:2.0:1789498789.806116:0:22641:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.117@tcp lock: ffffa075857b0c00/0x70d6b5fa1825e29a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70d6b5fa1825e2a1 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498789.806192:0:22641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789498789.806358:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498789.806365:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.117@tcp lock: ffffa075857b0c00/0x70d6b5fa1825e29a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70d6b5fa1825e2a1 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498789.806373:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075857b0c00 already unused, calling callback (ffffffffc13e6c20) 10000000:00010000:3.0:1789498789.806377:0:22647:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.117@tcp lock: ffffa075857b0c00/0x70d6b5fa1825e29a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x70d6b5fa1825e2a1 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498789.806416:0:22647:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa075857b0c00/0x70d6b5fa1825e29a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x70d6b5fa1825e2a1 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789498789.806424:0:22647:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa075857b0c00/0x70d6b5fa1825e29a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x70d6b5fa1825e2a1 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498789.806430:0:22647:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789498789.806471:0:22647:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.117@tcp lock: ffffa075857b0c00/0x70d6b5fa1825e29a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e2a1 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498789.806478:0:22647:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789498789.806500:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.117@tcp lock: ffffa075857b0c00/0x70d6b5fa1825e29a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e2a1 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498789.806507:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa075857b0c00/0x70d6b5fa1825e29a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e2a1 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498789.806529:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498789.806553:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498789.806554:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498789.806581:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39f24317-e976-4eca-a2df-96def568323f:3642:1876424916169984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789498789.806624:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498789.807074:0:22641:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39f24317-e976-4eca-a2df-96def568323f+3:22674:x1876424916169856:12345-0@lo:104: Request processed in 103us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498789.807085:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789498789.807139:0:22643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916169984 00000100:00100000:2.0:1789498789.807147:0:22643:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916169984 00010000:00010000:2.0:1789498789.807174:0:22643:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa076c1570200/0x70d6b5fa1825e2a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70d6b5fa1825e29a expref: 12 pid: 22653 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498789.807368:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789498789.807378:0:22643:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39f24317-e976-4eca-a2df-96def568323f+12:3642:x1876424916169984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789498789.807393:0:22643:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498789.807398:0:22643:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa076c1570200/0x70d6b5fa1825e2a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70d6b5fa1825e29a expref: 12 pid: 22653 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498789.807424:0:22643:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa076c1570200/0x70d6b5fa1825e2a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70d6b5fa1825e29a expref: 12 pid: 22653 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498789.807443:0:22643:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa075874a1800/0x70d6b5fa1825e2d2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498789.807452:0:22643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa075874a1800/0x70d6b5fa1825e2d2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789498789.807489:0:22643:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002510936s 00010000:00010000:2.0:1789498789.807494:0:22643:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa075874a1800/0x70d6b5fa1825e2d2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498789.807502:0:22643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa075874a1800/0x70d6b5fa1825e2d2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498789.807509:0:22643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa075874a1800/0x70d6b5fa1825e2d2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498789.807517:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa075874a1800/0x70d6b5fa1825e2d2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498789.807524:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a1800 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498789.807529:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa075874a1800/0x70d6b5fa1825e2d2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498789.807559:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa075874a1800/0x70d6b5fa1825e2d2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498789.807570:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa075874a1800/0x70d6b5fa1825e2d2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498789.807583:0:22643:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498789.807635:0:22643:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39f24317-e976-4eca-a2df-96def568323f+12:3642:x1876424916169984:12345-0@lo:103:ldlm_bl.0 Request processed in 260us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498789.807643:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789498789.807684:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39f24317-e976-4eca-a2df-96def568323f:3642:1876424916169984:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789498789.807717:0:22674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa076c1570200/0x70d6b5fa1825e2a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70d6b5fa1825e29a expref: 11 pid: 22653 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498789.807741:0:22674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883da680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22674:1876424916169856:0@lo:104: 00010000:00010000:2.0:1789498789.807756:0:22674:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa075874a1800/0x70d6b5fa1825e2d2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498789.807766:0:22674:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa075874a1800/0x70d6b5fa1825e2d2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498789.807773:0:22674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa075874a1800/0x70d6b5fa1825e2d2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498789.807780:0:22674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa075874a1800/0x70d6b5fa1825e2d2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498789.813753:0:22637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586727480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:22637:1876424916169728:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789498789.813784:0:22637:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789498789.813788:0:22637:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789498789.813790:0:22637:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789498789.813792:0:22637:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789498789.813793:0:22637:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789498789.813794:0:22637:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789498789.813797:0:22637:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789498789.813799:0:22637:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789498789.813801:0:22637:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789498789.814108:0:22637:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789498789.814112:0:22637:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789498789.814138:0:22637:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:3.0:1789498789.901073:0:22637:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:3.0:1789498789.904601:0:22637:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1789498789.905585:0:22698:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:0.0:1789498789.905594:0:22698:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:0.0:1789498789.907847:0:22699:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789498789.907950:0:22637:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:0.0:1789498789.908579:0:22700:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffffa075874f5f80 x1876424916170112/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498789.908593:0:22700:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07683042540 going to sleep for 0 seconds 00000040:01000000:3.0:1789498789.909324:0:22637:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789498789.909369:0:22637:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789498789.910238:0:22637:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789498789.910256:0:22637:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789498789.910358:0:22637:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789498789.910514:0:22699:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789498789.911593:0:22637:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789498789.917998:0:22699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789498789.918375:0:22699:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1789498789.925133:0:22637:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789498789.925251:0:22637:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789498789.935671:0:22637:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1789498789.936484:0:22637:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:1.0:1789498789.956372:0:22637:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1789498789.965008:0:22637:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789498789.965053:0:22637:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb68781be7988 00100000:10000000:1.0:1789498789.965062:0:22637:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789498789.966619:0:22637:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789498789.966643:0:22637:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.117@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789498789.966671:0:22637:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789498789.966710:0:22637:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1789498789.970380:0:22637:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789498789.970655:0:22637:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789498790.418648:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789498790.606514:0:22655:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789498790.606522:0:22655:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0758605a000 from 11 10000000:01000000:1.0:1789498790.606551:0:22655:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789498790.606599:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075857b1600/0x70d6b5fa1825e2d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498790.606610:0:22655:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa075857b1600/0x70d6b5fa1825e2d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498790.606622:0:22655:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa075857b1600/0x70d6b5fa1825e2d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498790.606646:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916170240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789498790.606712:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498790.606752:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a074ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498790.607049:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916170240 00000100:00100000:3.0:1789498790.607059:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916170240 00000100:00100000:3.0:1789498790.607124:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789498790.607134:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07682ae9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+11:22655:x1876424916170240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789498790.607152:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498790.607166:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa075874a1000/0x70d6b5fa1825e2e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e2d9 expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498790.607193:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa075874a1000/0x70d6b5fa1825e2e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e2d9 expref: 12 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498790.607204:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa075874a1000/0x70d6b5fa1825e2e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e2d9 expref: 12 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498790.607213:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa075874a1000, rc 0) 00000100:00100000:3.0:1789498790.607255:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07682ae9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+12:22655:x1876424916170240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498790.607263:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789498790.607360:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916170240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789498790.607375:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa075857b1600/0x70d6b5fa1825e2d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e2e0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498790.607383:0:22655:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa075857b1600/0x70d6b5fa1825e2d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e2e0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498790.607457:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916170368:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789498790.607492:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498790.607516:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a074ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498790.609448:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916170368 00000100:00100000:3.0:1789498790.609461:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916170368 00000100:00100000:3.0:1789498790.609548:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789498790.609560:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07682ae8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+12:22655:x1876424916170368:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789498790.609586:0:22653:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789498790.609608:0:22653:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789498790.609612:0:22653:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1789498790.609735:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07682ae8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+12:22655:x1876424916170368:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 177us (2241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498790.609743:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789498790.610143:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916170368:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789498790.610205:0:22655:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789498790.610215:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075857b1600/0x70d6b5fa1825e2d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e2e0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498790.610232:0:22655:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa075857b1600/0x70d6b5fa1825e2d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e2e0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789498790.784215:0:22692:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789498790.784227:0:22692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498790.785300:0:22692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789498790.785311:0:22692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789498790.971705:0:22700:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07683042540 going to sleep for 0 seconds 00010000:00010000:1.0:1789498791.421903:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789498791.803801:0:22692:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789498791.803810:0:22692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498791.804026:0:22692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1789498791.804068:0:22692:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498791.804233:0:22692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:0.0:1789498791.995627:0:22700:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07683042540 going to sleep for 0 seconds 00010000:00010000:1.0:1789498792.455942:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498793.027127:0:22700:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07683042540 going to sleep for 0 seconds 00010000:00010000:1.0:1789498793.476341:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498794.046012:0:22700:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07683042540 going to sleep for 0 seconds 00010000:00010000:1.0:1789498794.491795:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789498794.939898:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789498794.939905:0:20398:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789498794.939908:0:20398:0:(import.c:65:import_set_state_nolock()) ffffa076bbf39000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789498794.939916:0:20398:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 624 00000100:00080000:2.0:1789498794.939923:0:20398:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789498794.939935:0:20398:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffffa076bbf39000 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:2.0:1789498794.939957:0:20398:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa07586724000 x1876424916170624/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789498794.939992:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789498794.939996:0:20398:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789498794.939998:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789498794.940002:0:20398:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789498794.940004:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789498794.940007:0:20398:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789498794.940009:0:20398:0:(import.c:65:import_set_state_nolock()) ffffa07682991800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789498794.940015:0:20398:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffffa07682991800 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:2.0:1789498794.940046:0:20398:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa07586725880 x1876424916170752/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789498794.940071:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916170624:0@lo:38:kworker.0 00000100:00100000:0.0:1789498794.940085:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789498794.940093:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39f24317-e976-4eca-a2df-96def568323f:3644:1876424916170496:0@lo:400:kworker.0 00000100:00100000:2.0:1789498794.945478:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498794.945606:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876424916170752:0@lo:38:kworker.0 00000100:00100000:2.0:1789498794.945679:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498794.945899:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916170624 00000100:00100000:3.0:1789498794.945910:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916170624 00000100:00100000:3.0:1789498794.945959:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789498794.945969:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1876424916170624:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789498794.945992:0:22664:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789498794.946043:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1876424916170624:12345-0@lo:38:kworker.0 Request processed in 74us (572us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789498794.946050:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789498794.946119:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916170752 00000100:00100000:3.0:1789498794.946125:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916170752 00000100:00100000:3.0:1789498794.946143:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789498794.946148:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1876424916170752:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789498794.946168:0:22660:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 629 last 0 00000020:00000080:3.0:1789498794.946208:0:22660:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x70d6b5fa1825e2e7 00000004:00100000:3.0:1789498794.946228:0:22660:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789498794.946392:0:22660:0:(import.c:65:import_set_state_nolock()) ffffa076bef74800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789498794.946437:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876424916170752:12345-0@lo:38:kworker.0 Request processed in 288us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498794.946444:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789498794.946518:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076bbf39000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789498794.946524:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789498794.946527:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916170624:0@lo:38:kworker.0 00010000:00080000:2.0:1789498794.946574:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa07586725880 x1876424916170752/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789498804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789498794.946598:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1789498794.946607:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789498794.946612:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789498794.946622:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa07682991800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789498794.946629:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876424916170752:0@lo:38:kworker.0 00000100:00100000:0.0:1789498794.947702:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498794.947878:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916170496 00000100:00100000:3.0:1789498794.947887:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916170496 00000100:00100000:3.0:1789498794.947928:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789498794.947948:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07682ae9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+12:3644:x1876424916170496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498794.948034:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07682ae9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+12:3644:x1876424916170496:12345-0@lo:400:kworker.0 Request processed in 88us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498794.948042:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789498794.948702:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39f24317-e976-4eca-a2df-96def568323f:3644:1876424916170496:0@lo:400:kworker.0 00000100:00100000:0.0:1789498795.070806:0:22700:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07683042540 going to sleep for 0 seconds 00010000:00010000:1.0:1789498795.516735:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498796.093598:0:22700:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07683042540 going to sleep for 0 seconds 00010000:00010000:0.0:1789498796.539870:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498797.119774:0:22700:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07683042540 going to sleep for 0 seconds 00010000:00010000:0.0:1789498797.566903:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498798.139630:0:22700:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07683042540 going to sleep for 0 seconds 00000001:02000400:3.0:1789498798.440751:0:22943:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg417-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789498798.590505:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498799.051000:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789498789/real 1789498789] req@ffffa075883d8e00 x1876424916167424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498799 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498799.051030:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa075883d8e00 x1876424916167424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498799 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498799.051128:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789498789/real 1789498789] req@ffffa076a9de4e00 x1876424916167296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498799 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498799.051144:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa076a9de4e00 x1876424916167296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498799 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789498799.051166:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076beb13800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789498799.051187:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789498799.051192:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916167424:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789498799.051198:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076b06fb000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789498799.051202:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789498799.051205:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916167296:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789498799.051418:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789498799.051423:0:20398:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789498799.051426:0:20398:0:(import.c:65:import_set_state_nolock()) ffffa076bbf39000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789498799.051431:0:20398:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 629 00000100:00080000:2.0:1789498799.051437:0:20398:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00100000:3.0:1789498799.051449:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:2.0:1789498799.051450:0:20398:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffffa076bbf39000 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:3.0:1789498799.051464:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39f24317-e976-4eca-a2df-96def568323f:3643:1876424916170880:0@lo:400:kworker.0 00000100:00100000:2.0:1789498799.051475:0:20398:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa07586724000 x1876424916171008/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789498799.051488:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789498799.051491:0:20398:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789498799.051492:0:20398:0:(import.c:65:import_set_state_nolock()) ffffa076b06fb000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789498799.051495:0:20398:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 623 00000100:00080000:2.0:1789498799.051498:0:20398:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789498799.051502:0:20398:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa076b06fb000 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:2.0:1789498799.051511:0:20398:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa07586724e00 x1876424916171136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789498799.051518:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789498799.051520:0:20398:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:3.0:1789498799.051555:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498799.051606:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916170880 00000100:00100000:3.0:1789498799.051615:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916170880 00000100:00080000:2.0:1789498799.051639:0:20398:0:(import.c:65:import_set_state_nolock()) ffffa076beb13800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789498799.051645:0:20398:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 623 00000100:00080000:2.0:1789498799.051647:0:20398:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789498799.051653:0:20398:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa076beb13800 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:2.0:1789498799.051666:0:20398:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa07586724380 x1876424916171264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789498799.051676:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789498799.051687:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07682ae8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+12:3643:x1876424916170880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498799.051705:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876424916171392:0@lo:400:kworker.0 00000100:00100000:2.0:1789498799.051736:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498799.051787:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916171392 00000100:00100000:2.0:1789498799.051791:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916171392 00000100:00100000:2.0:1789498799.051818:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789498799.051825:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876424916171392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498799.051937:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876424916171392:12345-0@lo:400:kworker.0 Request processed in 36us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498799.051945:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789498799.051991:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa07586727480 x1876424916171392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498799.052005:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876424916171392:0@lo:400:kworker.0 00000100:00100000:3.0:1789498799.052090:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07682ae8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+12:3643:x1876424916170880:12345-0@lo:400:kworker.0 Request processed in 57us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498799.052108:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789498799.052151:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39f24317-e976-4eca-a2df-96def568323f:3643:1876424916170880:0@lo:400:kworker.0 00000100:00100000:3.0:1789498799.052170:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916171008:0@lo:38:kworker.0 00000100:00100000:3.0:1789498799.052197:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498799.052222:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916171136:0@lo:8:kworker.0 00000400:00000100:3.0:1789498799.052249:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876424916171136 offset 0 length 520: 4 00000100:00100000:3.0:1789498799.052260:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916171264:0@lo:8:kworker.0 00000400:00000100:3.0:1789498799.052278:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876424916171264 offset 0 length 520: 4 00000100:00100000:2.0:1789498799.053635:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916171008 00000100:00100000:2.0:1789498799.053647:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916171008 00000100:00100000:2.0:1789498799.053688:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789498799.053695:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1876424916171008:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789498799.053715:0:22664:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789498799.053780:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1876424916171008:12345-0@lo:38:kworker.0 Request processed in 85us (1582us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789498799.053802:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789498799.053883:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076bbf39000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789498799.053890:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789498799.053894:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916171008:0@lo:38:kworker.0 00000100:00100000:1.0:1789498799.176302:0:22700:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07683042540 going to sleep for 0 seconds 00010000:00010000:0.0:1789498799.612957:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789498799.948441:0:22995:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789498799.949083:0:22995:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789498800.187943:0:22700:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07683042540 going to sleep for 0 seconds 00010000:00010000:1.0:1789498800.637057:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789498800.964508:0:23045:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789498800.964754:0:23045:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:0.0:1789498801.024291:0:22692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789498801.215044:0:22700:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07683042540 going to sleep for 0 seconds 00010000:00010000:0.0:1789498801.660043:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498802.235635:0:22700:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07683042540 going to sleep for 0 seconds 00010000:00010000:1.0:1789498802.684106:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498803.259705:0:22700:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07683042540 going to sleep for 0 seconds 00010000:00010000:2.0:1789498803.707843:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498804.155835:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1789498804.155855:0:15719:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789498804.155861:0:15719:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789498804.155864:0:15719:0:(import.c:65:import_set_state_nolock()) ffffa076bbf39000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789498804.155873:0:15719:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 633 00000100:00080000:2.0:1789498804.155879:0:15719:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789498804.155893:0:15719:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffffa076bbf39000 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:2.0:1789498804.155921:0:15719:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa07586726300 x1876424916171648/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789498804.155938:0:15719:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789498804.155942:0:15719:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789498804.155945:0:15719:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789498804.155948:0:15719:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789498804.156029:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876424916171776:0@lo:400:kworker.0 00000100:00100000:3.0:1789498804.156101:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498804.156229:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916171776 00000100:00100000:2.0:1789498804.156237:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916171776 00000100:00100000:2.0:1789498804.156345:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789498804.156355:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876424916171776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498804.156413:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876424916171776:12345-0@lo:400:kworker.0 Request processed in 60us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498804.156421:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789498804.160170:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39f24317-e976-4eca-a2df-96def568323f:3641:1876424916171520:0@lo:400:kworker.0 00000100:00100000:1.0:1789498804.160331:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498804.160426:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916171648:0@lo:38:kworker.0 00000100:00100000:1.0:1789498804.160461:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498804.160523:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916171648 00000100:00100000:1.0:1789498804.160594:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916171648 00000100:00100000:1.0:1789498804.160649:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789498804.160656:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9de4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1876424916171648:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789498804.160681:0:22664:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789498804.160732:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9de4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1876424916171648:12345-0@lo:38:kworker.0 Request processed in 75us (270us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789498804.160741:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789498804.160790:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076bbf39000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789498804.160797:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789498804.160800:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916171648:0@lo:38:kworker.0 00010000:00080000:3.0:1789498804.161170:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa07586726680 x1876424916171776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498804.161185:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876424916171776:0@lo:400:kworker.0 00000100:00100000:0.0:1789498804.161380:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916171520 00000100:00100000:0.0:1789498804.161386:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916171520 00000100:00100000:0.0:1789498804.161434:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789498804.161444:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07682aeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+12:3641:x1876424916171520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498804.161509:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07682aeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+12:3641:x1876424916171520:12345-0@lo:400:kworker.0 Request processed in 67us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498804.161525:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789498804.161866:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39f24317-e976-4eca-a2df-96def568323f:3641:1876424916171520:0@lo:400:kworker.0 00000100:00100000:1.0:1789498804.283627:0:22700:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07683042540 going to sleep for 0 seconds 00010000:00010000:1.0:1789498804.731920:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498805.308031:0:22700:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07683042540 going to sleep for 0 seconds 00010000:00010000:2.0:1789498805.760222:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498806.331650:0:22700:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07683042540 going to sleep for 0 seconds 00010000:00010000:1.0:1789498806.779791:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498807.356554:0:22700:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07683042540 going to sleep for 0 seconds 00010000:00010000:0.0:1789498807.810443:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498808.380777:0:22700:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07683042540 going to sleep for 0 seconds 00010000:00010000:1.0:1789498808.828742:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789498809.283973:0:15719:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789498809.283980:0:15719:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789498809.283984:0:15719:0:(import.c:65:import_set_state_nolock()) ffffa076bbf39000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789498809.283992:0:15719:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 638 00000100:00080000:0.0:1789498809.283997:0:15719:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789498809.284007:0:15719:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffffa076bbf39000 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:3.0:1789498809.284099:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789498809.284123:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39f24317-e976-4eca-a2df-96def568323f:3643:1876424916171904:0@lo:400:kworker.0 00000100:00100000:3.0:1789498809.284290:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498809.284346:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916171904 00000100:00100000:3.0:1789498809.284354:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916171904 00000100:00100000:3.0:1789498809.284392:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789498809.284399:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+12:3643:x1876424916171904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498809.284502:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+12:3643:x1876424916171904:12345-0@lo:400:kworker.0 Request processed in 102us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498809.284516:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789498809.284578:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39f24317-e976-4eca-a2df-96def568323f:3643:1876424916171904:0@lo:400:kworker.0 00000100:00100000:0.0:1789498809.284632:0:15719:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa075874f4000 x1876424916172032/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789498809.284653:0:15719:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789498809.284657:0:15719:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789498809.284660:0:15719:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789498809.284663:0:15719:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789498809.284696:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876424916172160:0@lo:400:kworker.0 00000100:00100000:0.0:1789498809.284727:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498809.284760:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916172160 00000100:00100000:0.0:1789498809.284763:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916172160 00000100:00100000:0.0:1789498809.284787:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789498809.284792:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876424916172160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498809.285301:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916172032:0@lo:38:kworker.0 00000100:00100000:3.0:1789498809.285328:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498809.285355:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916172032 00000100:00100000:3.0:1789498809.285358:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916172032 00000100:00100000:3.0:1789498809.285376:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789498809.285381:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1876424916172032:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789498809.285396:0:22664:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789498809.285422:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1876424916172032:12345-0@lo:38:kworker.0 Request processed in 40us (94us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789498809.285428:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789498809.285468:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076bbf39000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789498809.285472:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789498809.285475:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916172032:0@lo:38:kworker.0 00000100:00100000:0.0:1789498809.286272:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876424916172160:12345-0@lo:400:kworker.0 Request processed in 1476us (1540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498809.286283:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789498809.298325:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa075874f5c00 x1876424916172160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498809.298365:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876424916172160:0@lo:400:kworker.0 00000100:00100000:2.0:1789498809.403690:0:22700:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07683042540 going to sleep for 0 seconds 00000020:01000004:2.0:1789498809.631525:0:23390:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789498809.631644:0:23390:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789498809.631647:0:23390:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789498809.633320:0:23390:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa076bc350800 00000020:01000004:2.0:1789498809.633353:0:23390:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1789498809.633376:0:23390:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789498809.633401:0:23390:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffffa07587274d40) 00000020:00000080:2.0:1789498809.633753:0:23390:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789498809.759913:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789498809.763594:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1789498809.764775:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1789498809.765274:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1789498809.765910:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1789498809.766299:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1789498809.767035:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1789498809.767669:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1789498809.768064:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1789498809.768699:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1789498809.768978:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1789498809.769299:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1789498809.769553:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1789498809.769801:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1789498809.770066:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1789498809.770781:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1789498809.771409:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1789498809.771870:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1789498809.772413:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1789498809.772758:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1789498809.773214:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1789498809.773551:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1789498809.774014:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1789498809.774787:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1789498809.775238:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1789498809.775477:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1789498809.775893:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1789498809.776268:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1789498809.776553:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1789498809.777082:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789498809.784603:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789498809.786151:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789498809.786444:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789498809.786680:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1789498809.799111:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1789498809.801173:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1789498809.804331:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1789498809.806511:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789498809.807604:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1789498809.809898:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789498809.810996:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1789498809.811787:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1789498809.813052:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1789498809.815490:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789498809.817087:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1789498809.817702:0:23390:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:1.0:1789498809.820153:0:23390:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789498809.820382:0:23390:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1789498809.820405:0:23390:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789498809.820422:0:23390:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x70d6b5fa1825e2f5 00000020:01000004:1.0:1789498809.820430:0:23390:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1789498809.820467:0:23390:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.117@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789498809.820473:0:23390:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.117@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789498809.820482:0:23390:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1789498809.820626:0:23390:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1789498809.820634:0:23390:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.117@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1789498809.834081:0:23390:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.117@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789498809.834128:0:23390:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.117@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1789498809.834133:0:23390:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789498809.834135:0:23390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789498809.834136:0:23390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789498809.834137:0:23390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789498809.834138:0:23390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789498809.834139:0:23390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789498809.834141:0:23390:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789498809.834142:0:23390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789498809.834144:0:23390:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789498809.834148:0:23390:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1789498809.834150:0:23390:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789498809.834152:0:23390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789498809.834153:0:23390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789498809.834154:0:23390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789498809.834155:0:23390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789498809.834156:0:23390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789498809.834156:0:23390:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789498809.834157:0:23390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789498809.834158:0:23390:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789498809.834188:0:23390:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789498809.834208:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916172288:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789498809.834295:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498809.834345:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffffa075866823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498809.834404:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916172288 00000100:00100000:0.0:1789498809.834413:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916172288 00000100:00100000:0.0:1789498809.834476:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789498809.834486:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+12:23390:x1876424916172288:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789498809.834514:0:22653:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789498809.834517:0:22653:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1789498809.834525:0:22653:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1789498809.835087:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+12:23390:x1876424916172288:12345-0@lo:253:mount.lustre.0 Request processed in 601us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498809.835096:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789498809.835206:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916172288:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789498809.835218:0:23390:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789498809.835228:0:23390:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789498809.835229:0:23390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789498809.835230:0:23390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789498809.835231:0:23390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789498809.835232:0:23390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789498809.835233:0:23390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789498809.835234:0:23390:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789498809.835236:0:23390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789498809.835237:0:23390:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789498809.835263:0:23390:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa076bc350800 from lustre-MDT0001 10000000:01000000:1.0:1789498809.835312:0:23390:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1789498809.835318:0:23390:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789498809.835329:0:23390:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa075876f8000 local copy 00010000:00010000:1.0:1789498809.835346:0:23390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9000/0x70d6b5fa1825e1eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e1f2 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498809.835506:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916172416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789498809.835610:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498809.835869:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07586682480 going to sleep for 11 seconds 00000100:00100000:3.0:1789498809.847156:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916172416 00000100:00100000:3.0:1789498809.847187:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916172416 00000100:00100000:3.0:1789498809.847337:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789498809.847359:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+12:23390:x1876424916172416:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498809.847989:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+12:23390:x1876424916172416:12345-0@lo:501:mount.lustre.0 Request processed in 637us (12376us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789498809.847999:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789498809.848860:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916172416:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789498809.848898:0:23390:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.117@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789498809.848973:0:23390:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.117@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789498809.848989:0:23390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9000/0x70d6b5fa1825e1eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e1f2 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498809.849007:0:23390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9000/0x70d6b5fa1825e1eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e1f2 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498809.849070:0:23390:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa076bc350800 10000000:01000000:1.0:1789498809.849080:0:23390:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789498809.849090:0:23390:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffffa075876f8000 10000000:01000000:1.0:1789498809.849125:0:23390:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789498809.849135:0:23390:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffffa075876f8000 from 1 10000000:01000000:1.0:1789498809.849142:0:23390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789498809.849203:0:23390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075857b0a00/0x70d6b5fa1825e2fc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498809.849218:0:23390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa075857b0a00/0x70d6b5fa1825e2fc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498809.849235:0:23390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa075857b0a00/0x70d6b5fa1825e2fc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498809.849269:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916172544:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789498809.849353:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498809.849389:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07586682480 going to sleep for 11 seconds 00000100:00100000:0.0:1789498809.849745:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916172544 00000100:00100000:0.0:1789498809.849753:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916172544 00000100:00100000:0.0:1789498809.849815:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789498809.849825:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+12:23390:x1876424916172544:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789498809.849837:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498809.849850:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa076bc6d8c00/0x70d6b5fa1825e303 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e2fc expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498809.849876:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa076bc6d8c00/0x70d6b5fa1825e303 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e2fc expref: 13 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498809.849902:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa076bc6d8c00/0x70d6b5fa1825e303 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e2fc expref: 13 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498809.849912:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa076bc6d8c00, rc 0) 00000100:00100000:0.0:1789498809.849956:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+13:23390:x1876424916172544:12345-0@lo:101:mount.lustre.0 Request processed in 134us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498809.849963:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789498809.850183:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916172544:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789498809.850198:0:23390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa075857b0a00/0x70d6b5fa1825e2fc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e303 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498809.850207:0:23390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa075857b0a00/0x70d6b5fa1825e2fc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e303 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498809.850224:0:23390:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789498809.850242:0:23390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075857b0a00/0x70d6b5fa1825e2fc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e303 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498809.850249:0:23390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa075857b0a00/0x70d6b5fa1825e2fc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e303 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498809.850259:0:23390:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffffa076bc350800 10000000:01000000:1.0:1789498809.850269:0:23390:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789498809.850273:0:23390:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffffa076bc350800 from 1 10000000:01000000:1.0:1789498809.850275:0:23390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789498809.850292:0:23390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075857b0000/0x70d6b5fa1825e30a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498809.850299:0:23390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa075857b0000/0x70d6b5fa1825e30a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498809.850305:0:23390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa075857b0000/0x70d6b5fa1825e30a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498809.850319:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916172672:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789498809.850345:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498809.850582:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07586682480 going to sleep for 11 seconds 00000100:00100000:2.0:1789498809.858996:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916172672 00000100:00100000:2.0:1789498809.859026:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916172672 00000100:00100000:2.0:1789498809.859097:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789498809.859109:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+13:23390:x1876424916172672:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789498809.859129:0:22651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498809.859150:0:22651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa076c1571800/0x70d6b5fa1825e311 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e30a expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498809.859184:0:22651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa076c1571800/0x70d6b5fa1825e311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e30a expref: 14 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498809.859198:0:22651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa076c1571800/0x70d6b5fa1825e311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e30a expref: 14 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498809.859231:0:22651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa076c1571800, rc 0) 00000100:00100000:2.0:1789498809.859317:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+14:23390:x1876424916172672:12345-0@lo:101:mount.lustre.0 Request processed in 210us (8969us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498809.859323:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789498809.859415:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916172672:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789498809.859797:0:23390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa075857b0000/0x70d6b5fa1825e30a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e311 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498809.859929:0:23390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa075857b0000/0x70d6b5fa1825e30a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e311 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498809.859959:0:23390:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789498809.859989:0:23390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075857b0000/0x70d6b5fa1825e30a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e311 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498809.860003:0:23390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa075857b0000/0x70d6b5fa1825e30a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e311 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498809.860014:0:23390:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789498809.860034:0:23390:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789498809.860044:0:23390:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffffa076bc350800 10000000:01000000:2.0:1789498809.860049:0:23390:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789498809.860055:0:23390:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789498809.860059:0:23390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789498809.860100:0:23390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1570e00/0x70d6b5fa1825e318 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498809.860130:0:23390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa076c1570e00/0x70d6b5fa1825e318 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498809.860143:0:23390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa076c1570e00/0x70d6b5fa1825e318 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498809.860174:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586726d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916172800:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789498809.860235:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498809.860284:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916172800 00000100:00100000:2.0:1789498809.860294:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916172800 00000100:00100000:2.0:1789498809.860345:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789498809.860357:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+14:23390:x1876424916172800:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789498809.860368:0:22651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498809.860382:0:22651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa076c1570400/0x70d6b5fa1825e31f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e318 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498809.860406:0:22651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa076c1570400/0x70d6b5fa1825e31f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e318 expref: 15 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498809.861441:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498809.862134:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a074c540 going to sleep for 11 seconds 00010000:00010000:2.0:1789498809.862212:0:22651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa076c1570400/0x70d6b5fa1825e31f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e318 expref: 15 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498809.862234:0:22651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa076c1570400, rc 0) 00000100:00100000:2.0:1789498809.862393:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+15:23390:x1876424916172800:12345-0@lo:101:mount.lustre.0 Request processed in 2032us (2151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498809.862409:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789498809.867961:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586726d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916172800:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789498809.868009:0:23390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa076c1570e00/0x70d6b5fa1825e318 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e31f expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498809.868036:0:23390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa076c1570e00/0x70d6b5fa1825e318 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e31f expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789498809.873132:0:23390:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:3.0:1789498809.874383:0:23390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789498809.889189:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1789498809.889272:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1789498809.889294:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1789498809.889311:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1789498809.890347:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1789498809.890369:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1789498809.890386:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1789498809.890404:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1789498809.890435:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1789498809.890456:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1789498809.890474:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1789498809.890489:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1789498809.890502:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1789498809.890518:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1789498809.890915:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1789498809.890942:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1789498809.890958:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1789498809.890972:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1789498809.890985:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1789498809.891005:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1789498809.891039:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1789498809.891061:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1789498809.891080:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1789498809.891100:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1789498809.891113:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1789498809.891126:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1789498809.891141:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1789498809.891156:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1789498809.891169:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1789498809.891185:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1789498809.891201:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1789498809.891217:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1789498809.891231:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1789498809.891257:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1789498809.891324:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1789498809.891364:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1789498809.891401:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1789498809.891890:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1789498809.891932:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1789498809.891969:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1789498809.892004:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1789498809.892056:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1789498809.892095:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1789498809.892129:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1789498809.892205:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1789498809.892217:0:23390:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1789498809.892391:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586726a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916172928:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789498809.898060:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498809.898157:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a074c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789498809.906075:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916172928 00000100:00100000:3.0:1789498809.906101:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916172928 00000100:00100000:3.0:1789498809.906243:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789498809.906265:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+15:23390:x1876424916172928:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498809.908404:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+15:23390:x1876424916172928:12345-0@lo:501:mount.lustre.0 Request processed in 2136us (10342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498809.908492:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789498809.909604:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586726a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916172928:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789498809.909685:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916173056:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789498809.909775:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498809.909848:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076befa2000 going to sleep for 11 seconds 00000100:00100000:2.0:1789498809.911140:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916173056 00000100:00100000:2.0:1789498809.911153:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916173056 00000100:00100000:2.0:1789498809.911232:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789498809.911243:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+15:23390:x1876424916173056:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789498809.916640:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+15:23390:x1876424916173056:12345-0@lo:503:mount.lustre.0 Request processed in 5378us (6846us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498809.916670:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789498809.917948:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916173056:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789498809.919127:0:23390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789498809.919243:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916173184:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789498809.919337:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498809.919390:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07586682840 going to sleep for 11 seconds 00000100:00100000:3.0:1789498809.924032:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916173184 00000100:00100000:3.0:1789498809.924052:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916173184 00000100:00100000:3.0:1789498809.924128:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789498809.924141:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+15:23390:x1876424916173184:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789498809.927349:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+15:23390:x1876424916173184:12345-0@lo:502:mount.lustre.0 Request processed in 3194us (7995us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498809.927378:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789498809.927861:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916173184:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789498809.928173:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1789498809.928212:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:1.0:1789498809.928231:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:1.0:1789498809.928250:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:1.0:1789498809.928266:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:1.0:1789498809.928281:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:1.0:1789498809.928296:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:1.0:1789498809.928324:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:1.0:1789498809.928340:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:1.0:1789498809.928355:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:1.0:1789498809.928370:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:1.0:1789498809.928387:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:1.0:1789498809.928407:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:1.0:1789498809.928442:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:1.0:1789498809.928462:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:1.0:1789498809.928479:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:1.0:1789498809.928493:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:1.0:1789498809.928507:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:1.0:1789498809.928522:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:1.0:1789498809.928578:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:1.0:1789498809.928599:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:1.0:1789498809.928616:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:1.0:1789498809.928634:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:1.0:1789498809.928652:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:1.0:1789498809.928670:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:1.0:1789498809.928688:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:1.0:1789498809.928704:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:1.0:1789498809.928719:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:1.0:1789498809.928735:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:1.0:1789498809.928750:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:1.0:1789498809.928764:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:1.0:1789498809.928776:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:1.0:1789498809.928791:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:1.0:1789498809.928804:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:1.0:1789498809.928820:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:1.0:1789498809.928838:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:1.0:1789498809.928853:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:1.0:1789498809.928869:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:1.0:1789498809.928885:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:1.0:1789498809.928900:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:1.0:1789498809.928928:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:1.0:1789498809.928943:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:1.0:1789498809.928959:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:1.0:1789498809.928975:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:1.0:1789498809.929031:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916173312:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789498809.929097:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498809.929135:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07586682840 going to sleep for 11 seconds 00000100:00100000:0.0:1789498809.929230:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916173312 00000100:00100000:0.0:1789498809.929238:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916173312 00000100:00100000:0.0:1789498809.929286:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789498809.929296:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+15:23390:x1876424916173312:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789498809.929425:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+15:23390:x1876424916173312:12345-0@lo:502:mount.lustre.0 Request processed in 131us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498809.929433:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789498809.937775:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916173312:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789498809.937910:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:1.0:1789498809.937926:0:23390:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1789498809.939848:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789498809.939868:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498809.939872:0:23395:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789498809.939882:0:23395:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1789498809.939888:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789498809.939912:0:23395:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffffa076a01f8000) 00000020:00000080:1.0:1789498809.939947:0:23395:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1789498809.939957:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789498809.940165:0:23395:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789498809.940174:0:23395:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x70d6b5fa1825e32d 00000020:00000080:1.0:1789498809.940400:0:23395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789498809.940405:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498809.940408:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498809.940410:0:23395:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789498809.940413:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789498809.940416:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498809.940431:0:23395:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1789498809.940436:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789498809.940450:0:23395:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffffa07585733380) 00000020:00000080:1.0:1789498809.940466:0:23395:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1789498809.940473:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789498809.940487:0:23395:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1789498809.940491:0:23395:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1789498809.940504:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789498809.940832:0:23395:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa076bc350800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1789498809.940846:0:23395:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffffa07585730000) 00000020:00000080:1.0:1789498809.940861:0:23395:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1789498809.940973:0:23395:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789498809.940983:0:23395:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x70d6b5fa1825e342 00000020:00000080:1.0:1789498809.941188:0:23395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1789498809.941201:0:23395:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789498809.941210:0:23395:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x70d6b5fa1825e349 00080000:01000000:1.0:1789498809.941220:0:23395:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789498809.941224:0:23395:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x70d6b5fa1825e350 00010000:00010000:3.0:1789498810.091242:0:23395:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1789498810.100572:0:23395:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:3.0:1789498810.104553:0:23395:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789498810.113037:0:23395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1789498810.113059:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498810.113069:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498810.113073:0:23395:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1789498810.113079:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498810.113303:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498810.113308:0:23395:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1789498810.113318:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789498810.113327:0:23395:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.117@tcp to nid 0x20000c0a8cc75 (192.168.204.117@tcp) 00000020:00000080:2.0:1789498810.113369:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789498810.113397:0:23395:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffffa076beff4d40) 00000020:00000080:2.0:1789498810.113483:0:23395:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1789498810.113492:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789498810.113603:0:23395:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1789498810.113611:0:23395:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789498810.113619:0:23395:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x70d6b5fa1825e35e 00010000:00080000:2.0:1789498810.113655:0:23395:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa076beb75000@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.117@tcp at head 00010000:00010000:2.0:1789498810.126955:0:23395:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1789498810.131062:0:23395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789498810.131079:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789498810.131227:0:23395:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789498810.131250:0:23395:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x70d6b5fa1825e365 00000100:00080000:2.0:1789498810.131261:0:23395:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789498810.131274:0:23395:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffffa076beb75000 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:2.0:1789498810.131312:0:23395:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa07586725180 x1876424916173440/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789498810.131340:0:23395:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1789498810.132451:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498810.132458:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498810.132460:0:23395:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1789498810.132464:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789498810.132466:0:23395:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1789498810.132468:0:23395:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789498810.132470:0:23395:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789498810.132472:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789498810.132474:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498810.132475:0:23395:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789498810.132478:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498810.132482:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498810.132483:0:23395:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1789498810.132487:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789498810.132555:0:23395:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789498810.132569:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498810.132572:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498810.132573:0:23395:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1789498810.132576:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789498810.132577:0:23395:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1789498810.132578:0:23395:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789498810.132579:0:23395:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789498810.132581:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789498810.132583:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498810.132584:0:23395:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789498810.132587:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789498810.132590:0:23395:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789498810.132593:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498810.132594:0:23395:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789498810.132596:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789498810.132600:0:23395:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.117@tcp to nid 0x20000c0a8cc75 (192.168.204.117@tcp) 00000020:01000000:2.0:1789498810.132620:0:23395:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789498810.132623:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789498810.132636:0:23395:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffffa076beff3380) 00000020:00000080:2.0:1789498810.132650:0:23395:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1789498810.132654:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789498810.132711:0:23395:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1789498810.132718:0:23395:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789498810.132724:0:23395:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x70d6b5fa1825e373 00010000:00080000:2.0:1789498810.132764:0:23395:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa07587559000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.117@tcp at head 00010000:00010000:2.0:1789498810.133031:0:23395:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:3.0:1789498810.133469:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876424916173440:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789498810.133548:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498810.133625:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916173440 00000100:00100000:3.0:1789498810.133633:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916173440 00000100:00100000:3.0:1789498810.133662:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789498810.133670:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1876424916173440:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789498810.133699:0:22664:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 644 last 0 00000020:00000080:3.0:1789498810.133733:0:22664:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x70d6b5fa1825e37a 00000004:00100000:3.0:1789498810.133750:0:22664:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789498810.133756:0:22664:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:01000000:2.0:1789498810.138404:0:23395:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789498810.138873:0:23395:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1789498810.140795:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789498810.140804:0:20398:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789498810.140807:0:20398:0:(import.c:65:import_set_state_nolock()) ffffa076bbf39000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789498810.140816:0:20398:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 643 00000100:00080000:0.0:1789498810.140822:0:20398:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789498810.140842:0:20398:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffffa076bbf39000 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:0.0:1789498810.140882:0:20398:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa075874f7b80 x1876424916173568/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789498810.140906:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789498810.140909:0:20398:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789498810.140911:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789498810.140914:0:20398:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789498810.140963:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916173568:0@lo:38:kworker.0 00000100:00100000:0.0:1789498810.141114:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498810.141204:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876424916173696:0@lo:400:kworker.0 00000100:00100000:0.0:1789498810.141231:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498810.141273:0:22663:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1789498810.141282:0:22663:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1789498810.141299:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916173696 00000100:00100000:0.0:1789498810.141307:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916173696 00000100:00100000:0.0:1789498810.141349:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789498810.141359:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876424916173696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498810.141419:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876424916173696:12345-0@lo:400:kworker.0 Request processed in 55us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498810.141427:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789498810.141470:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa075874f4380 x1876424916173696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498810.141485:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876424916173696:0@lo:400:kworker.0 00000100:00100000:0.0:1789498810.142116:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916173568 00000100:00100000:0.0:1789498810.142129:0:22663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916173568 00000100:00100000:0.0:1789498810.142247:0:23400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789498810.142253:0:23400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1876424916173568:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1789498810.142312:0:23400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1876424916173568:12345-0@lo:38:kworker.0 Request processed in 57us (1201us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789498810.142321:0:23400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789498810.142349:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789498810.142356:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076bbf39000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789498810.142360:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789498810.142364:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916173568:0@lo:38:kworker.0 00000040:00080000:2.0:1789498810.145373:0:23395:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789498810.147527:0:23395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1789498810.149948:0:23395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1789498810.153854:0:23401:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789498810.153864:0:23401:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789498810.154823:0:23395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789498810.154835:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789498810.154873:0:23395:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789498810.154897:0:23395:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x70d6b5fa1825e381 00000100:00080000:3.0:1789498810.154910:0:23395:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789498810.154921:0:23395:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffffa07587559000 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:3.0:1789498810.154959:0:23395:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa075883d8a80 x1876424916173824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789498810.154997:0:23395:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789498810.155063:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789498810.155066:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498810.155068:0:23395:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789498810.155071:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789498810.155074:0:23395:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1789498810.155075:0:23395:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789498810.155077:0:23395:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789498810.155078:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789498810.155081:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498810.155082:0:23395:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789498810.155084:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789498810.155162:0:23395:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789498810.155167:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498810.155168:0:23395:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789498810.155173:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789498810.155178:0:23395:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.117@tcp to nid 0x20000c0a8cc75 (192.168.204.117@tcp) 00000020:01000000:3.0:1789498810.155201:0:23395:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789498810.155203:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789498810.155215:0:23395:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffffa076bc793380) 00000020:00000080:3.0:1789498810.155229:0:23395:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1789498810.155233:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789498810.155303:0:23395:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1789498810.155310:0:23395:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789498810.155318:0:23395:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x70d6b5fa1825e38f 00010000:00080000:3.0:1789498810.155346:0:23395:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa07587142800@lustre-OST0001-osc-MDT0001: add connection 192.168.204.117@tcp at head 00010000:00010000:3.0:1789498810.155520:0:23395:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1789498810.155623:0:23395:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789498810.155637:0:23395:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1789498810.156201:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789498810.156207:0:20398:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789498810.156210:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789498810.156213:0:20398:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789498810.156511:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876424916173824:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789498810.156630:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876424916173824 offset 0 length 520: 4 00000100:00080000:3.0:1789498810.159474:0:22664:0:(import.c:65:import_set_state_nolock()) ffffa07587147000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789498810.160402:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1876424916173440:12345-0@lo:38:llog_process_th.0 Request processed in 26727us (26849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498810.160520:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789498810.160552:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1789498810.160561:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789498810.160566:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789498810.160569:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076beb75000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789498810.160583:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876424916173440:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789498810.160656:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789498810.160877:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789498810.160894:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876424916173952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789498810.160938:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498810.161712:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916173952 00000100:00100000:0.0:1789498810.161721:0:22663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916173952 00000100:00100000:0.0:1789498810.161772:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789498810.161781:0:22663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9de5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1876424916173952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789498810.161818:0:22663:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789498810.161874:0:22663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9de5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1876424916173952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498810.161881:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789498810.162472:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876424916173952:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1789498810.164237:0:23395:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789498810.164625:0:23395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1789498810.164756:0:23395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:0.0:1789498810.165923:0:23403:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1789498810.165928:0:23403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789498810.167755:0:23395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789498810.167772:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789498810.167812:0:23395:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789498810.167836:0:23395:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x70d6b5fa1825e396 00000100:00080000:2.0:1789498810.167894:0:23395:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789498810.167907:0:23395:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffffa07587142800 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:2.0:1789498810.167945:0:23395:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa07586724a80 x1876424916174080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789498810.168004:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876424916174080:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789498810.168065:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876424916174080 offset 0 length 520: 4 00000100:00080000:2.0:1789498810.168232:0:23395:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789498810.168300:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498810.168304:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498810.168306:0:23395:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789498810.168308:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498810.168313:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498810.168315:0:23395:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789498810.168318:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789498810.168320:0:23395:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789498810.168322:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498810.168324:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498810.168326:0:23395:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789498810.168328:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498810.168330:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498810.168336:0:23395:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789498810.168341:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789498810.168373:0:23395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498810.168376:0:23395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498810.168377:0:23395:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789498810.168381:0:23395:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:2.0:1789498810.168516:0:23390:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1789498810.168569:0:23390:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789498810.168586:0:23390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1570e00/0x70d6b5fa1825e318 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e31f expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.168598:0:23390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa076c1570e00/0x70d6b5fa1825e318 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e31f expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498810.168607:0:23390:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa076bc350800 from 1 10000000:01000000:2.0:1789498810.168613:0:23390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789498810.168653:0:23390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1571c00/0x70d6b5fa1825e39d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.168663:0:23390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa076c1571c00/0x70d6b5fa1825e39d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.168678:0:23390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa076c1571c00/0x70d6b5fa1825e39d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498810.168707:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586727b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916174208:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789498810.168774:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498810.168800:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07689f0f0c0 going to sleep for 11 seconds 00000100:00080000:0.0:1789498810.169040:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789498810.169047:0:20398:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789498810.169051:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789498810.169056:0:20398:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789498810.169429:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916174208 00000100:00100000:3.0:1789498810.169437:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916174208 00000100:00100000:3.0:1789498810.169488:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789498810.169498:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+15:23390:x1876424916174208:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789498810.169513:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498810.169526:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa075874a1800/0x70d6b5fa1825e3a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e39d expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498810.169583:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa075874a1800/0x70d6b5fa1825e3a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e39d expref: 16 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498810.169604:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa075874a1800/0x70d6b5fa1825e3a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e39d expref: 16 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498810.169612:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa075874a1800, rc 0) 00000100:00100000:3.0:1789498810.169658:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+16:23390:x1876424916174208:12345-0@lo:101:mount.lustre.0 Request processed in 161us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498810.169664:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789498810.169888:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586727b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916174208:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789498810.169903:0:23390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa076c1571c00/0x70d6b5fa1825e39d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e3a4 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.169922:0:23390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa076c1571c00/0x70d6b5fa1825e39d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e3a4 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498810.170719:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586727b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916174336:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789498810.170767:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498810.170812:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07689f0f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498810.170987:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916174336 00000100:00100000:3.0:1789498810.170994:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916174336 00000100:00100000:3.0:1789498810.171178:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789498810.171187:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+16:23390:x1876424916174336:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789498810.171206:0:22653:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789498810.171225:0:22653:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789498810.171228:0:22653:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1789498810.171467:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+16:23390:x1876424916174336:12345-0@lo:256:mount.lustre.0 Request processed in 280us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498810.171475:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789498810.178869:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586727b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916174336:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789498810.179766:0:23390:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789498810.179796:0:23390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1571c00/0x70d6b5fa1825e39d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e3a4 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498810.179810:0:23390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa076c1571c00/0x70d6b5fa1825e39d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e3a4 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498810.179821:0:23390:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa076bc350800 from 1 10000000:01000000:0.0:1789498810.179824:0:23390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789498810.179870:0:23390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8e00/0x70d6b5fa1825e3ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498810.179879:0:23390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8e00/0x70d6b5fa1825e3ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498810.179891:0:23390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8e00/0x70d6b5fa1825e3ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498810.179918:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916174464:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789498810.179991:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498810.180047:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076befa2900 going to sleep for 11 seconds 00000100:00100000:3.0:1789498810.180466:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916174464 00000100:00100000:3.0:1789498810.180475:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916174464 00000100:00100000:3.0:1789498810.180567:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789498810.180577:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+16:23390:x1876424916174464:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789498810.180594:0:22651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498810.180608:0:22651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa075874a0e00/0x70d6b5fa1825e3b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e3ab expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498810.180635:0:22651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa075874a0e00/0x70d6b5fa1825e3b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e3ab expref: 17 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498810.180664:0:22651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa075874a0e00/0x70d6b5fa1825e3b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e3ab expref: 17 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498810.180673:0:22651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa075874a0e00, rc 0) 00000100:00100000:3.0:1789498810.180719:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+17:23390:x1876424916174464:12345-0@lo:101:mount.lustre.0 Request processed in 143us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498810.180726:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789498810.181233:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916174464:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789498810.181248:0:23390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8e00/0x70d6b5fa1825e3ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e3b2 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498810.181258:0:23390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8e00/0x70d6b5fa1825e3ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e3b2 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789498810.183577:0:23390:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:0.0:1789498810.184162:0:23390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789498810.184361:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1789498810.184723:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:0.0:1789498810.184743:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:0.0:1789498810.184762:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:0.0:1789498810.184778:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:0.0:1789498810.184795:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:0.0:1789498810.184810:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:0.0:1789498810.184824:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:0.0:1789498810.184840:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1789498810.185954:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:0.0:1789498810.186007:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:0.0:1789498810.186049:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:0.0:1789498810.186055:0:23390:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:0.0:1789498810.186158:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916174592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789498810.186230:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498810.186277:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076befa2000 going to sleep for 11 seconds 00000100:00100000:3.0:1789498810.186431:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916174592 00000100:00100000:3.0:1789498810.186440:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916174592 00000100:00100000:3.0:1789498810.186503:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789498810.186519:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+17:23390:x1876424916174592:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789498810.189331:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+17:23390:x1876424916174592:12345-0@lo:501:mount.lustre.0 Request processed in 2810us (3093us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498810.189346:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789498810.189974:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916174592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789498810.190050:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916174720:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789498810.190111:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498810.190155:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076befa2000 going to sleep for 11 seconds 00000100:00100000:2.0:1789498810.190507:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916174720 00000100:00100000:2.0:1789498810.190515:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916174720 00000100:00100000:2.0:1789498810.190585:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789498810.190595:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+17:23390:x1876424916174720:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789498810.190862:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+17:23390:x1876424916174720:12345-0@lo:503:mount.lustre.0 Request processed in 268us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498810.190869:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789498810.191334:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916174720:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789498810.192260:0:23390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789498810.192393:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916174848:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789498810.197476:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498810.197598:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07689f7d840 going to sleep for 11 seconds 00000100:00100000:2.0:1789498810.197688:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916174848 00000100:00100000:2.0:1789498810.197699:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916174848 00000100:00100000:2.0:1789498810.197762:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789498810.197772:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+17:23390:x1876424916174848:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789498810.197923:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+17:23390:x1876424916174848:12345-0@lo:502:mount.lustre.0 Request processed in 152us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498810.197935:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789498810.198136:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916174848:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789498810.198600:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1789498810.198646:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:1.0:1789498810.198682:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:1.0:1789498810.198705:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:1.0:1789498810.198733:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:1.0:1789498810.198765:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:1.0:1789498810.198795:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:1.0:1789498810.198820:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:1.0:1789498810.198835:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1789498810.198859:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:1.0:1789498810.198891:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:1.0:1789498810.198951:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916174976:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789498810.199033:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498810.199064:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076bc526e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789498810.199226:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916174976 00000100:00100000:2.0:1789498810.199236:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916174976 00000100:00100000:2.0:1789498810.199303:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789498810.199314:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+17:23390:x1876424916174976:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789498810.199445:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+17:23390:x1876424916174976:12345-0@lo:502:mount.lustre.0 Request processed in 131us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498810.199457:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789498810.199796:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916174976:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789498810.199854:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:1.0:1789498810.199864:0:23390:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789498810.201822:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789498810.201833:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498810.201836:0:23405:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789498810.201842:0:23405:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa076bc350800 00000020:00000080:3.0:1789498810.201845:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789498810.201852:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789498810.201854:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498810.201855:0:23405:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789498810.201857:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789498810.201859:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498810.201860:0:23405:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789498810.201863:0:23405:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa076bc350800 00000020:00000080:3.0:1789498810.201865:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789498810.201954:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789498810.201957:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498810.201958:0:23405:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789498810.201960:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789498810.201962:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498810.201969:0:23405:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789498810.201973:0:23405:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa076bc350800 00000020:00000080:3.0:1789498810.201975:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789498810.205260:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789498810.205275:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498810.205277:0:23405:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789498810.205281:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789498810.205284:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498810.205285:0:23405:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789498810.205290:0:23405:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa076bc350800 00000020:00000080:3.0:1789498810.205292:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789498810.205358:0:23405:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789498810.205362:0:23405:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498810.205363:0:23405:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789498810.205366:0:23405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:0.0:1789498810.215291:0:23390:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789498810.215372:0:23390:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789498810.215441:0:23390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8e00/0x70d6b5fa1825e3ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e3b2 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498810.215459:0:23390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8e00/0x70d6b5fa1825e3ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e3b2 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498810.215597:0:23390:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789498810.215619:0:23390:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa076bc350800 10000000:01000000:0.0:1789498810.215626:0:23390:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa076bc350800 10000000:01000000:0.0:1789498810.215634:0:23390:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789498810.215648:0:23390:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa076bc350800 from 1 10000000:01000000:0.0:1789498810.215655:0:23390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789498810.215723:0:23390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8a00/0x70d6b5fa1825e3b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498810.215739:0:23390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8a00/0x70d6b5fa1825e3b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498810.215758:0:23390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8a00/0x70d6b5fa1825e3b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498810.215803:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916175104:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789498810.215892:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498810.215956:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076befa2000 going to sleep for 11 seconds 00000100:00100000:2.0:1789498810.217197:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916175104 00000100:00100000:2.0:1789498810.217216:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916175104 00000100:00100000:2.0:1789498810.217318:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789498810.217336:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586704c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+17:23390:x1876424916175104:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789498810.217369:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498810.217391:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa076c1571a00/0x70d6b5fa1825e3c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e3b9 expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.217505:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa076c1571a00/0x70d6b5fa1825e3c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e3b9 expref: 18 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.217520:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa076c1571a00/0x70d6b5fa1825e3c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e3b9 expref: 18 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.217837:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa076c1571a00, rc 0) 00000100:00100000:2.0:1789498810.217970:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586704c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+18:23390:x1876424916175104:12345-0@lo:101:mount.lustre.0 Request processed in 640us (2076us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498810.217984:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789498810.218334:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916175104:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789498810.218357:0:23390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8a00/0x70d6b5fa1825e3b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e3c0 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498810.218367:0:23390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8a00/0x70d6b5fa1825e3b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e3c0 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789498810.232313:0:23390:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1789498810.233635:0:23390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789498810.233902:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1789498810.233946:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1789498810.233988:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1789498810.234036:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1789498810.234113:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1789498810.234158:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1789498810.234202:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1789498810.234252:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1789498810.234302:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1789498810.234345:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1789498810.234367:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1789498810.234385:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1789498810.234402:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1789498810.234431:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1789498810.234449:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1789498810.234464:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1789498810.234492:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1789498810.234508:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1789498810.234524:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1789498810.234573:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1789498810.234620:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1789498810.234641:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1789498810.234657:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1789498810.234672:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1789498810.234685:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1789498810.234700:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1789498810.234714:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1789498810.234731:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1789498810.234748:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1789498810.234766:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1789498810.234781:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1789498810.234796:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1789498810.234812:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1789498810.234829:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1789498810.234844:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1789498810.234858:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1789498810.234885:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1789498810.234904:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1789498810.234927:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1789498810.234968:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1789498810.235006:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1789498810.235069:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1789498810.235096:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1789498810.235113:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1789498810.235128:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1789498810.235144:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1789498810.235168:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1789498810.235185:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1789498810.235409:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1789498810.235442:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1789498810.235491:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1789498810.235502:0:23390:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1789498810.235685:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916175232:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498810.235767:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498810.235827:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a07619c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789498810.237517:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916175232 00000100:00100000:2.0:1789498810.237545:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916175232 00000100:00100000:2.0:1789498810.237619:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789498810.237630:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+18:23390:x1876424916175232:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789498810.237827:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+18:23390:x1876424916175232:12345-0@lo:501:mount.lustre.0 Request processed in 199us (2059us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498810.237844:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789498810.237921:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916175232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789498810.237999:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586725500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916175360:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789498810.238063:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498810.238089:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916175360 00000100:00100000:2.0:1789498810.238094:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916175360 00000100:00100000:2.0:1789498810.238116:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789498810.238122:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586705c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+18:23390:x1876424916175360:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789498810.238239:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586705c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+18:23390:x1876424916175360:12345-0@lo:503:mount.lustre.0 Request processed in 113us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498810.238250:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789498810.238324:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07587582840 going to sleep for 11 seconds 00000100:00100000:2.0:1789498810.238350:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586725500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916175360:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789498810.238830:0:23390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789498810.238901:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586725500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916175488:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789498810.238973:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498810.239029:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916175488 00000100:00100000:2.0:1789498810.239034:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916175488 00000100:00100000:2.0:1789498810.239060:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789498810.239067:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586707c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+18:23390:x1876424916175488:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789498810.239155:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586707c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+18:23390:x1876424916175488:12345-0@lo:502:mount.lustre.0 Request processed in 88us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498810.239167:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789498810.239231:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07587582840 going to sleep for 11 seconds 00000100:00100000:2.0:1789498810.239269:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586725500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916175488:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789498810.239575:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1789498810.239623:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1789498810.239642:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1789498810.239657:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1789498810.239674:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1789498810.239691:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1789498810.239708:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1789498810.239738:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1789498810.239761:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1789498810.239776:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1789498810.239791:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1789498810.239806:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1789498810.239823:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1789498810.239839:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1789498810.239856:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1789498810.239872:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1789498810.239887:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1789498810.239907:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1789498810.239940:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1789498810.239972:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1789498810.240003:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1789498810.240052:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1789498810.240069:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1789498810.240091:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1789498810.240107:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1789498810.240123:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1789498810.240138:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1789498810.240157:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1789498810.240186:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1789498810.240222:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1789498810.245585:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1789498810.245734:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1789498810.245755:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1789498810.245773:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1789498810.245789:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1789498810.245805:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1789498810.245822:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1789498810.245860:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1789498810.245881:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1789498810.245897:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1789498810.245913:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1789498810.245932:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1789498810.245948:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1789498810.245962:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:2.0:1789498810.245976:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1789498810.245991:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1789498810.246019:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1789498810.246038:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1789498810.246107:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586725500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916175616:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789498810.246206:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498810.246277:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916175616 00000100:00100000:2.0:1789498810.246288:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916175616 00000100:00100000:2.0:1789498810.246350:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789498810.246361:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586705450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+18:23390:x1876424916175616:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789498810.248582:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07587582840 going to sleep for 11 seconds 00000100:00100000:2.0:1789498810.248829:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586705450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+18:23390:x1876424916175616:12345-0@lo:502:mount.lustre.0 Request processed in 2465us (2620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498810.248842:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789498810.248922:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586725500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916175616:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789498810.249170:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1789498810.249199:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1789498810.249245:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586725500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916175744:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789498810.249285:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498810.249313:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916175744 00000100:00100000:2.0:1789498810.249320:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916175744 00000100:00100000:2.0:1789498810.249357:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789498810.249365:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586707850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+18:23390:x1876424916175744:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789498810.250645:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586707850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+18:23390:x1876424916175744:12345-0@lo:502:mount.lustre.0 Request processed in 1272us (1351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498810.250655:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789498810.250718:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07587582840 going to sleep for 11 seconds 00000100:00100000:2.0:1789498810.250737:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586725500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916175744:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789498810.250802:0:23390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:2.0:1789498810.250813:0:23390:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789498810.252702:0:23410:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1789498810.252721:0:23410:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffffa076beff19c0) 00000020:00000080:2.0:1789498810.252742:0:23410:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1789498810.252823:0:23410:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa076bc350800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789498810.252827:0:23410:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa076bc350800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789498810.252830:0:23410:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa076bc350800 3 00010000:00080000:2.0:1789498810.252863:0:23410:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa07585718800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.117@tcp at head 00010000:00010000:2.0:1789498810.260156:0:23410:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1789498810.260381:0:23410:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1789498810.264665:0:23410:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789498810.264689:0:23410:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x70d6b5fa1825e3ce 00000100:00080000:2.0:1789498810.264703:0:23410:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789498810.264718:0:23410:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffffa07585718800 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:2.0:1789498810.264761:0:23410:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa07586725500 x1876424916175872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789498810.264802:0:23410:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789498810.264831:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789498810.264836:0:20398:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789498810.264838:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789498810.264841:0:20398:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789498810.267859:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876424916175872:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789498810.267959:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498810.268138:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916175872 00000100:00100000:2.0:1789498810.268147:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916175872 00000100:00100000:2.0:1789498810.268202:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789498810.268211:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1876424916175872:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789498810.268242:0:22660:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 644 last 0 00000020:00000080:2.0:1789498810.268312:0:22660:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x70d6b5fa1825e3d5 00000004:00100000:2.0:1789498810.268333:0:22660:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789498810.268367:0:22660:0:(import.c:65:import_set_state_nolock()) ffffa076beb77800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789498810.268443:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876424916175872:12345-0@lo:38:llog_process_th.0 Request processed in 232us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498810.268451:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789498810.268498:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa07586725500 x1876424916175872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789498820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498810.268511:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789498810.268521:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1789498810.268529:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789498810.268557:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789498810.268559:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa07585718800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789498810.268565:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876424916175872:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1789498810.268711:0:23410:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:2.0:1789498810.268766:0:23390:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789498810.268805:0:23390:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789498810.268823:0:23390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8a00/0x70d6b5fa1825e3b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e3c0 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.268835:0:23390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8a00/0x70d6b5fa1825e3b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e3c0 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789498810.268888:0:23390:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789498810.268890:0:23390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789498810.268891:0:23390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789498810.268892:0:23390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789498810.268893:0:23390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789498810.268895:0:23390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789498810.268896:0:23390:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789498810.268898:0:23390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789498810.268900:0:23390:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789498810.268903:0:23390:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1789498810.268905:0:23390:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789498810.268907:0:23390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789498810.268908:0:23390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789498810.268909:0:23390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789498810.268910:0:23390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789498810.268911:0:23390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789498810.268912:0:23390:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789498810.268913:0:23390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789498810.268914:0:23390:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789498810.268935:0:23390:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789498810.268948:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586725500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916176000:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789498810.268985:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498810.269004:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffffa075864156c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789498810.269039:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916176000 00000100:00100000:2.0:1789498810.269043:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916176000 00000100:00100000:2.0:1789498810.269080:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789498810.269088:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586704050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+18:23390:x1876424916176000:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789498810.269111:0:22650:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789498810.269123:0:22650:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1789498810.288685:0:22638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1789498810.288796:0:22650:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789498810.288814:0:22650:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1789498810.289067:0:22674:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789498810.289073:0:22674:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789498810.289095:0:22674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa076c1570800/0x70d6b5fa1825e3dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.289116:0:22674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa075874a1000/0x70d6b5fa1825e2e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e2d9 expref: 18 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.289125:0:22674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa075874a1800/0x70d6b5fa1825e3a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e39d expref: 18 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.289132:0:22674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa076c1570800/0x70d6b5fa1825e3dc lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.289177:0:22674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa075874a1800/0x70d6b5fa1825e3a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70d6b5fa1825e39d expref: 18 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.289195:0:22674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa075874a1800/0x70d6b5fa1825e3a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70d6b5fa1825e39d expref: 18 pid: 22650 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498810.289211:0:22674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586727100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22674:1876424916176128:0@lo:104: 00000100:00100000:2.0:1789498810.289282:0:22674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789498810.289334:0:22674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa075874a1000/0x70d6b5fa1825e2e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70d6b5fa1825e2d9 expref: 18 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.289343:0:22674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa075874a1000/0x70d6b5fa1825e2e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70d6b5fa1825e2d9 expref: 18 pid: 22650 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498810.289369:0:22674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586727b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22674:1876424916176256:0@lo:104: 00000100:00100000:2.0:1789498810.289393:0:22674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498810.289475:0:22674:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07586415300 going to sleep for 11 seconds 00000100:00100000:2.0:1789498810.289503:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916176128 00000100:00100000:2.0:1789498810.289511:0:22641:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916176128 00000100:00100000:2.0:1789498810.289574:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916176256 00000100:00100000:2.0:1789498810.289578:0:22641:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916176256 00000100:00100000:2.0:1789498810.289591:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789498810.289600:0:22641:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586724700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39f24317-e976-4eca-a2df-96def568323f+4:22674:x1876424916176128:12345-0@lo:104: 00010000:00010000:2.0:1789498810.289614:0:22641:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.117@tcp lock: ffffa076c1571c00/0x70d6b5fa1825e39d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x70d6b5fa1825e3a4 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.289669:0:22641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789498810.289675:0:22641:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586724700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39f24317-e976-4eca-a2df-96def568323f+4:22674:x1876424916176128:12345-0@lo:104: Request processed in 76us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498810.289682:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789498810.289697:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789498810.289703:0:22641:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586725180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39f24317-e976-4eca-a2df-96def568323f+3:22674:x1876424916176256:12345-0@lo:104: 00010000:00010000:2.0:1789498810.289710:0:22641:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.117@tcp lock: ffffa075857b1600/0x70d6b5fa1825e2d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x70d6b5fa1825e2e0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.289742:0:22641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789498810.289747:0:22641:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586725180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39f24317-e976-4eca-a2df-96def568323f+3:22674:x1876424916176256:12345-0@lo:104: Request processed in 45us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498810.289753:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789498810.289772:0:22646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789498810.289777:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.117@tcp lock: ffffa076c1571c00/0x70d6b5fa1825e39d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x70d6b5fa1825e3a4 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.289791:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c1571c00 already unused, calling callback (ffffffffc13e6c20) 10000000:00010000:2.0:1789498810.289795:0:22646:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.117@tcp lock: ffffa076c1571c00/0x70d6b5fa1825e39d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x70d6b5fa1825e3a4 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.289804:0:22646:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa076c1571c00/0x70d6b5fa1825e39d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x70d6b5fa1825e3a4 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789498810.289811:0:22646:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa076c1571c00/0x70d6b5fa1825e39d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x70d6b5fa1825e3a4 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498810.289816:0:22646:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789498810.289843:0:22646:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.117@tcp lock: ffffa076c1571c00/0x70d6b5fa1825e39d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e3a4 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.289850:0:22646:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789498810.289870:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.117@tcp lock: ffffa076c1571c00/0x70d6b5fa1825e39d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e3a4 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.289876:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa076c1571c00/0x70d6b5fa1825e39d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e3a4 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.289891:0:22646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498810.289894:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.117@tcp lock: ffffa075857b1600/0x70d6b5fa1825e2d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70d6b5fa1825e2e0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.289900:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075857b1600 already unused, calling callback (ffffffffc13e6c20) 10000000:00010000:2.0:1789498810.289902:0:22646:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.117@tcp lock: ffffa075857b1600/0x70d6b5fa1825e2d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x70d6b5fa1825e2e0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.289920:0:22646:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa075857b1600/0x70d6b5fa1825e2d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x70d6b5fa1825e2e0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789498810.289926:0:22646:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa075857b1600/0x70d6b5fa1825e2d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x70d6b5fa1825e2e0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498810.289932:0:22646:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789498810.289944:0:22646:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.117@tcp lock: ffffa075857b1600/0x70d6b5fa1825e2d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e2e0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.289951:0:22646:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789498810.289969:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.117@tcp lock: ffffa075857b1600/0x70d6b5fa1825e2d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e2e0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.289976:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa075857b1600/0x70d6b5fa1825e2d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e2e0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.289988:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498810.289990:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498810.289991:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498810.289997:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498810.290029:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39f24317-e976-4eca-a2df-96def568323f:3644:1876424916176384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789498810.290058:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498810.290091:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39f24317-e976-4eca-a2df-96def568323f:3641:1876424916176512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789498810.290113:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498810.290142:0:22643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916176384 00000100:00100000:2.0:1789498810.290145:0:22643:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916176384 00010000:00010000:2.0:1789498810.290162:0:22643:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa075874a1800/0x70d6b5fa1825e3a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70d6b5fa1825e39d expref: 19 pid: 22650 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498810.290189:0:22643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916176512 00000100:00100000:2.0:1789498810.290192:0:22643:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916176512 00010000:00010000:2.0:1789498810.290204:0:22643:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa075874a1000/0x70d6b5fa1825e2e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70d6b5fa1825e2d9 expref: 20 pid: 22650 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498810.290215:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789498810.290221:0:22643:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586727480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39f24317-e976-4eca-a2df-96def568323f+20:3644:x1876424916176384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789498810.290231:0:22643:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498810.290236:0:22643:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa075874a1800/0x70d6b5fa1825e3a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70d6b5fa1825e39d expref: 20 pid: 22650 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.290245:0:22643:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa075874a1800/0x70d6b5fa1825e3a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70d6b5fa1825e39d expref: 20 pid: 22650 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.290259:0:22643:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498810.290286:0:22643:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586727480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39f24317-e976-4eca-a2df-96def568323f+20:3644:x1876424916176384:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498810.290292:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789498810.290304:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789498810.290310:0:22643:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586726680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39f24317-e976-4eca-a2df-96def568323f+19:3641:x1876424916176512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789498810.290316:0:22643:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498810.290320:0:22643:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa075874a1000/0x70d6b5fa1825e2e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70d6b5fa1825e2d9 expref: 19 pid: 22650 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.290329:0:22643:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa075874a1000/0x70d6b5fa1825e2e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70d6b5fa1825e2d9 expref: 19 pid: 22650 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.290339:0:22643:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa076c1570800/0x70d6b5fa1825e3dc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.290352:0:22643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa076c1570800/0x70d6b5fa1825e3dc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789498810.290365:0:22643:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002510936s 00010000:00010000:2.0:1789498810.290370:0:22643:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa076c1570800/0x70d6b5fa1825e3dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.290376:0:22643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa076c1570800/0x70d6b5fa1825e3dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.290381:0:22643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa076c1570800/0x70d6b5fa1825e3dc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.290387:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa076c1570800/0x70d6b5fa1825e3dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.290393:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c1570800 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498810.290396:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa076c1570800/0x70d6b5fa1825e3dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.290404:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa076c1570800/0x70d6b5fa1825e3dc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498810.290597:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586704050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+19:23390:x1876424916176000:12345-0@lo:253:mount.lustre.0 Request processed in 21509us (21610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498810.290605:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00010000:2.0:1789498810.292513:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa076c1570800/0x70d6b5fa1825e3dc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498810.292724:0:22643:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498810.292923:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39f24317-e976-4eca-a2df-96def568323f:3644:1876424916176384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789498810.292966:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586725500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:23390:1876424916176000:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789498810.292992:0:23390:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789498810.292995:0:23390:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789498810.292997:0:23390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789498810.292998:0:23390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789498810.293000:0:23390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789498810.293001:0:23390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789498810.293002:0:23390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789498810.293003:0:23390:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789498810.293005:0:23390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789498810.293020:0:23390:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789498810.293033:0:23390:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789498810.293758:0:22643:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586726680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39f24317-e976-4eca-a2df-96def568323f+18:3641:x1876424916176512:12345-0@lo:103:ldlm_bl.0 Request processed in 3446us (3642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498810.293768:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789498810.293807:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39f24317-e976-4eca-a2df-96def568323f:3641:1876424916176512:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789498810.293897:0:22674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa075874a1800/0x70d6b5fa1825e3a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70d6b5fa1825e39d expref: 17 pid: 22650 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498810.293910:0:22674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586727100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22674:1876424916176128:0@lo:104: 00010000:00010000:0.0:1789498810.293921:0:22674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa075874a1000/0x70d6b5fa1825e2e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70d6b5fa1825e2d9 expref: 16 pid: 22650 timeout: 744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498810.293943:0:22674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586727b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22674:1876424916176256:0@lo:104: 00010000:00010000:0.0:1789498810.293957:0:22674:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa076c1570800/0x70d6b5fa1825e3dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498810.293966:0:22674:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa076c1570800/0x70d6b5fa1825e3dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498810.293972:0:22674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa076c1570800/0x70d6b5fa1825e3dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498810.293979:0:22674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa076c1570800/0x70d6b5fa1825e3dc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:2.0:1789498810.298983:0:23390:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1789498810.299573:0:23417:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789498810.299956:0:23390:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:2.0:1789498810.300140:0:23417:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1789498810.301717:0:23390:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1789498810.301759:0:23390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789498810.302195:0:23390:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789498810.302202:0:23390:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1789498810.302242:0:23390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789498810.305380:0:23390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789498810.306439:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789498810.306500:0:23417:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000020:00080000:0.0:1789498810.309510:0:23416:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1789498810.309523:0:23416:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:3.0:1789498810.310198:0:23390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789498810.310244:0:23390:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1789498810.310363:0:23390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789498810.310779:0:23418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f5180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23418:1876424916176640:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789498810.310852:0:23418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498810.310895:0:23418:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076befa2000 going to sleep for 11 seconds 00000100:00100000:1.0:1789498810.310959:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916176640 00000100:00100000:1.0:1789498810.310966:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916176640 00000100:00100000:1.0:1789498810.311027:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789498810.311036:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23418:x1876424916176640:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789498810.311121:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23418:x1876424916176640:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 87us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498810.311129:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789498810.311167:0:23418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23418:1876424916176640:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1789498810.311204:0:23418:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789498810.311230:0:23418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de6300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23418:1876424916176768:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789498810.311259:0:23418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498810.311280:0:23400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916176768 00000100:00100000:1.0:1789498810.311283:0:23400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916176768 00000100:00100000:1.0:1789498810.311303:0:23400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789498810.311309:0:23400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9de4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23418:x1876424916176768:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789498810.311399:0:23400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9de4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23418:x1876424916176768:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 90us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498810.311405:0:23400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789498810.311600:0:23418:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076befa2900 going to sleep for 11 seconds 00000100:00100000:1.0:1789498810.311617:0:23418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de6300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23418:1876424916176768:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789498810.311721:0:23418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de6300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23418:1876424916176896:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789498810.311748:0:23418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498810.311867:0:23418:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076ab3e2180 going to sleep for 11 seconds 00080000:10000000:3.0:1789498810.313207:0:23390:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:3.0:1789498810.318979:0:23390:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:0.0:1789498810.322600:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916176896 00000100:00100000:0.0:1789498810.322620:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916176896 00000100:00100000:0.0:1789498810.322683:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789498810.322696:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9de5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23418:x1876424916176896:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789498810.322816:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9de5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23418:x1876424916176896:12345-0@lo:900:lod0001_rec0000.0 Request processed in 123us (11066us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498810.322823:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789498810.322932:0:23418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa076a9de6300 x1876424916176896/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789498826 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498810.322950:0:23418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de6300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23418:1876424916176896:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789498810.323040:0:23418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586726d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23418:1876424916177024:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789498810.323078:0:23418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498810.323109:0:23418:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076afca7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789498810.323169:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916177024 00000100:00100000:0.0:1789498810.323174:0:22663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916177024 00000100:00100000:0.0:1789498810.323225:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789498810.323231:0:22663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23418:x1876424916177024:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789498810.323295:0:22663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23418:x1876424916177024:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 65us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498810.323302:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789498810.323369:0:23418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586726d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23418:1876424916177024:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1789498810.323435:0:23418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789498810.325509:0:23418:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789498810.325601:0:23418:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789498810.325606:0:23418:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:2.0:1789498810.337511:0:23390:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789498810.337709:0:23390:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb68781c6f988 00100000:10000000:2.0:1789498810.337718:0:23390:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1789498810.349045:0:23390:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789498810.349084:0:23390:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.117@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789498810.349102:0:23390:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789498810.349131:0:23390:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1789498810.350092:0:23390:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789498810.350317:0:23390:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789498810.429787:0:22700:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07683042540 going to sleep for 0 seconds 00010000:00010000:2.0:1789498810.875838:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789498811.261647:0:22692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789498811.325748:0:23413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789498811.459498:0:22700:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07683042540 going to sleep for 0 seconds 10000000:01000000:0.0:1789498811.519995:0:22655:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789498811.520003:0:22655:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa076bc350800 from 12 10000000:01000000:0.0:1789498811.520010:0:22655:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789498811.520073:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9200/0x70d6b5fa1825e3e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498811.520085:0:22655:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9200/0x70d6b5fa1825e3e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498811.520097:0:22655:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9200/0x70d6b5fa1825e3e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498811.520123:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916177152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789498811.520206:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498811.520242:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa075866823c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789498811.520349:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916177152 00000100:00100000:2.0:1789498811.520356:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916177152 00000100:00100000:2.0:1789498811.520414:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789498811.520425:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586707050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+16:22655:x1876424916177152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789498811.520440:0:22651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498811.520455:0:22651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa076c1571c00/0x70d6b5fa1825e3ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e3e3 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498811.520479:0:22651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa076c1571c00/0x70d6b5fa1825e3ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e3e3 expref: 17 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498811.520490:0:22651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa076c1571c00/0x70d6b5fa1825e3ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e3e3 expref: 17 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498811.520499:0:22651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa076c1571c00, rc 0) 00000100:00100000:2.0:1789498811.520576:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586707050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+17:22655:x1876424916177152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498811.520600:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789498811.520707:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916177152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789498811.520720:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9200/0x70d6b5fa1825e3e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e3ea expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498811.520729:0:22655:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9200/0x70d6b5fa1825e3e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e3ea expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498811.520792:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916177280:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789498811.520831:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498811.520850:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa075866823c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789498811.520901:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916177280 00000100:00100000:2.0:1789498811.520906:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916177280 00000100:00100000:2.0:1789498811.520938:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789498811.520945:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586704850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+17:22655:x1876424916177280:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789498811.520959:0:22650:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789498811.520977:0:22650:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789498811.520980:0:22650:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1789498811.521075:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586704850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+17:22655:x1876424916177280:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498811.521082:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789498811.521111:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916177280:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789498811.521164:0:22655:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789498811.521170:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9200/0x70d6b5fa1825e3e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e3ea expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498811.521192:0:22655:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9200/0x70d6b5fa1825e3e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e3ea expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498811.521202:0:22655:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789498811.521205:0:22655:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0758605a000 from 12 10000000:01000000:2.0:1789498811.521208:0:22655:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789498811.521227:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1570800/0x70d6b5fa1825e3f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498811.521234:0:22655:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa076c1570800/0x70d6b5fa1825e3f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498811.521252:0:22655:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa076c1570800/0x70d6b5fa1825e3f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498811.521267:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586726d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916177408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789498811.521292:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498811.521306:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07690602cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789498811.521317:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916177408 00000100:00100000:2.0:1789498811.521320:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916177408 00000100:00100000:2.0:1789498811.521336:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789498811.521342:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586706050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+17:22655:x1876424916177408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789498811.521349:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498811.521358:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa076c1570200/0x70d6b5fa1825e3f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e3f1 expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498811.521372:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa076c1570200/0x70d6b5fa1825e3f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e3f1 expref: 18 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498811.521380:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa076c1570200/0x70d6b5fa1825e3f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e3f1 expref: 18 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498811.521387:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa076c1570200, rc 0) 00000100:00100000:2.0:1789498811.521416:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586706050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+18:22655:x1876424916177408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498811.521422:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789498811.521452:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586726d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916177408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789498811.521462:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa076c1570800/0x70d6b5fa1825e3f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e3f8 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498811.521477:0:22655:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa076c1570800/0x70d6b5fa1825e3f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e3f8 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498811.521513:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586726d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916177536:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789498811.521571:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498811.521584:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07690602cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789498811.521594:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916177536 00000100:00100000:2.0:1789498811.521597:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916177536 00000100:00100000:2.0:1789498811.521613:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789498811.521618:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586706850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+18:22655:x1876424916177536:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789498811.521628:0:22650:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789498811.521639:0:22650:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789498811.521643:0:22650:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1789498811.521701:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586706850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+18:22655:x1876424916177536:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 82us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498811.521708:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789498811.521734:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586726d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916177536:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789498811.521765:0:22655:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789498811.521770:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1570800/0x70d6b5fa1825e3f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e3f8 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498811.521778:0:22655:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa076c1570800/0x70d6b5fa1825e3f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e3f8 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498811.899819:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498812.354222:0:23413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789498812.476679:0:22700:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07683042540 going to sleep for 0 seconds 00010000:00010000:2.0:1789498812.929737:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498813.502122:0:22700:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07683042540 going to sleep for 0 seconds 00010000:00010000:2.0:1789498813.951011:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498814.396620:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789498799/real 1789498799] req@ffffa07586724e00 x1876424916171136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498814 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498814.396657:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa07586724e00 x1876424916171136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498814 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498814.396669:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789498799/real 1789498799] req@ffffa07586724380 x1876424916171264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498814 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498814.396710:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa07586724380 x1876424916171264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498814 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789498814.396733:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076b06fb000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789498814.396759:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789498814.396764:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916171136:0@lo:8:kworker.0 00000100:00080000:3.0:1789498814.396770:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076beb13800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789498814.396775:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789498814.396778:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916171264:0@lo:8:kworker.0 00000100:00080000:1.0:1789498814.397003:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789498814.397014:0:20398:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789498814.397017:0:20398:0:(import.c:65:import_set_state_nolock()) ffffa076bbf39000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789498814.397031:0:20398:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffffa076bbf39000 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:1.0:1789498814.397057:0:20398:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa076a9de4a80 x1876424916177792/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789498814.397086:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789498814.397089:0:20398:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789498814.397090:0:20398:0:(import.c:65:import_set_state_nolock()) ffffa076b06fb000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789498814.397095:0:20398:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 633 00000100:00080000:1.0:1789498814.397101:0:20398:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789498814.397106:0:20398:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa076b06fb000 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:1.0:1789498814.397118:0:20398:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa076a9de7480 x1876424916177920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789498814.397127:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789498814.397130:0:20398:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789498814.397131:0:20398:0:(import.c:65:import_set_state_nolock()) ffffa076beb13800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789498814.397134:0:20398:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 633 00000100:00080000:1.0:1789498814.397136:0:20398:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789498814.397140:0:20398:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa076beb13800 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:1.0:1789498814.397149:0:20398:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa076a9de4000 x1876424916178048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789498814.397189:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789498814.397193:0:20398:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789498814.397195:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789498814.397204:0:20398:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789498814.397235:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876424916178176:0@lo:400:kworker.0 00000100:00100000:1.0:1789498814.397236:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876424916178432:0@lo:400:kworker.0 00000100:00100000:3.0:1789498814.397333:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39f24317-e976-4eca-a2df-96def568323f:3642:1876424916177664:0@lo:400:kworker.0 00000100:00100000:1.0:1789498814.406156:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498814.406276:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876424916178304:0@lo:400:kworker.0 00000100:00100000:1.0:1789498814.406335:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498814.411564:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916178304 00000100:00100000:1.0:1789498814.411581:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916178304 00000100:00100000:1.0:1789498814.411667:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789498814.411677:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9de4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876424916178304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498814.411781:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9de4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876424916178304:12345-0@lo:400:kworker.0 Request processed in 105us (5444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498814.411787:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789498814.411844:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876424916178304:0@lo:400:kworker.0 00000100:00100000:1.0:1789498814.411878:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916177792:0@lo:38:kworker.0 00000100:00100000:1.0:1789498814.411911:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498814.411950:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916177920:0@lo:8:kworker.0 00000400:00000100:1.0:1789498814.411974:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876424916177920 offset 0 length 520: 4 00000100:00100000:1.0:1789498814.411997:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916178048:0@lo:8:kworker.0 00000400:00000100:1.0:1789498814.412015:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876424916178048 offset 0 length 520: 4 00000100:00100000:1.0:1789498814.412041:0:23400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916177792 00000100:00100000:1.0:1789498814.412045:0:23400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916177792 00000100:00100000:1.0:1789498814.412064:0:23400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789498814.412069:0:23400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9de7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1876424916177792:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789498814.412094:0:23400:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 648 last 0 00000020:00000080:1.0:1789498814.412135:0:23400:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x70d6b5fa1825e3ff 00000004:00100000:1.0:1789498814.412152:0:23400:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789498814.412158:0:23400:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:0.0:1789498814.415122:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498814.415220:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916178432 00000100:00100000:0.0:1789498814.415231:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916178432 00000100:00100000:0.0:1789498814.415672:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916178176 00000100:00100000:0.0:1789498814.415676:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916178176 00000100:00100000:0.0:1789498814.415698:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789498814.415708:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9de7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876424916178432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498814.415789:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9de7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876424916178432:12345-0@lo:400:kworker.0 Request processed in 83us (9645us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498814.415796:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789498814.415812:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789498814.415819:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876424916178176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498814.415848:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876424916178176:12345-0@lo:400:kworker.0 Request processed in 29us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498814.415854:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789498814.415904:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa076a9de6a00 x1876424916178432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498814.415918:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876424916178432:0@lo:400:kworker.0 00010000:00080000:0.0:1789498814.415964:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa076a9de6d80 x1876424916178176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498814.415973:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876424916178176:0@lo:400:kworker.0 00000100:00100000:3.0:1789498814.420685:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498814.420751:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916177664 00000100:00100000:3.0:1789498814.420761:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916177664 00000100:00100000:3.0:1789498814.420824:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789498814.420836:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+18:3642:x1876424916177664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498814.420908:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+18:3642:x1876424916177664:12345-0@lo:400:kworker.0 Request processed in 75us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498814.420917:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789498814.421022:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39f24317-e976-4eca-a2df-96def568323f:3642:1876424916177664:0@lo:400:kworker.0 00000100:00080000:3.0:1789498814.426650:0:23400:0:(import.c:65:import_set_state_nolock()) ffffa075880b8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789498814.426804:0:23400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9de7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1876424916177792:12345-0@lo:38:kworker.0 Request processed in 14730us (14889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498814.426820:0:23400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1789498814.426987:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1789498814.426998:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789498814.427004:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789498814.427007:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076bbf39000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1789498814.427032:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000009bc3bb02): req@ffffa075874f5f80 x1876424916170112/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498814.427049:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916177792:0@lo:38:kworker.0 00000100:00100000:3.0:1789498814.427465:0:22700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498814.427501:0:22700:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07683042540 going to sleep for 11 seconds 00000100:00100000:3.0:1789498814.427515:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498814.427551:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916178560:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789498814.427580:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498814.427689:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916170112 00000100:00100000:3.0:1789498814.427700:0:22663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916170112 00000100:00100000:3.0:1789498814.427741:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916178560 00000100:00100000:3.0:1789498814.427745:0:22663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916178560 00000100:00100000:3.0:1789498814.427762:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789498814.427770:0:22663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22700:x1876424916170112:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789498814.427851:0:22663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22700:x1876424916170112:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 81us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498814.427859:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789498814.427874:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789498814.427880:0:22663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1876424916178560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789498814.427909:0:22663:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789498814.428154:0:22663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1876424916178560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 274us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498814.428162:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789498814.428193:0:22700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22700:1876424916170112:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1789498814.428260:0:22700:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789498814.428307:0:22700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883d9880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22700:1876424916178688:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789498814.428339:0:22700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498814.428363:0:22700:0:(client.c:2716:ptlrpc_set_wait()) set ffffa075877e1780 going to sleep for 11 seconds 00000100:00100000:3.0:1789498814.428379:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916178688 00000100:00100000:3.0:1789498814.428383:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916178688 00000100:00100000:3.0:1789498814.428400:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789498814.428416:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22700:x1876424916178688:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789498814.428448:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916178560:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789498814.428559:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22700:x1876424916178688:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 144us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498814.428567:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789498814.428766:0:22700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883d9880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22700:1876424916178688:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789498814.428851:0:22700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de4a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22700:1876424916178816:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789498814.428889:0:22700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498814.428915:0:22700:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076ab3e23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498814.429441:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916178816 00000100:00100000:3.0:1789498814.429447:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916178816 00000100:00100000:3.0:1789498814.429487:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789498814.429495:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9de5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22700:x1876424916178816:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789498814.429702:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9de5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22700:x1876424916178816:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 208us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498814.429710:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789498814.429968:0:22700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de4a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22700:1876424916178816:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1789498814.430020:0:22700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789498814.443350:0:22700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789498814.444705:0:22700:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 25, retries 0 00000004:00080000:1.0:1789498814.444715:0:22700:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1789498814.975841:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498815.419800:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916178944:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789498815.419865:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498815.419961:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916178944 00000100:00100000:0.0:1789498815.419976:0:22663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916178944 00000100:00100000:0.0:1789498815.420025:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789498815.420033:0:22663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9de4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916178944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789498815.420067:0:22663:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789498815.420127:0:22663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9de4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916178944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498815.420133:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789498815.420326:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916178944:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1789498815.888376:0:23661:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg417-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789498815.999763:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789498816.999378:0:23714:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789498816.999889:0:23714:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789498817.025821:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498818.047793:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789498818.223846:0:23764:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789498818.224165:0:23764:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789498819.084585:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789498819.370005:0:23812:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdcf34ecd0 20000000:00000080:2.0:1789498819.370027:0:23812:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa076c0eee800 uarg=0000000000000000 20000000:01000000:2.0:1789498819.370073:0:23812:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789498819.370081:0:23812:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789498819.370087:0:23812:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789498819.373745:0:23813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1789498819.373944:0:23812:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789498819.389121:0:23812:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789498819.393734:0:23812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa076bc6d9e00/0x70d6b5fa1825e406 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498819.393767:0:23812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa075857b0200/0x70d6b5fa1825e2af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e2a8 expref: 17 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498819.393775:0:23812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa075874a0e00/0x70d6b5fa1825e3b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e3ab expref: 17 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498819.393784:0:23812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa076bc6d9e00/0x70d6b5fa1825e406 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498819.393845:0:23812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa075874a0e00/0x70d6b5fa1825e3b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70d6b5fa1825e3ab expref: 17 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498819.393864:0:23812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa075874a0e00/0x70d6b5fa1825e3b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70d6b5fa1825e3ab expref: 17 pid: 22651 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498819.393880:0:23812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23812:1876424916179072:0@lo:104: 00000100:00100000:0.0:1789498819.394602:0:23812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789498819.394691:0:23812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa075857b0200/0x70d6b5fa1825e2af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70d6b5fa1825e2a8 expref: 17 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498819.394705:0:23812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa075857b0200/0x70d6b5fa1825e2af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70d6b5fa1825e2a8 expref: 17 pid: 22653 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498819.394715:0:23812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23812:1876424916179200:0@lo:104: 00000100:00100000:0.0:1789498819.394738:0:23812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498819.394772:0:23812:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07683077000 going to sleep for 11 seconds 00000100:00100000:2.0:1789498819.394884:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916179072 00000100:00100000:1.0:1789498819.394887:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916179200 00000100:00100000:2.0:1789498819.394894:0:22642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916179072 00000100:00100000:1.0:1789498819.394894:0:22641:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916179200 00000100:00100000:2.0:1789498819.394967:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789498819.394980:0:22642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39f24317-e976-4eca-a2df-96def568323f+4:23812:x1876424916179072:12345-0@lo:104: 00010000:00010000:2.0:1789498819.394995:0:22642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8e00/0x70d6b5fa1825e3ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x70d6b5fa1825e3b2 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498819.395074:0:22642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789498819.395086:0:22642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39f24317-e976-4eca-a2df-96def568323f+4:23812:x1876424916179072:12345-0@lo:104: Request processed in 110us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498819.395095:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789498819.395145:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498819.395156:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8e00/0x70d6b5fa1825e3ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x70d6b5fa1825e3b2 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498819.395164:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076bc6d8e00 already unused, calling callback (ffffffffc13e6c20) 10000000:00010000:3.0:1789498819.395169:0:22647:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8e00/0x70d6b5fa1825e3ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x70d6b5fa1825e3b2 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498819.395179:0:22647:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8e00/0x70d6b5fa1825e3ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x70d6b5fa1825e3b2 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789498819.395187:0:22647:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8e00/0x70d6b5fa1825e3ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x70d6b5fa1825e3b2 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498819.395193:0:22647:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789498819.395229:0:22647:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8e00/0x70d6b5fa1825e3ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e3b2 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498819.395246:0:22647:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789498819.395273:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8e00/0x70d6b5fa1825e3ab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e3b2 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498819.395281:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8e00/0x70d6b5fa1825e3ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e3b2 expref: -99 pid: 23390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498819.395296:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498819.395297:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498819.395299:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498819.395410:0:23812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23812:1876424916179072:0@lo:104: 00000100:00100000:1.0:1789498819.398004:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789498819.398027:0:22641:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39f24317-e976-4eca-a2df-96def568323f+4:23812:x1876424916179200:12345-0@lo:104: 00010000:00010000:1.0:1789498819.398047:0:22641:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.117@tcp lock: ffffa075874a1400/0x70d6b5fa1825e2a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70d6b5fa1825e2af expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498819.398162:0:22641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789498819.398175:0:22641:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39f24317-e976-4eca-a2df-96def568323f+4:23812:x1876424916179200:12345-0@lo:104: Request processed in 161us (3435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498819.398182:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789498819.398219:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39f24317-e976-4eca-a2df-96def568323f:3644:1876424916179328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789498819.398259:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789498819.398354:0:22646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498819.398362:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.117@tcp lock: ffffa075874a1400/0x70d6b5fa1825e2a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70d6b5fa1825e2af expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498819.398369:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a1400 already unused, calling callback (ffffffffc13e6c20) 10000000:00010000:3.0:1789498819.398373:0:22646:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.117@tcp lock: ffffa075874a1400/0x70d6b5fa1825e2a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x70d6b5fa1825e2af expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498819.398382:0:22646:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa075874a1400/0x70d6b5fa1825e2a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x70d6b5fa1825e2af expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789498819.398389:0:22646:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa075874a1400/0x70d6b5fa1825e2a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x70d6b5fa1825e2af expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498819.398394:0:22646:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789498819.398427:0:22646:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.117@tcp lock: ffffa075874a1400/0x70d6b5fa1825e2a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e2af expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498819.398432:0:22646:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789498819.398470:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.117@tcp lock: ffffa075874a1400/0x70d6b5fa1825e2a8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e2af expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498819.398476:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa075874a1400/0x70d6b5fa1825e2a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e2af expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498819.398493:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498819.398495:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498819.398497:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498819.398983:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39f24317-e976-4eca-a2df-96def568323f:3641:1876424916179456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789498819.399018:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498819.399151:0:23812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23812:1876424916179200:0@lo:104: 00010000:00010000:0.0:1789498819.399183:0:23812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa076bc6d9e00/0x70d6b5fa1825e406 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498819.403013:0:22643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916179328 00000100:00100000:3.0:1789498819.403034:0:22643:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916179328 00010000:00010000:3.0:1789498819.403094:0:22643:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa075874a0e00/0x70d6b5fa1825e3b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70d6b5fa1825e3ab expref: 18 pid: 22651 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498819.403138:0:22643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916179456 00000100:00100000:3.0:1789498819.403142:0:22643:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916179456 00010000:00010000:3.0:1789498819.403154:0:22643:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa075857b0200/0x70d6b5fa1825e2af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70d6b5fa1825e2a8 expref: 19 pid: 22653 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498819.403174:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789498819.403183:0:22643:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9de7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39f24317-e976-4eca-a2df-96def568323f+19:3644:x1876424916179328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789498819.403197:0:22643:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498819.403203:0:22643:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa075874a0e00/0x70d6b5fa1825e3b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70d6b5fa1825e3ab expref: 19 pid: 22651 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498819.403203:0:22644:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789498819.403212:0:22644:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1789498819.403215:0:22643:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa075874a0e00/0x70d6b5fa1825e3b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70d6b5fa1825e3ab expref: 19 pid: 22651 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498819.403233:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa075874a0e00/0x70d6b5fa1825e3b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70d6b5fa1825e3ab expref: 19 pid: 22651 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498819.403272:0:22643:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498819.403367:0:22643:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9de7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39f24317-e976-4eca-a2df-96def568323f+18:3644:x1876424916179328:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (5108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498819.403374:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789498819.403391:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789498819.403397:0:22643:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9de5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39f24317-e976-4eca-a2df-96def568323f+17:3641:x1876424916179456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789498819.403404:0:22643:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498819.403409:0:22643:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa075857b0200/0x70d6b5fa1825e2af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70d6b5fa1825e2a8 expref: 17 pid: 22653 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498819.403417:0:22643:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa075857b0200/0x70d6b5fa1825e2af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70d6b5fa1825e2a8 expref: 17 pid: 22653 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498819.403427:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa075857b0200/0x70d6b5fa1825e2af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70d6b5fa1825e2a8 expref: 17 pid: 22653 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498819.403440:0:22643:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa076bc6d9e00/0x70d6b5fa1825e406 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498819.403448:0:22643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa076bc6d9e00/0x70d6b5fa1825e406 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498819.403464:0:22643:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa076bc6d9e00/0x70d6b5fa1825e406 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498819.403471:0:22643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa076bc6d9e00/0x70d6b5fa1825e406 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498819.403477:0:22643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa076bc6d9e00/0x70d6b5fa1825e406 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498819.403491:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa076bc6d9e00/0x70d6b5fa1825e406 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498819.403498:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076bc6d9e00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:3.0:1789498819.403502:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa076bc6d9e00/0x70d6b5fa1825e406 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498819.403511:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa076bc6d9e00/0x70d6b5fa1825e406 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498819.403549:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa076bc6d9e00/0x70d6b5fa1825e406 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498819.403562:0:22643:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789498819.403569:0:23812:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa076bc6d9e00/0x70d6b5fa1825e406 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498819.403578:0:23812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa076bc6d9e00/0x70d6b5fa1825e406 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498819.403584:0:23812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa076bc6d9e00/0x70d6b5fa1825e406 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498819.403593:0:22643:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9de5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:39f24317-e976-4eca-a2df-96def568323f+16:3641:x1876424916179456:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (4575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498819.403599:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789498819.403637:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39f24317-e976-4eca-a2df-96def568323f:3644:1876424916179328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789498819.403668:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39f24317-e976-4eca-a2df-96def568323f:3641:1876424916179456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789498819.516936:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876424916179584:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1789498819.517065:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789498819.517070:0:20398:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789498819.517073:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789498819.517084:0:20398:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789498819.517104:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789498819.517107:0:20398:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789498819.517109:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789498819.517112:0:20398:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789498819.517134:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916179712:0@lo:400:kworker.0 00000100:00100000:0.0:1789498819.517200:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498819.517385:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789498819.517393:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876424916179840:0@lo:400:kworker.0 00000100:00100000:0.0:1789498819.517425:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498819.517473:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916179712 00000100:00100000:0.0:1789498819.517482:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916179712 00000100:00100000:0.0:1789498819.517594:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789498819.517605:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1876424916179712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498819.517676:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1876424916179712:12345-0@lo:400:kworker.0 Request processed in 72us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498819.517683:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789498819.517735:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916179712:0@lo:400:kworker.0 00000100:00100000:1.0:1789498819.518800:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498819.518863:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876424916180096:0@lo:400:kworker.0 00000100:00100000:1.0:1789498819.518891:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498819.518916:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789498819.518922:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876424916179968:0@lo:400:kworker.0 00000100:00100000:1.0:1789498819.518945:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498819.518996:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916179840 00000100:00100000:1.0:1789498819.519002:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916179840 00000100:00100000:1.0:1789498819.519048:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916180096 00000100:00100000:1.0:1789498819.519051:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916180096 00000100:00100000:1.0:1789498819.519084:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789498819.519092:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876424916179840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498819.519150:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876424916179840:12345-0@lo:400:kworker.0 Request processed in 58us (1723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498819.519158:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789498819.519177:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789498819.519185:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9de6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876424916180096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498819.519219:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9de6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876424916180096:12345-0@lo:400:kworker.0 Request processed in 35us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498819.519225:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789498819.519265:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa075874f4380 x1876424916180096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498819.519279:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876424916180096:0@lo:400:kworker.0 00000100:00100000:0.0:1789498819.520905:0:23400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916179584 00000100:00100000:0.0:1789498819.520918:0:23400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916179584 00000100:00100000:0.0:1789498819.520979:0:23400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916179968 00000100:00100000:0.0:1789498819.520983:0:23400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916179968 00000100:00100000:0.0:1789498819.521001:0:23400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789498819.521009:0:23400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9de5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1876424916179584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789498819.521050:0:23400:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789498819.521140:0:23400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9de5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1876424916179584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (2345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498819.521148:0:23400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789498819.521167:0:23400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789498819.521173:0:23400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9de6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876424916179968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498819.521207:0:23400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9de6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876424916179968:12345-0@lo:400:kworker.0 Request processed in 34us (2261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498819.521213:0:23400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1789498819.521267:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa075874f5880 x1876424916179840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498819.521282:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876424916179840:0@lo:400:kworker.0 00000100:00100000:0.0:1789498819.521317:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876424916179968:0@lo:400:kworker.0 00000100:00100000:0.0:1789498819.521336:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876424916179584:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789498820.091761:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498820.539735:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789498820.539761:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876424916180224:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789498820.539871:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498820.540027:0:23400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916180224 00000100:00100000:2.0:1789498820.540035:0:23400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916180224 00000100:00100000:2.0:1789498820.540092:0:23400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789498820.540102:0:23400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876424916180224:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789498820.540115:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789498810/real 1789498810] req@ffffa07586724a80 x1876424916174080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498820 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000004:00000024:2.0:1789498820.540154:0:23400:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789498820.540202:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa07586724a80 x1876424916174080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498820 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498820.540213:0:23400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876424916180224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498820.540213:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789498810/real 1789498810] req@ffffa075883d8a80 x1876424916173824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498820 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498820.540226:0:23400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789498820.540230:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa075883d8a80 x1876424916173824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498820 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789498820.540243:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa07587142800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789498820.540256:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789498820.540260:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876424916174080:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789498820.540272:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa07587559000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789498820.540283:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789498820.540287:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876424916173824:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789498820.540309:0:15719:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789498820.540315:0:15719:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789498820.540318:0:15719:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789498820.540321:0:15719:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789498820.540331:0:15719:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789498820.540334:0:15719:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789498820.540336:0:15719:0:(import.c:65:import_set_state_nolock()) ffffa07587559000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789498820.540342:0:15719:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 644 00000100:00080000:2.0:1789498820.540346:0:15719:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:1.0:1789498820.540354:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916180480:0@lo:400:kworker.0 00000100:00080000:2.0:1789498820.540355:0:15719:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffffa07587559000 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:2.0:1789498820.540376:0:15719:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa07586724000 x1876424916180736/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789498820.540387:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789498820.540390:0:15719:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789498820.540393:0:15719:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789498820.540395:0:15719:0:(import.c:65:import_set_state_nolock()) ffffa07587142800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1789498820.540407:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789498820.540412:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876424916180608:0@lo:400:kworker.0 00000100:00100000:1.0:1789498820.540450:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498820.540480:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916180480 00000100:00100000:1.0:1789498820.540484:0:22663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916180480 00000100:00100000:1.0:1789498820.540510:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789498820.540516:0:22663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9de6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1876424916180480:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789498820.540527:0:15719:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 644 00000100:00080000:2.0:1789498820.540555:0:15719:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789498820.540561:0:15719:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffffa07587142800 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:1.0:1789498820.540575:0:22663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9de6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1876424916180480:12345-0@lo:400:kworker.0 Request processed in 59us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498820.540576:0:15719:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa07586725880 x1876424916180864/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789498820.540598:0:15719:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789498820.540601:0:15719:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789498820.540614:0:15719:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789498820.540617:0:15719:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789498820.540642:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876424916180992:0@lo:400:kworker.0 00000100:00100000:2.0:1789498820.540675:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498820.540699:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789498820.540706:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39f24317-e976-4eca-a2df-96def568323f:3643:1876424916180352:0@lo:400:kworker.0 00000100:00100000:2.0:1789498820.540737:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498820.540761:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916180352 00000100:00100000:3.0:1789498820.540766:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916180352 00000100:00100000:2.0:1789498820.540833:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789498820.541472:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586707450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+16:3643:x1876424916180352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498820.541525:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586707450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+16:3643:x1876424916180352:12345-0@lo:400:kworker.0 Request processed in 685us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498820.543670:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876424916180224:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789498820.543991:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916180608 00000100:00100000:0.0:1789498820.544004:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916180608 00000100:00100000:0.0:1789498820.544063:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916180992 00000100:00100000:0.0:1789498820.544066:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916180992 00000100:00100000:0.0:1789498820.544080:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789498820.544087:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9de6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876424916180608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498820.544298:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9de6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876424916180608:12345-0@lo:400:kworker.0 Request processed in 209us (3845us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498820.544307:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789498820.544325:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789498820.544330:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876424916180992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498820.544360:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876424916180992:12345-0@lo:400:kworker.0 Request processed in 30us (3685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498820.544383:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789498820.544499:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876424916180736:0@lo:8:kworker.0 00000400:00000100:0.0:1789498820.544566:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876424916180736 offset 0 length 520: 4 00000100:00100000:0.0:1789498820.544605:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876424916180864:0@lo:8:kworker.0 00000400:00000100:0.0:1789498820.544626:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876424916180864 offset 0 length 520: 4 00000100:00100000:2.0:1789498820.545517:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789498820.545614:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39f24317-e976-4eca-a2df-96def568323f:3643:1876424916180352:0@lo:400:kworker.0 00010000:00080000:2.0:1789498820.545636:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa07586724a80 x1876424916180992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498820.545651:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876424916180992:0@lo:400:kworker.0 00000001:00100000:0.0:1789498820.546060:0:23391:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1789498820.546676:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa07586726300 x1876424916180608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498820.546692:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876424916180608:0@lo:400:kworker.0 00000100:00100000:0.0:1789498820.546708:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916180480:0@lo:400:kworker.0 00000100:00100000:1.0:1789498820.550545:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 10000000:01000000:3.0:1789498820.732411:0:22655:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789498820.732431:0:22655:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa076bc350800 from 13 10000000:01000000:3.0:1789498820.732436:0:22655:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789498820.732487:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075874a0e00/0x70d6b5fa1825e40d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498820.732499:0:22655:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa075874a0e00/0x70d6b5fa1825e40d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498820.732511:0:22655:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa075874a0e00/0x70d6b5fa1825e40d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498820.732552:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916181120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789498820.732621:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498820.732674:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa075877e1780 going to sleep for 11 seconds 00000100:00100000:1.0:1789498820.734582:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916181120 00000100:00100000:1.0:1789498820.734600:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916181120 00000100:00100000:1.0:1789498820.734685:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789498820.734698:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586706450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+16:22655:x1876424916181120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789498820.734721:0:22651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498820.734741:0:22651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa075857b1400/0x70d6b5fa1825e414 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e40d expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498820.734776:0:22651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa075857b1400/0x70d6b5fa1825e414 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e40d expref: 17 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498820.734789:0:22651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa075857b1400/0x70d6b5fa1825e414 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e40d expref: 17 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498820.735945:0:22651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa075857b1400, rc 0) 00000100:00100000:1.0:1789498820.736052:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586706450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+17:22655:x1876424916181120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1354us (3428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498820.736061:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789498820.738246:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916181120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789498820.738274:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa075874a0e00/0x70d6b5fa1825e40d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e414 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498820.738287:0:22655:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa075874a0e00/0x70d6b5fa1825e40d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e414 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498820.738391:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916181248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498820.738441:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498820.738486:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa075877e1780 going to sleep for 11 seconds 00000100:00100000:2.0:1789498820.738497:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916181248 00000100:00100000:2.0:1789498820.738507:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916181248 00000100:00100000:2.0:1789498820.738611:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789498820.738622:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586705850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+17:22655:x1876424916181248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789498820.739819:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586705850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+17:22655:x1876424916181248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1178us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498820.739832:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789498820.742748:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916181248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498820.743438:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916181376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789498820.743519:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498820.743735:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa075877e1780 going to sleep for 11 seconds 00000100:00100000:2.0:1789498820.744909:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916181376 00000100:00100000:2.0:1789498820.744922:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916181376 00000100:00100000:0.0:1789498820.745080:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789498820.745090:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076b7161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+17:22655:x1876424916181376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789498820.745241:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076b7161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+17:22655:x1876424916181376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (1722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498820.745248:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789498820.745372:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916181376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789498820.757280:0:23854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789498820.757573:0:22655:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789498820.757600:0:22655:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789498820.757613:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075874a0e00/0x70d6b5fa1825e40d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e414 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498820.757627:0:22655:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa075874a0e00/0x70d6b5fa1825e40d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e414 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498820.757640:0:22655:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789498820.757656:0:22655:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0758605a000 from 13 10000000:01000000:0.0:1789498820.757659:0:22655:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789498820.757704:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8200/0x70d6b5fa1825e41b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498820.757712:0:22655:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8200/0x70d6b5fa1825e41b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498820.757725:0:22655:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8200/0x70d6b5fa1825e41b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498820.757759:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916181504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789498820.757861:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498820.757933:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07683077900 going to sleep for 11 seconds 00000100:00100000:2.0:1789498820.758147:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916181504 00000100:00100000:2.0:1789498820.758159:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916181504 00000100:00100000:2.0:1789498820.758210:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789498820.758220:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076b7161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+17:22655:x1876424916181504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789498820.758236:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498820.758254:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa076c1570c00/0x70d6b5fa1825e422 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e41b expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498820.758288:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa076c1570c00/0x70d6b5fa1825e422 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e41b expref: 18 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498820.758299:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa076c1570c00/0x70d6b5fa1825e422 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e41b expref: 18 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498820.758309:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa076c1570c00, rc 0) 00000100:00100000:2.0:1789498820.760050:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076b7161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+18:22655:x1876424916181504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1825us (2183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498820.760062:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789498820.769845:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916181504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789498820.769901:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8200/0x70d6b5fa1825e41b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e422 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498820.769917:0:22655:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8200/0x70d6b5fa1825e41b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e422 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498820.770043:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916181632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498820.770124:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498820.770168:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa075877e1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789498820.772607:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916181632 00000100:00100000:1.0:1789498820.772622:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916181632 00000100:00100000:1.0:1789498820.772710:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789498820.772721:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+18:22655:x1876424916181632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789498820.774003:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+18:22655:x1876424916181632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1276us (3871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498820.774015:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789498820.774218:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916181632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498820.774272:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916181760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789498820.774329:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498820.774377:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa075877e1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789498820.774394:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916181760 00000100:00100000:3.0:1789498820.774400:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916181760 00000100:00100000:3.0:1789498820.774433:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789498820.774442:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+18:22655:x1876424916181760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789498820.774607:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+18:22655:x1876424916181760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498820.774615:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789498820.783627:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916181760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789498820.784564:0:23858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789498820.784651:0:22655:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789498820.784677:0:22655:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789498820.784694:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8200/0x70d6b5fa1825e41b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e422 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498820.784729:0:22655:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8200/0x70d6b5fa1825e41b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e422 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498821.116357:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498821.500293:0:22692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789498822.139704:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789498822.589834:0:23413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789498823.174848:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498824.187871:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498824.637589:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789498824.637611:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916181888:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789498824.637695:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498824.637766:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916181888 00000100:00100000:1.0:1789498824.637774:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916181888 00000100:00100000:1.0:1789498824.637826:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789498824.637836:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876424916181888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789498824.638222:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789498824.638280:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876424916181888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 444us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498824.638287:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789498824.638453:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916181888:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789498825.216753:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789498825.660490:0:15719:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789498825.660497:0:15719:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789498825.660507:0:15719:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789498825.660511:0:15719:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789498825.660583:0:15719:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789498825.660586:0:15719:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789498825.660588:0:15719:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789498825.660591:0:15719:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789498825.660627:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39f24317-e976-4eca-a2df-96def568323f:3641:1876424916182016:0@lo:400:kworker.0 00000100:00100000:3.0:1789498825.660705:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498825.660757:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876424916182528:0@lo:400:kworker.0 00000100:00100000:3.0:1789498825.660785:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498825.660813:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498825.660819:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916182144:0@lo:400:kworker.0 00000100:00100000:3.0:1789498825.660858:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498825.660886:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876424916182272:0@lo:400:kworker.0 00000100:00100000:3.0:1789498825.660910:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498825.660925:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789498825.660930:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075883d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916182400:0@lo:400:kworker.0 00000100:00100000:3.0:1789498825.660949:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498825.660978:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916182016 00000100:00100000:3.0:1789498825.660986:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916182016 00000100:00100000:3.0:1789498825.661029:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789498825.661037:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+18:3641:x1876424916182016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498825.661088:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+18:3641:x1876424916182016:12345-0@lo:400:kworker.0 Request processed in 52us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498825.661103:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789498825.661153:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916182528 00000100:00100000:3.0:1789498825.661157:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916182528 00000100:00100000:3.0:1789498825.661181:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916182272 00000100:00100000:3.0:1789498825.661184:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916182272 00000100:00100000:3.0:1789498825.661196:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789498825.661202:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07587661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876424916182528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498825.661233:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07587661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876424916182528:12345-0@lo:400:kworker.0 Request processed in 30us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498825.661240:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789498825.661250:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789498825.661255:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07587662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876424916182272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498825.661283:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07587662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876424916182272:12345-0@lo:400:kworker.0 Request processed in 28us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498825.661289:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789498825.661308:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916182144 00000100:00100000:3.0:1789498825.661311:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916182144 00000100:00100000:3.0:1789498825.661331:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916182400 00000100:00100000:3.0:1789498825.661333:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916182400 00000100:00100000:3.0:1789498825.661343:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789498825.661348:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07587661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916182144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498825.661378:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07587661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916182144:12345-0@lo:400:kworker.0 Request processed in 30us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498825.661385:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789498825.661396:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789498825.661401:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07587660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916182400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498825.661435:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07587660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916182400:12345-0@lo:400:kworker.0 Request processed in 34us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498825.661441:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789498825.661484:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916182400:0@lo:400:kworker.0 00010000:00080000:3.0:1789498825.661499:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa075883d9880 x1876424916182272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498825.661509:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876424916182272:0@lo:400:kworker.0 00000100:00100000:3.0:1789498825.661565:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916182144:0@lo:400:kworker.0 00000100:00100000:3.0:1789498825.661574:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075883d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39f24317-e976-4eca-a2df-96def568323f:3641:1876424916182016:0@lo:400:kworker.0 00010000:00080000:3.0:1789498825.661583:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa07587661180 x1876424916182528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498825.661592:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876424916182528:0@lo:400:kworker.0 00000100:00100000:2.0:1789498825.663972:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876424916182656:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789498825.664052:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498825.664130:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916182656 00000100:00100000:2.0:1789498825.664140:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916182656 00000100:00100000:2.0:1789498825.664193:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789498825.664202:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876424916182656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789498825.664244:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789498825.664290:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876424916182656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498825.664298:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789498825.664349:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876424916182656:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789498826.246830:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498827.260195:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789498827.666023:0:24162:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789498827.666032:0:24162:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789498827.666033:0:24162:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1789498827.666154:0:24162:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa07581547800 00000020:01000004:1.0:1789498827.666171:0:24162:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789498827.666184:0:24162:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789498827.666198:0:24162:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffffa075857319c0) 00000020:00000080:1.0:1789498827.666217:0:24162:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789498827.783682:0:24162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789498827.792573:0:24162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789498827.794185:0:24162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789498827.795187:0:24162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1789498827.798724:0:24162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789498827.799267:0:24162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1789498827.799687:0:24162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:3.0:1789498827.802084:0:24162:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789498827.802306:0:24162:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789498827.802319:0:24162:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789498827.802331:0:24162:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x70d6b5fa1825e430 00000020:01000004:3.0:1789498827.802338:0:24162:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789498827.802359:0:24162:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.117@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789498827.802363:0:24162:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.117@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789498827.802370:0:24162:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789498827.802375:0:24162:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789498827.802387:0:24162:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffffa0769060b380) 00000020:00000080:3.0:1789498827.802398:0:24162:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1789498827.804436:0:24162:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789498827.808650:0:24162:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789498827.808679:0:24162:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789498827.824035:0:24162:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789498827.824050:0:24162:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789498827.824767:0:24162:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789498827.824776:0:24162:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789498827.828135:0:24162:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789498827.828348:0:24162:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789498827.828356:0:24162:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789498827.831013:0:24162:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789498827.831027:0:24162:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789498827.890211:0:24162:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789498827.890791:0:24162:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789498827.890799:0:24162:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789498827.892699:0:24162:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789498827.892712:0:24162:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789498827.894248:0:24162:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789498827.894266:0:24162:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789498827.899216:0:24162:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789498827.899491:0:24162:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789498827.899498:0:24162:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789498827.902291:0:24162:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789498827.902303:0:24162:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789498827.946221:0:24162:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789498827.946426:0:24162:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789498827.946432:0:24162:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789498827.947808:0:24162:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789498827.947819:0:24162:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789498827.948401:0:24162:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789498827.948431:0:24162:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1789498827.948437:0:24162:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.117@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789498827.962987:0:24162:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.117@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789498827.963166:0:24162:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.117@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789498827.963171:0:24162:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789498827.963173:0:24162:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789498827.963174:0:24162:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789498827.963175:0:24162:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789498827.963176:0:24162:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789498827.963178:0:24162:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789498827.963180:0:24162:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789498827.963183:0:24162:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789498827.963191:0:24162:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789498827.963195:0:24162:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789498827.963198:0:24162:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789498827.963199:0:24162:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789498827.963200:0:24162:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789498827.963200:0:24162:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789498827.963201:0:24162:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789498827.963202:0:24162:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789498827.963203:0:24162:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789498827.963204:0:24162:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789498827.963204:0:24162:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789498827.963243:0:24162:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789498827.963266:0:24162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916182784:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789498827.963340:0:24162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498827.963458:0:24162:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07689375a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789498827.969246:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916182784 00000100:00100000:1.0:1789498827.969263:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916182784 00000100:00100000:0.0:1789498827.969393:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789498827.969405:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+18:24162:x1876424916182784:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789498827.969465:0:22651:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789498827.969469:0:22651:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789498827.969473:0:22651:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789498827.969961:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+18:24162:x1876424916182784:12345-0@lo:253:mount.lustre.0 Request processed in 557us (6619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498827.969970:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789498827.970319:0:24162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916182784:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789498827.970336:0:24162:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789498827.970340:0:24162:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789498827.970342:0:24162:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789498827.970343:0:24162:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789498827.970345:0:24162:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789498827.970346:0:24162:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789498827.970348:0:24162:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789498827.970349:0:24162:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789498827.970351:0:24162:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789498827.970353:0:24162:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789498827.970379:0:24162:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa07581547800 from lustre-OST0000 10000000:01000000:2.0:1789498827.970425:0:24162:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789498827.970428:0:24162:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789498827.970438:0:24162:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa075876f8000 local copy 00010000:00010000:2.0:1789498827.970451:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9000/0x70d6b5fa1825e1eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e1f2 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498827.970620:0:24162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586724a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916182912:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789498827.970673:0:24162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498827.970780:0:24162:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07698c61e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789498827.971214:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916182912 00000100:00100000:3.0:1789498827.971221:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916182912 00000100:00100000:3.0:1789498827.971302:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789498827.971312:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+18:24162:x1876424916182912:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498827.971408:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+18:24162:x1876424916182912:12345-0@lo:501:mount.lustre.0 Request processed in 97us (743us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789498827.971416:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789498827.971485:0:24162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586724a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916182912:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789498827.971503:0:24162:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.117@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789498827.971561:0:24162:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.117@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789498827.971570:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9000/0x70d6b5fa1825e1eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e1f2 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498827.971581:0:24162:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9000/0x70d6b5fa1825e1eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e1f2 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498827.971624:0:24162:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa07581547800 10000000:01000000:2.0:1789498827.971629:0:24162:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789498827.971636:0:24162:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789498827.971639:0:24162:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789498827.971645:0:24162:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789498827.971648:0:24162:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789498827.971688:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1571600/0x70d6b5fa1825e43e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498827.971697:0:24162:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa076c1571600/0x70d6b5fa1825e43e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498827.971706:0:24162:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa076c1571600/0x70d6b5fa1825e43e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498827.971722:0:24162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586724a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916183040:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789498827.971763:0:24162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498827.972230:0:24162:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07698c61e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789498827.972284:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916183040 00000100:00100000:0.0:1789498827.972290:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916183040 00000100:00100000:1.0:1789498827.972334:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789498827.972344:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+18:24162:x1876424916183040:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789498827.972355:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498827.972369:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa075857b1200/0x70d6b5fa1825e445 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e43e expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498827.972395:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa075857b1200/0x70d6b5fa1825e445 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e43e expref: 19 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498827.972405:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa075857b1200/0x70d6b5fa1825e445 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e43e expref: 19 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498827.972414:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa075857b1200, rc 0) 00000100:00100000:1.0:1789498827.972459:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+19:24162:x1876424916183040:12345-0@lo:101:mount.lustre.0 Request processed in 118us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498827.972476:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789498827.972573:0:24162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586724a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916183040:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789498827.972588:0:24162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa076c1571600/0x70d6b5fa1825e43e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e445 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498827.972597:0:24162:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa076c1571600/0x70d6b5fa1825e43e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e445 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789498827.974402:0:24162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1789498827.976359:0:24162:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789498827.978461:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1789498827.978926:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1789498827.978953:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1789498827.978969:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1789498827.978984:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1789498827.979002:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1789498827.979018:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1789498827.979050:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1789498827.979076:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1789498827.979096:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1789498827.979112:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1789498827.979127:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1789498827.979154:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1789498827.979161:0:24162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1789498827.979276:0:24162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586724a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916183168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789498827.979345:0:24162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498827.979396:0:24162:0:(client.c:2716:ptlrpc_set_wait()) set ffffa0768289c600 going to sleep for 11 seconds 00000100:00100000:3.0:1789498827.979583:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916183168 00000100:00100000:3.0:1789498827.979592:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916183168 00000100:00100000:3.0:1789498827.979643:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789498827.979653:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+19:24162:x1876424916183168:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498827.979832:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+19:24162:x1876424916183168:12345-0@lo:501:mount.lustre.0 Request processed in 180us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498827.979841:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789498827.980224:0:24162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586724a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916183168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789498827.980263:0:24162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586724a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916183296:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789498827.980304:0:24162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498827.980335:0:24162:0:(client.c:2716:ptlrpc_set_wait()) set ffffa0768289c600 going to sleep for 11 seconds 00000100:00100000:1.0:1789498827.980385:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916183296 00000100:00100000:1.0:1789498827.980389:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916183296 00000100:00100000:1.0:1789498827.980426:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789498827.980433:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+19:24162:x1876424916183296:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789498827.981404:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+19:24162:x1876424916183296:12345-0@lo:503:mount.lustre.0 Request processed in 966us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498827.981414:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789498827.981511:0:24162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586724a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916183296:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789498827.982060:0:24162:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789498827.982278:0:24162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586724a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916183424:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789498827.982341:0:24162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498827.982427:0:24162:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a0bd7240 going to sleep for 11 seconds 00000100:00100000:0.0:1789498827.983674:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916183424 00000100:00100000:0.0:1789498827.983692:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916183424 00000100:00100000:0.0:1789498827.983863:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789498827.983874:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+19:24162:x1876424916183424:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789498827.984690:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+19:24162:x1876424916183424:12345-0@lo:502:mount.lustre.0 Request processed in 816us (2347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498827.984711:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789498827.984859:0:24162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586724a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916183424:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789498827.985143:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1789498827.985186:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1789498827.985203:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1789498827.985223:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1789498827.985239:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1789498827.985252:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1789498827.985266:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1789498827.985281:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1789498827.985294:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1789498827.985308:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1789498827.985326:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1789498827.985340:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1789498827.985380:0:24162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586724a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916183552:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789498827.985428:0:24162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498827.985992:0:24162:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a0bd7240 going to sleep for 11 seconds 00000100:00100000:3.0:1789498827.986150:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916183552 00000100:00100000:3.0:1789498827.986157:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916183552 00000100:00100000:3.0:1789498827.986198:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789498827.986206:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+19:24162:x1876424916183552:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789498827.986346:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+19:24162:x1876424916183552:12345-0@lo:502:mount.lustre.0 Request processed in 139us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498827.986354:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789498827.986445:0:24162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586724a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916183552:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789498827.986501:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1789498827.986511:0:24162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1789498827.987458:0:24179:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789498827.987467:0:24179:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1789498827.987473:0:24179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498827.987475:0:24179:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789498827.987481:0:24179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789498827.987495:0:24179:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffffa076beff0000) 00000020:00000080:2.0:1789498827.987519:0:24179:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789498827.987526:0:24179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789498827.987638:0:24179:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa07581547800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789498827.987647:0:24179:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789498827.987654:0:24179:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x70d6b5fa1825e453 00010000:00010000:2.0:1789498827.993687:0:24179:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1789498827.994301:0:24179:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:2.0:1789498827.995975:0:24179:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1789498827.997714:0:24179:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789498827.997733:0:24179:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789498827.997739:0:24179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498827.997742:0:24179:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789498827.997745:0:24179:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789498827.997748:0:24179:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1789498827.997749:0:24179:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789498827.997751:0:24179:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789498827.997752:0:24179:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789498827.997755:0:24179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498827.997756:0:24179:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789498827.997759:0:24179:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789498827.997762:0:24179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498827.997763:0:24179:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789498827.997766:0:24179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789498827.997767:0:24179:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789498827.997769:0:24179:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789498827.997771:0:24179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498827.997772:0:24179:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789498827.997774:0:24179:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789498827.997776:0:24179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498827.997777:0:24179:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789498827.997781:0:24179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789498827.997901:0:24179:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789498827.997905:0:24179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498827.997907:0:24179:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789498827.997911:0:24179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:1.0:1789498828.004911:0:24162:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1789498828.004959:0:24162:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789498828.005037:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1571600/0x70d6b5fa1825e43e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e445 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498828.005050:0:24162:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa076c1571600/0x70d6b5fa1825e43e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e445 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498828.005059:0:24162:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa07581547800 from 1 10000000:01000000:1.0:1789498828.005062:0:24162:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789498828.005779:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075857b0800/0x70d6b5fa1825e45a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498828.005790:0:24162:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa075857b0800/0x70d6b5fa1825e45a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498828.005801:0:24162:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa075857b0800/0x70d6b5fa1825e45a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498828.005841:0:24162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916183680:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789498828.005918:0:24162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498828.005967:0:24162:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076befa26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789498828.006201:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916183680 00000100:00100000:2.0:1789498828.006211:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916183680 00000100:00100000:2.0:1789498828.006273:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789498828.006283:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+19:24162:x1876424916183680:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789498828.006296:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498828.006310:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa076c1571200/0x70d6b5fa1825e461 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e45a expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498828.006337:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa076c1571200/0x70d6b5fa1825e461 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e45a expref: 20 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498828.006347:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa076c1571200/0x70d6b5fa1825e461 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e45a expref: 20 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498828.006355:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa076c1571200, rc 0) 00000100:00100000:2.0:1789498828.006394:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+20:24162:x1876424916183680:12345-0@lo:101:mount.lustre.0 Request processed in 114us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498828.006400:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789498828.007972:0:24162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916183680:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789498828.007999:0:24162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa075857b0800/0x70d6b5fa1825e45a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e461 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498828.008012:0:24162:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa075857b0800/0x70d6b5fa1825e45a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e461 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789498828.009189:0:24162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1789498828.009492:0:24162:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789498828.012282:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1789498828.012349:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1789498828.012369:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1789498828.012386:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1789498828.012402:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1789498828.012418:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1789498828.012434:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1789498828.012450:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1789498828.012466:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1789498828.012480:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1789498828.012495:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1789498828.012519:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1789498828.012524:0:24162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1789498828.012660:0:24162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916183808:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789498828.015303:0:24162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498828.015617:0:24162:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076befa2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789498828.017683:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916183808 00000100:00100000:2.0:1789498828.017698:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916183808 00000100:00100000:2.0:1789498828.017821:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789498828.017832:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+20:24162:x1876424916183808:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789498828.018019:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+20:24162:x1876424916183808:12345-0@lo:501:mount.lustre.0 Request processed in 189us (2722us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498828.018037:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789498828.018140:0:24162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916183808:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789498828.018197:0:24162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916183936:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789498828.018258:0:24162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498828.020331:0:24162:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076befa2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789498828.026281:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916183936 00000100:00100000:3.0:1789498828.026306:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916183936 00000100:00100000:3.0:1789498828.026396:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789498828.026427:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+20:24162:x1876424916183936:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789498828.026699:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+20:24162:x1876424916183936:12345-0@lo:503:mount.lustre.0 Request processed in 275us (8440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498828.026707:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789498828.026930:0:24162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916183936:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789498828.027623:0:24162:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789498828.027736:0:24162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916184064:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789498828.027810:0:24162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498828.027858:0:24162:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076befa26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498828.029173:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916184064 00000100:00100000:3.0:1789498828.029186:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916184064 00000100:00100000:3.0:1789498828.029232:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789498828.029241:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+20:24162:x1876424916184064:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789498828.029392:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+20:24162:x1876424916184064:12345-0@lo:502:mount.lustre.0 Request processed in 151us (1583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498828.029399:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789498828.031321:0:24162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916184064:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789498828.031651:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1789498828.031727:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1789498828.031748:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1789498828.031764:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1789498828.031781:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1789498828.031799:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1789498828.031814:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1789498828.031832:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1789498828.031849:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1789498828.031867:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1789498828.031883:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1789498828.031924:0:24162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916184192:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789498828.031994:0:24162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498828.032052:0:24162:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076befa26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498828.032351:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916184192 00000100:00100000:3.0:1789498828.032360:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916184192 00000100:00100000:3.0:1789498828.032413:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789498828.032425:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+20:24162:x1876424916184192:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789498828.032593:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+20:24162:x1876424916184192:12345-0@lo:502:mount.lustre.0 Request processed in 169us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498828.032601:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789498828.032721:0:24162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916184192:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789498828.033202:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1789498828.033216:0:24162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1789498828.034753:0:24183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498828.034769:0:24183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498828.034771:0:24183:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789498828.034778:0:24183:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa07581547800 00000020:00000080:2.0:1789498828.034793:0:24183:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789498828.034804:0:24183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498828.034808:0:24183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498828.034809:0:24183:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789498828.034812:0:24183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498828.034814:0:24183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498828.034816:0:24183:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789498828.034819:0:24183:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa07581547800 00000020:00000080:2.0:1789498828.034820:0:24183:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789498828.034928:0:24183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498828.034932:0:24183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498828.034933:0:24183:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789498828.034935:0:24183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498828.034943:0:24183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498828.034944:0:24183:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789498828.034947:0:24183:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa07581547800 00000020:00000080:2.0:1789498828.034949:0:24183:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789498828.037690:0:24183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498828.037706:0:24183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498828.037709:0:24183:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789498828.037714:0:24183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498828.037718:0:24183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498828.037719:0:24183:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789498828.037724:0:24183:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa07581547800 00000020:00000080:2.0:1789498828.037726:0:24183:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789498828.037803:0:24183:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498828.037807:0:24183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498828.037809:0:24183:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789498828.037813:0:24183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1789498828.038035:0:24162:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789498828.038082:0:24162:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789498828.038117:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075857b0800/0x70d6b5fa1825e45a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e461 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498828.038130:0:24162:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa075857b0800/0x70d6b5fa1825e45a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e461 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498828.038186:0:24162:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789498828.038190:0:24162:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa07581547800 10000000:01000000:1.0:1789498828.038194:0:24162:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa07581547800 10000000:01000000:1.0:1789498828.038197:0:24162:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789498828.038203:0:24162:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa07581547800 from 1 10000000:01000000:1.0:1789498828.038206:0:24162:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789498828.038241:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075857b0400/0x70d6b5fa1825e468 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498828.038250:0:24162:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa075857b0400/0x70d6b5fa1825e468 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498828.038261:0:24162:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa075857b0400/0x70d6b5fa1825e468 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498828.038286:0:24162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916184320:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789498828.038354:0:24162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498828.038396:0:24162:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076befa2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789498828.038651:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916184320 00000100:00100000:2.0:1789498828.038660:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916184320 00000100:00100000:2.0:1789498828.038716:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789498828.038726:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+20:24162:x1876424916184320:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789498828.038749:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498828.038763:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa076c1570000/0x70d6b5fa1825e46f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e468 expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498828.038787:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa076c1570000/0x70d6b5fa1825e46f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e468 expref: 21 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498828.038798:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa076c1570000/0x70d6b5fa1825e46f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e468 expref: 21 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498828.038805:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa076c1570000, rc 0) 00000100:00100000:2.0:1789498828.038852:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+21:24162:x1876424916184320:12345-0@lo:101:mount.lustre.0 Request processed in 127us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498828.038859:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789498828.038979:0:24162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916184320:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789498828.038994:0:24162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa075857b0400/0x70d6b5fa1825e468 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e46f expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498828.039004:0:24162:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa075857b0400/0x70d6b5fa1825e468 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e46f expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789498828.042480:0:24162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1789498828.042918:0:24162:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789498828.044741:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1789498828.044807:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1789498828.044826:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1789498828.044842:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1789498828.044857:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1789498828.044875:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1789498828.044891:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1789498828.044907:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1789498828.044922:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1789498828.044938:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1789498828.044955:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1789498828.044990:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1789498828.045009:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1789498828.045040:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1789498828.045056:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1789498828.046189:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1789498828.046231:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1789498828.046249:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1789498828.046266:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1789498828.046284:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1789498828.046302:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1789498828.046318:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1789498828.046336:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1789498828.046354:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1789498828.046371:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1789498828.046388:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1789498828.046405:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1789498828.046440:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1789498828.046461:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1789498828.046490:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1789498828.046510:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1789498828.046527:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1789498828.046566:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1789498828.046585:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1789498828.046600:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1789498828.046616:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1789498828.046632:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1789498828.046650:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1789498828.046686:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1789498828.046706:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1789498828.046721:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1789498828.046734:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1789498828.046746:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1789498828.046775:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1789498828.046793:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1789498828.046809:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1789498828.046825:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1789498828.046842:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1789498828.051328:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1789498828.051366:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1789498828.051386:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1789498828.051391:0:24162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1789498828.051494:0:24162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916184448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789498828.051578:0:24162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498828.051632:0:24162:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076befa29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498828.052244:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916184448 00000100:00100000:0.0:1789498828.052253:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916184448 00000100:00100000:0.0:1789498828.052315:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789498828.052325:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+21:24162:x1876424916184448:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789498828.052503:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+21:24162:x1876424916184448:12345-0@lo:501:mount.lustre.0 Request processed in 179us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498828.052511:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789498828.053251:0:24162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916184448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789498828.053301:0:24162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916184576:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789498828.053358:0:24162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498828.053390:0:24162:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076befa29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789498828.054375:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916184576 00000100:00100000:2.0:1789498828.054384:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916184576 00000100:00100000:2.0:1789498828.054430:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789498828.054439:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+21:24162:x1876424916184576:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789498828.054591:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+21:24162:x1876424916184576:12345-0@lo:503:mount.lustre.0 Request processed in 152us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498828.054598:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789498828.057233:0:24162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916184576:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789498828.057779:0:24162:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789498828.057859:0:24162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916184704:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789498828.057929:0:24162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498828.057971:0:24162:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076befa2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789498828.058387:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916184704 00000100:00100000:0.0:1789498828.058394:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916184704 00000100:00100000:0.0:1789498828.058441:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789498828.058451:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+21:24162:x1876424916184704:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789498828.058593:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+21:24162:x1876424916184704:12345-0@lo:502:mount.lustre.0 Request processed in 143us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498828.058600:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789498828.060740:0:24162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916184704:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789498828.061133:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1789498828.061175:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1789498828.061191:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1789498828.061205:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1789498828.061218:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1789498828.061231:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1789498828.061244:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1789498828.061257:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1789498828.061271:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1789498828.061284:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1789498828.061296:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1789498828.061323:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1789498828.061338:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1789498828.061353:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1789498828.061369:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1789498828.061385:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1789498828.061417:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1789498828.061449:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1789498828.061465:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1789498828.061480:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1789498828.061497:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1789498828.061513:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1789498828.061528:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1789498828.061588:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1789498828.061605:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1789498828.061623:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1789498828.061640:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1789498828.061657:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1789498828.061687:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1789498828.061704:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1789498828.061719:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1789498828.061733:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1789498828.061762:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1789498828.061782:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1789498828.061799:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1789498828.061815:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1789498828.061831:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1789498828.061846:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1789498828.061862:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1789498828.061879:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1789498828.061896:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1789498828.061912:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1789498828.061927:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1789498828.061944:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1789498828.061970:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1789498828.061987:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1789498828.062003:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1789498828.062018:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1789498828.071737:0:24162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916184832:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789498828.071846:0:24162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498828.071911:0:24162:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a9c1c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498828.071985:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916184832 00000100:00100000:3.0:1789498828.071994:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916184832 00000100:00100000:3.0:1789498828.072053:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789498828.072063:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+21:24162:x1876424916184832:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789498828.072210:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+21:24162:x1876424916184832:12345-0@lo:502:mount.lustre.0 Request processed in 148us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498828.072219:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789498828.072387:0:24162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916184832:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789498828.072690:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1789498828.072725:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1789498828.072754:0:24162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916184960:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789498828.072794:0:24162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498828.072825:0:24162:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a9c1c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498828.072844:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916184960 00000100:00100000:0.0:1789498828.072848:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916184960 00000100:00100000:0.0:1789498828.072879:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789498828.072885:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+21:24162:x1876424916184960:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789498828.072964:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+21:24162:x1876424916184960:12345-0@lo:502:mount.lustre.0 Request processed in 79us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498828.072970:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789498828.073011:0:24162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916184960:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789498828.073051:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1789498828.073059:0:24162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789498828.076495:0:24188:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789498828.076520:0:24188:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffffa07690608000) 00000020:00000080:3.0:1789498828.076572:0:24188:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1789498828.076683:0:24188:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa07581547800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789498828.076688:0:24188:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa07581547800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789498828.076691:0:24188:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa07581547800 3 00010000:00080000:3.0:1789498828.076727:0:24188:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa076bbe17000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.117@tcp at head 00010000:00010000:3.0:1789498828.087269:0:24188:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1789498828.087460:0:24188:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789498828.087505:0:24188:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789498828.087518:0:24188:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x70d6b5fa1825e47d 00000100:00080000:3.0:1789498828.087528:0:24188:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789498828.087556:0:24188:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa076bbe17000 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:3.0:1789498828.087593:0:24188:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa07587661180 x1876424916185088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789498828.087618:0:24188:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789498828.087710:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1876424916185088:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789498828.087788:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498828.087857:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916185088 00000100:00100000:0.0:1789498828.087873:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916185088 00000100:00100000:0.0:1789498828.087910:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789498828.087919:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1876424916185088:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789498828.087945:0:22660:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 662 last 0 00000020:00000080:0.0:1789498828.087972:0:22660:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x70d6b5fa1825e484 00000004:00100000:0.0:1789498828.087987:0:22660:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789498828.088023:0:22660:0:(import.c:65:import_set_state_nolock()) ffffa0758719e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789498828.088099:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876424916185088:12345-0@lo:38:llog_process_th.0 Request processed in 180us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498828.088107:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789498828.088149:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa07587661180 x1876424916185088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789498838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498828.088159:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789498828.088168:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1789498828.088177:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789498828.088181:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789498828.088183:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076bbe17000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789498828.088189:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1876424916185088:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1789498828.091994:0:24188:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789498828.092013:0:24188:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffffa075876f99c0) 00000020:00000080:0.0:1789498828.092037:0:24188:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1789498828.092157:0:24188:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa07581547800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789498828.092162:0:24188:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa07581547800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789498828.092164:0:24188:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa07581547800 3 00010000:00080000:0.0:1789498828.092197:0:24188:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0758719a800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.117@tcp at head 00010000:00010000:0.0:1789498828.093797:0:24188:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1789498828.093993:0:24188:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1789498828.094052:0:24188:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789498828.094070:0:24188:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x70d6b5fa1825e492 00000100:00080000:0.0:1789498828.094083:0:24188:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789498828.094094:0:24188:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffffa0758719a800 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:0.0:1789498828.094137:0:24188:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa075874f5c00 x1876424916185216/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789498828.094192:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1876424916185216:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789498828.094260:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789498828.094317:0:24188:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789498828.094838:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916185216 00000100:00100000:3.0:1789498828.094847:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916185216 00000100:00100000:3.0:1789498828.094881:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789498828.094889:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1876424916185216:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789498828.094917:0:22658:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 662 last 0 00000020:00000080:3.0:1789498828.094951:0:22658:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x70d6b5fa1825e499 00000004:00100000:3.0:1789498828.094965:0:22658:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789498828.095002:0:22658:0:(import.c:65:import_set_state_nolock()) ffffa076bbe15000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789498828.095077:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876424916185216:12345-0@lo:38:llog_process_th.0 Request processed in 174us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498828.095085:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789498828.095130:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa075874f5c00 x1876424916185216/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789498838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498828.095151:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789498828.095160:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1789498828.095166:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789498828.095169:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789498828.095172:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa0758719a800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789498828.095177:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1876424916185216:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789498828.097302:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789498828.097309:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789498828.097313:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789498828.097315:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789498828.097338:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789498828.097342:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789498828.097344:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789498828.097347:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789498828.097403:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916185344:0@lo:400:kworker.0 00000100:00100000:3.0:1789498828.097478:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498828.097512:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789498828.097518:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876424916185472:0@lo:400:kworker.0 00000100:00100000:3.0:1789498828.097558:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498828.097613:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916185472 00000100:00100000:3.0:1789498828.097620:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916185472 00000100:00100000:3.0:1789498828.097675:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789498828.097693:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07587660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876424916185472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498828.097743:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07587660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876424916185472:12345-0@lo:400:kworker.0 Request processed in 52us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498828.097751:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789498828.097793:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa07587660380 x1876424916185472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498828.097807:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876424916185472:0@lo:400:kworker.0 00000100:00100000:2.0:1789498828.098214:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916185600:0@lo:400:kworker.0 00000100:00100000:2.0:1789498828.098252:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498828.098274:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789498828.098279:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876424916185728:0@lo:400:kworker.0 00000100:00100000:2.0:1789498828.098301:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498828.098340:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916185344 00000100:00100000:2.0:1789498828.098350:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916185344 00000100:00100000:2.0:1789498828.098375:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916185600 00000100:00100000:2.0:1789498828.098377:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916185600 00000100:00100000:2.0:1789498828.098391:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789498828.098397:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07587663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876424916185344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498828.098436:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07587663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876424916185344:12345-0@lo:400:kworker.0 Request processed in 39us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498828.098442:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789498828.098453:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789498828.098458:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916185600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498828.098484:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916185600:12345-0@lo:400:kworker.0 Request processed in 26us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498828.098490:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789498828.098505:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916185728 00000100:00100000:2.0:1789498828.098508:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916185728 00000100:00100000:2.0:1789498828.098529:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789498828.098552:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876424916185728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498828.098596:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876424916185728:12345-0@lo:400:kworker.0 Request processed in 44us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498828.098603:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789498828.098635:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916185344:0@lo:400:kworker.0 00010000:00080000:2.0:1789498828.098659:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa07587663100 x1876424916185728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498828.098679:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876424916185728:0@lo:400:kworker.0 00000100:00100000:2.0:1789498828.098689:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916185600:0@lo:400:kworker.0 00000040:00080000:0.0:1789498828.102695:0:24188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1789498828.102776:0:24162:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789498828.102811:0:24162:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789498828.102833:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075857b0400/0x70d6b5fa1825e468 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e46f expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498828.102848:0:24162:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa075857b0400/0x70d6b5fa1825e468 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e46f expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789498828.102905:0:24162:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789498828.102908:0:24162:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789498828.102910:0:24162:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789498828.102911:0:24162:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789498828.102913:0:24162:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789498828.102914:0:24162:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789498828.102916:0:24162:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789498828.102918:0:24162:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789498828.102920:0:24162:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789498828.102924:0:24162:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1789498828.102927:0:24162:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789498828.102928:0:24162:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789498828.102929:0:24162:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789498828.102937:0:24162:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789498828.102938:0:24162:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789498828.102939:0:24162:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789498828.102940:0:24162:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789498828.102941:0:24162:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789498828.102942:0:24162:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789498828.102971:0:24162:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789498828.102994:0:24162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916185856:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789498828.105212:0:24162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498828.105271:0:24162:0:(client.c:2716:ptlrpc_set_wait()) set ffffa0768891cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789498828.105366:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916185856 00000100:00100000:0.0:1789498828.105375:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916185856 00000100:00100000:0.0:1789498828.105431:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789498828.105440:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+21:24162:x1876424916185856:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789498828.105479:0:22650:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789498828.105498:0:22650:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789498828.112899:0:22650:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789498828.112922:0:22650:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789498828.113386:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+21:24162:x1876424916185856:12345-0@lo:253:mount.lustre.0 Request processed in 7940us (8177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498828.113398:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 20000000:01000000:0.0:1789498828.113620:0:22674:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789498828.113626:0:22674:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789498828.113651:0:22674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa076bc6d8800/0x70d6b5fa1825e4a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498828.113679:0:22674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa076c1571c00/0x70d6b5fa1825e3ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e3e3 expref: 20 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498828.113686:0:22674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa076c1570200/0x70d6b5fa1825e3f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e3f1 expref: 20 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498828.113694:0:22674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa076bc6d8800/0x70d6b5fa1825e4a0 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498828.113734:0:22674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa076c1570200/0x70d6b5fa1825e3f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70d6b5fa1825e3f1 expref: 20 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498828.113768:0:22674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa076c1570200/0x70d6b5fa1825e3f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70d6b5fa1825e3f1 expref: 20 pid: 22650 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498828.113784:0:22674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22674:1876424916185984:0@lo:104: 00000100:00100000:0.0:1789498828.113823:0:22674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789498828.113907:0:22674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa076c1571c00/0x70d6b5fa1825e3ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70d6b5fa1825e3e3 expref: 20 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498828.113916:0:22674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa076c1571c00/0x70d6b5fa1825e3ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70d6b5fa1825e3e3 expref: 20 pid: 22651 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498828.113925:0:22674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22674:1876424916186112:0@lo:104: 00000100:00100000:0.0:1789498828.113951:0:22674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498828.117236:0:24162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24162:1876424916185856:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789498828.117253:0:24162:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789498828.117256:0:24162:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789498828.117257:0:24162:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789498828.117259:0:24162:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789498828.117260:0:24162:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789498828.117261:0:24162:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789498828.117263:0:24162:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789498828.117264:0:24162:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789498828.117267:0:24162:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789498828.117268:0:24162:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789498828.117288:0:24162:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789498828.122634:0:22674:0:(client.c:2716:ptlrpc_set_wait()) set ffffa0768891c240 going to sleep for 11 seconds 00000100:00100000:2.0:1789498828.122904:0:22642:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789498828.122931:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916185984 00000100:00100000:2.0:1789498828.122940:0:22642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916185984 00000100:00100000:2.0:1789498828.122978:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916186112 00000100:00100000:2.0:1789498828.122982:0:22642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916186112 00000100:00100000:2.0:1789498828.122998:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789498828.123008:0:22642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39f24317-e976-4eca-a2df-96def568323f+4:22674:x1876424916185984:12345-0@lo:104: 00010000:00010000:2.0:1789498828.123024:0:22642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.117@tcp lock: ffffa076c1570800/0x70d6b5fa1825e3f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x70d6b5fa1825e3f8 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498828.123105:0:22642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789498828.123112:0:22642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39f24317-e976-4eca-a2df-96def568323f+4:22674:x1876424916185984:12345-0@lo:104: Request processed in 106us (9288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498828.123118:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789498828.123135:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789498828.123141:0:22642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076b7162c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39f24317-e976-4eca-a2df-96def568323f+3:22674:x1876424916186112:12345-0@lo:104: 00010000:00010000:2.0:1789498828.123149:0:22642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9200/0x70d6b5fa1825e3e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x70d6b5fa1825e3ea expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498828.123179:0:22642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789498828.123184:0:22642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076b7162c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39f24317-e976-4eca-a2df-96def568323f+3:22674:x1876424916186112:12345-0@lo:104: Request processed in 44us (9233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498828.123190:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789498828.126132:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789498828.126147:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.117@tcp lock: ffffa076c1570800/0x70d6b5fa1825e3f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x70d6b5fa1825e3f8 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498828.126162:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c1570800 already unused, calling callback (ffffffffc13e6c20) 10000000:00010000:3.0:1789498828.126166:0:22647:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.117@tcp lock: ffffa076c1570800/0x70d6b5fa1825e3f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x70d6b5fa1825e3f8 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498828.126178:0:22647:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa076c1570800/0x70d6b5fa1825e3f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x70d6b5fa1825e3f8 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789498828.126203:0:22647:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa076c1570800/0x70d6b5fa1825e3f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x70d6b5fa1825e3f8 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498828.126208:0:22647:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789498828.126269:0:22647:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.117@tcp lock: ffffa076c1570800/0x70d6b5fa1825e3f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e3f8 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498828.126275:0:22647:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789498828.126296:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.117@tcp lock: ffffa076c1570800/0x70d6b5fa1825e3f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e3f8 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498828.126304:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa076c1570800/0x70d6b5fa1825e3f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e3f8 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498828.126322:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498828.126326:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9200/0x70d6b5fa1825e3e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70d6b5fa1825e3ea expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498828.126331:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076bc6d9200 already unused, calling callback (ffffffffc13e6c20) 10000000:00010000:3.0:1789498828.126334:0:22647:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9200/0x70d6b5fa1825e3e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x70d6b5fa1825e3ea expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498828.126341:0:22647:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9200/0x70d6b5fa1825e3e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x70d6b5fa1825e3ea expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789498828.126347:0:22647:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9200/0x70d6b5fa1825e3e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x70d6b5fa1825e3ea expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498828.126352:0:22647:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789498828.126372:0:22647:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9200/0x70d6b5fa1825e3e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e3ea expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498828.126377:0:22647:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789498828.126383:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9200/0x70d6b5fa1825e3e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e3ea expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498828.126388:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9200/0x70d6b5fa1825e3e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e3ea expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498828.126401:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498828.126402:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498828.126404:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498828.126421:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39f24317-e976-4eca-a2df-96def568323f:3644:1876424916186368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789498828.126495:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498828.126564:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789498828.126570:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39f24317-e976-4eca-a2df-96def568323f:3644:1876424916186240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789498828.126595:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498828.126636:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916186368 00000100:00100000:3.0:1789498828.126643:0:22644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916186368 00010000:00010000:3.0:1789498828.126684:0:22644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa076c1571c00/0x70d6b5fa1825e3ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70d6b5fa1825e3e3 expref: 21 pid: 22651 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498828.126709:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916186240 00000100:00100000:3.0:1789498828.126712:0:22644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916186240 00010000:00010000:3.0:1789498828.126723:0:22644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa076c1570200/0x70d6b5fa1825e3f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70d6b5fa1825e3f1 expref: 22 pid: 22650 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498828.126742:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789498828.126751:0:22644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07587662300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39f24317-e976-4eca-a2df-96def568323f+22:3644:x1876424916186368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789498828.126774:0:22644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498828.126780:0:22644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa076c1571c00/0x70d6b5fa1825e3ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70d6b5fa1825e3e3 expref: 22 pid: 22651 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498828.126790:0:22644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa076c1571c00/0x70d6b5fa1825e3ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70d6b5fa1825e3e3 expref: 22 pid: 22651 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498828.126807:0:22644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498828.126852:0:22644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07587662300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39f24317-e976-4eca-a2df-96def568323f+22:3644:x1876424916186368:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498828.126859:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789498828.126877:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789498828.126883:0:22644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586467850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39f24317-e976-4eca-a2df-96def568323f+21:3644:x1876424916186240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789498828.126904:0:22644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498828.126908:0:22644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa076c1570200/0x70d6b5fa1825e3f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70d6b5fa1825e3f1 expref: 21 pid: 22650 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498828.126918:0:22644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa076c1570200/0x70d6b5fa1825e3f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70d6b5fa1825e3f1 expref: 21 pid: 22650 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498828.126930:0:22644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa076bc6d8800/0x70d6b5fa1825e4a0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498828.126938:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa076bc6d8800/0x70d6b5fa1825e4a0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789498828.126954:0:22644:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013328241s 00010000:00010000:3.0:1789498828.126958:0:22644:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa076bc6d8800/0x70d6b5fa1825e4a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498828.126976:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa076bc6d8800/0x70d6b5fa1825e4a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498828.126983:0:22644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa076bc6d8800/0x70d6b5fa1825e4a0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498828.126988:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa076bc6d8800/0x70d6b5fa1825e4a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498828.126994:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076bc6d8800 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:3.0:1789498828.126998:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa076bc6d8800/0x70d6b5fa1825e4a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498828.127005:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa076bc6d8800/0x70d6b5fa1825e4a0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498828.127013:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa076bc6d8800/0x70d6b5fa1825e4a0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498828.127023:0:22644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498828.127047:0:22644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586467850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:39f24317-e976-4eca-a2df-96def568323f+21:3644:x1876424916186240:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498828.127054:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789498828.127167:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39f24317-e976-4eca-a2df-96def568323f:3644:1876424916186240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789498828.127175:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39f24317-e976-4eca-a2df-96def568323f:3644:1876424916186368:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789498828.127633:0:22674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa076c1570200/0x70d6b5fa1825e3f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70d6b5fa1825e3f1 expref: 20 pid: 22650 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498828.127649:0:22674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22674:1876424916185984:0@lo:104: 00010000:00010000:0.0:1789498828.127660:0:22674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa076c1571c00/0x70d6b5fa1825e3ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70d6b5fa1825e3e3 expref: 19 pid: 22651 timeout: 762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498828.127680:0:22674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22674:1876424916186112:0@lo:104: 00010000:00010000:0.0:1789498828.127701:0:22674:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa076bc6d8800/0x70d6b5fa1825e4a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498828.127710:0:22674:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa076bc6d8800/0x70d6b5fa1825e4a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498828.127731:0:22674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa076bc6d8800/0x70d6b5fa1825e4a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498828.127737:0:22674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa076bc6d8800/0x70d6b5fa1825e4a0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498828.127760:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498828.128173:0:22641:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000001:00000004:3.0:1789498828.129042:0:24162:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1789498828.133798:0:24162:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789498828.133809:0:24162:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789498828.133848:0:24162:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789498828.133897:0:24162:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.117@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789498828.133917:0:24162:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789498828.133948:0:24162:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1789498828.138973:0:24162:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789498828.139243:0:24162:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789498828.283780:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789498829.068022:0:24242:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789498829.068252:0:24242:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789498829.311223:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789498829.441169:0:22655:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789498829.441199:0:22655:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa076bc350800 from 13 10000000:01000000:3.0:1789498829.441204:0:22655:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789498829.441257:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075874a0800/0x70d6b5fa1825e4a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498829.441269:0:22655:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa075874a0800/0x70d6b5fa1825e4a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498829.441281:0:22655:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa075874a0800/0x70d6b5fa1825e4a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498829.441308:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587660000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916186496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789498829.441395:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498829.442574:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07690602180 going to sleep for 11 seconds 00000100:00100000:2.0:1789498829.446884:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916186496 00000100:00100000:2.0:1789498829.446903:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916186496 00000100:00100000:2.0:1789498829.446991:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789498829.447003:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+19:22655:x1876424916186496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789498829.447023:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498829.447161:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa076c1570a00/0x70d6b5fa1825e4ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e4a7 expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498829.447200:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa076c1570a00/0x70d6b5fa1825e4ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e4a7 expref: 20 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498829.447214:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa076c1570a00/0x70d6b5fa1825e4ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e4a7 expref: 20 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498829.447223:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa076c1570a00, rc 0) 00000100:00100000:2.0:1789498829.447365:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+20:22655:x1876424916186496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 364us (5971us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498829.447373:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789498829.452888:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587660000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916186496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789498829.452928:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa075874a0800/0x70d6b5fa1825e4a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e4ae expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498829.452944:0:22655:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa075874a0800/0x70d6b5fa1825e4a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e4ae expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498829.454939:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586724700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916186624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789498829.455021:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498829.455126:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a0761240 going to sleep for 11 seconds 00000100:00100000:0.0:1789498829.455729:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916186624 00000100:00100000:0.0:1789498829.455742:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916186624 00000100:00100000:0.0:1789498829.455803:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789498829.455815:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+20:22655:x1876424916186624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789498829.455838:0:22650:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789498829.455859:0:22650:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789498829.455862:0:22650:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1789498829.456177:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+20:22655:x1876424916186624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 363us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498829.456186:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789498829.461249:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586724700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916186624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789498829.461346:0:22655:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789498829.461357:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075874a0800/0x70d6b5fa1825e4a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e4ae expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498829.461382:0:22655:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa075874a0800/0x70d6b5fa1825e4a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e4ae expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498829.461393:0:22655:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789498829.461395:0:22655:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0758605a000 from 13 10000000:01000000:2.0:1789498829.461398:0:22655:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789498829.461435:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1571000/0x70d6b5fa1825e4b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498829.461442:0:22655:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa076c1571000/0x70d6b5fa1825e4b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498829.461452:0:22655:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa076c1571000/0x70d6b5fa1825e4b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498829.461472:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586724700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916186752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789498829.462178:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498829.462235:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a0761240 going to sleep for 11 seconds 00000100:00100000:3.0:1789498829.462704:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916186752 00000100:00100000:3.0:1789498829.462713:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916186752 00000100:00100000:3.0:1789498829.462809:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789498829.462820:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+20:22655:x1876424916186752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789498829.462835:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498829.462852:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa075874a0200/0x70d6b5fa1825e4bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e4b5 expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498829.462877:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa075874a0200/0x70d6b5fa1825e4bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e4b5 expref: 21 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498829.462900:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa075874a0200/0x70d6b5fa1825e4bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e4b5 expref: 21 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498829.462909:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa075874a0200, rc 0) 00000100:00100000:3.0:1789498829.462969:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+21:22655:x1876424916186752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (1440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498829.462975:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789498829.463062:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586724700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916186752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789498829.463076:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa076c1571000/0x70d6b5fa1825e4b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e4bc expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498829.463085:0:22655:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa076c1571000/0x70d6b5fa1825e4b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e4bc expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498829.463138:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586724700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916186880:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789498829.463174:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498829.470191:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a0761240 going to sleep for 11 seconds 00000100:00100000:0.0:1789498829.473155:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916186880 00000100:00100000:0.0:1789498829.473177:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916186880 00000100:00100000:0.0:1789498829.473245:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789498829.473256:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07682ae9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+21:22655:x1876424916186880:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789498829.473303:0:22651:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789498829.473321:0:22651:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789498829.473323:0:22651:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1789498829.473481:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07682ae9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+21:22655:x1876424916186880:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 227us (10305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498829.473489:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789498829.473661:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586724700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916186880:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789498829.473725:0:22655:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789498829.473736:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1571000/0x70d6b5fa1825e4b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e4bc expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498829.473748:0:22655:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa076c1571000/0x70d6b5fa1825e4b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e4bc expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498829.755778:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916187008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789498829.755858:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498829.755923:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916187008 00000100:00100000:2.0:1789498829.755934:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916187008 00000100:00100000:2.0:1789498829.755990:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789498829.755998:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916187008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789498829.756223:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789498829.756288:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916187008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 290us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498829.756297:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789498829.756381:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916187008:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789498830.331726:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498830.779690:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789498830.779715:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916187136:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789498830.779808:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498830.779873:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916187136 00000100:00100000:2.0:1789498830.779881:0:22663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916187136 00000100:00100000:2.0:1789498830.779927:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789498830.779936:0:22663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916187136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789498830.779978:0:22663:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789498830.780054:0:22663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916187136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498830.780063:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789498830.780114:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916187136:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789498831.362116:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789498831.740193:0:22692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789498832.379892:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498832.830349:0:23413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:3.0:1789498833.342196:0:15719:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789498833.342203:0:15719:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789498833.342206:0:15719:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789498833.342209:0:15719:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789498833.342235:0:15719:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789498833.342238:0:15719:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789498833.342241:0:15719:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789498833.342243:0:15719:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789498833.342285:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39f24317-e976-4eca-a2df-96def568323f:3643:1876424916187264:0@lo:400:kworker.0 00000100:00100000:3.0:1789498833.342366:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498833.342406:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876424916187776:0@lo:400:kworker.0 00000100:00100000:3.0:1789498833.342432:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498833.342459:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789498833.342464:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916187392:0@lo:400:kworker.0 00000100:00100000:3.0:1789498833.342508:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498833.342528:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876424916187904:0@lo:400:kworker.0 00000100:00100000:3.0:1789498833.342593:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498833.342624:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876424916187520:0@lo:400:kworker.0 00000100:00100000:3.0:1789498833.342647:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498833.342664:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876424916188032:0@lo:400:kworker.0 00000100:00100000:3.0:1789498833.342684:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498833.342695:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498833.342700:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916187648:0@lo:400:kworker.0 00000100:00100000:3.0:1789498833.342719:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498833.342756:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916187264 00000100:00100000:3.0:1789498833.342765:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916187264 00000100:00100000:3.0:1789498833.342828:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789498833.342837:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07682ae8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+21:3643:x1876424916187264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498833.342885:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07682ae8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+21:3643:x1876424916187264:12345-0@lo:400:kworker.0 Request processed in 50us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498833.342892:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789498833.342922:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916187776 00000100:00100000:3.0:1789498833.342927:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916187776 00000100:00100000:3.0:1789498833.342946:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916187904 00000100:00100000:3.0:1789498833.342948:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916187904 00000100:00100000:3.0:1789498833.342967:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916187520 00000100:00100000:3.0:1789498833.342970:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916187520 00000100:00100000:3.0:1789498833.342980:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916188032 00000100:00100000:3.0:1789498833.342982:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916188032 00000100:00100000:3.0:1789498833.342995:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789498833.343001:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07587663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876424916187776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498833.343043:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07587663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876424916187776:12345-0@lo:400:kworker.0 Request processed in 42us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498833.343049:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789498833.343060:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789498833.343067:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07587663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876424916187904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498833.343091:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07587663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876424916187904:12345-0@lo:400:kworker.0 Request processed in 25us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498833.343096:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789498833.343108:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789498833.343113:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07587660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876424916187520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498833.343142:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07587660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876424916187520:12345-0@lo:400:kworker.0 Request processed in 29us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498833.343148:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789498833.343161:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789498833.343166:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07587661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876424916188032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498833.343191:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07587661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876424916188032:12345-0@lo:400:kworker.0 Request processed in 26us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498833.343197:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789498833.343215:0:23400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916187392 00000100:00100000:3.0:1789498833.343219:0:23400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916187392 00000100:00100000:3.0:1789498833.343238:0:23400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916187648 00000100:00100000:3.0:1789498833.343241:0:23400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916187648 00000100:00100000:3.0:1789498833.343251:0:23400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789498833.343256:0:23400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07587662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876424916187392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498833.343285:0:23400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07587662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876424916187392:12345-0@lo:400:kworker.0 Request processed in 29us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498833.343299:0:23400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789498833.343311:0:23400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789498833.343317:0:23400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9de7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916187648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498833.343345:0:23400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9de7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916187648:12345-0@lo:400:kworker.0 Request processed in 30us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498833.343351:0:23400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789498833.343403:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916187648:0@lo:400:kworker.0 00010000:00080000:3.0:1789498833.343416:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa07587662300 x1876424916187520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498833.343426:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876424916187520:0@lo:400:kworker.0 00010000:00080000:3.0:1789498833.343436:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa07587661880 x1876424916188032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498833.343445:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876424916188032:0@lo:400:kworker.0 00000100:00100000:3.0:1789498833.343475:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916187392:0@lo:400:kworker.0 00010000:00080000:3.0:1789498833.343484:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa07587663480 x1876424916187904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498833.343492:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876424916187904:0@lo:400:kworker.0 00000100:00100000:3.0:1789498833.343499:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39f24317-e976-4eca-a2df-96def568323f:3643:1876424916187264:0@lo:400:kworker.0 00010000:00080000:3.0:1789498833.343508:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa07587662a00 x1876424916187776/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498833.343516:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876424916187776:0@lo:400:kworker.0 00000100:00080000:2.0:1789498833.343746:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789498833.343751:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789498833.403869:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498834.235869:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789498814/real 1789498814] req@ffffa076a9de7480 x1876424916177920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498834 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498834.235902:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa076a9de7480 x1876424916177920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498834 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498834.235913:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789498814/real 1789498814] req@ffffa076a9de4000 x1876424916178048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498834 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498834.235924:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa076a9de4000 x1876424916178048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498834 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789498834.235945:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076b06fb000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789498834.235960:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789498834.235963:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916177920:0@lo:8:kworker.0 00000100:00080000:1.0:1789498834.235968:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076beb13800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789498834.235973:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789498834.235975:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916178048:0@lo:8:kworker.0 00000100:00080000:3.0:1789498834.238190:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789498834.238197:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789498834.238203:0:8:0:(import.c:65:import_set_state_nolock()) ffffa076b06fb000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789498834.238214:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 648 00000100:00080000:3.0:1789498834.238221:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789498834.238236:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa076b06fb000 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:3.0:1789498834.238266:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa076a9de7480 x1876424916188416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789498834.238284:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789498834.238288:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789498834.238290:0:8:0:(import.c:65:import_set_state_nolock()) ffffa076beb13800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789498834.238293:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 648 00000100:00080000:3.0:1789498834.238295:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789498834.238301:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa076beb13800 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:3.0:1789498834.238314:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa07587662a00 x1876424916188544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789498834.238338:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789498834.238343:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789498834.238346:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789498834.238349:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789498834.238404:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916188800:0@lo:400:kworker.0 00000100:00100000:3.0:1789498834.238500:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498834.238591:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789498834.238605:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916188416:0@lo:8:kworker.0 00000100:00100000:3.0:1789498834.238609:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39f24317-e976-4eca-a2df-96def568323f:3641:1876424916188160:0@lo:400:kworker.0 00000100:00100000:3.0:1789498834.238640:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498834.238648:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498834.238794:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876424916188928:0@lo:400:kworker.0 00000100:00100000:3.0:1789498834.238826:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498834.238853:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916188288:0@lo:400:kworker.0 00000100:00100000:3.0:1789498834.238876:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498834.238893:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876424916189056:0@lo:400:kworker.0 00000100:00100000:3.0:1789498834.238912:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498834.238928:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789498834.238934:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876424916188672:0@lo:400:kworker.0 00000100:00100000:3.0:1789498834.238955:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498834.238971:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876424916189184:0@lo:400:kworker.0 00000100:00100000:3.0:1789498834.238991:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498834.239016:0:23400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916188800 00000100:00100000:3.0:1789498834.239023:0:23400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916188800 00000100:00100000:3.0:1789498834.239063:0:23400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916188288 00000100:00100000:3.0:1789498834.239065:0:23400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916188288 00000100:00100000:3.0:1789498834.239081:0:23400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789498834.239090:0:23400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07587661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916188800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498834.239157:0:23400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07587661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916188800:12345-0@lo:400:kworker.0 Request processed in 67us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498834.239164:0:23400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789498834.239184:0:23400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789498834.239190:0:23400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876424916188288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498834.239217:0:23400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876424916188288:12345-0@lo:400:kworker.0 Request processed in 28us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498834.239232:0:23400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789498834.239248:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916188160 00000100:00100000:3.0:1789498834.239252:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916188160 00000100:00100000:3.0:1789498834.239271:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789498834.239276:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07682ae9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+21:3641:x1876424916188160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498834.239304:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07682ae9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+21:3641:x1876424916188160:12345-0@lo:400:kworker.0 Request processed in 27us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498834.239310:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789498834.239334:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916188928 00000100:00100000:3.0:1789498834.239337:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916188928 00000100:00100000:3.0:1789498834.239354:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916189056 00000100:00100000:3.0:1789498834.239356:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916189056 00000100:00100000:3.0:1789498834.239365:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916188672 00000100:00100000:3.0:1789498834.239366:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916188672 00000100:00100000:3.0:1789498834.239375:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916189184 00000100:00100000:3.0:1789498834.239377:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916189184 00000100:00100000:3.0:1789498834.239387:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789498834.239392:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876424916188928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498834.239419:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876424916188928:12345-0@lo:400:kworker.0 Request processed in 27us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498834.239425:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789498834.239434:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789498834.239440:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876424916189056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498834.239461:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876424916189056:12345-0@lo:400:kworker.0 Request processed in 22us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498834.239466:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789498834.239475:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789498834.239487:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876424916188672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498834.239512:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876424916188672:12345-0@lo:400:kworker.0 Request processed in 26us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498834.239517:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789498834.239527:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789498834.239565:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876424916189184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498834.239590:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876424916189184:12345-0@lo:400:kworker.0 Request processed in 58us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498834.239595:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789498834.239638:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39f24317-e976-4eca-a2df-96def568323f:3641:1876424916188160:0@lo:400:kworker.0 00010000:00080000:3.0:1789498834.239650:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa07587660380 x1876424916188928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498834.239661:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876424916188928:0@lo:400:kworker.0 00000100:00100000:3.0:1789498834.239670:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916188800:0@lo:400:kworker.0 00010000:00080000:3.0:1789498834.239699:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa07587660000 x1876424916188672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498834.242038:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876424916188672:0@lo:400:kworker.0 00010000:00080000:3.0:1789498834.242092:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa07587662300 x1876424916189184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498834.242104:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876424916189184:0@lo:400:kworker.0 00000100:00100000:3.0:1789498834.242118:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916188288:0@lo:400:kworker.0 00010000:00080000:3.0:1789498834.242133:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa07587661880 x1876424916189056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498834.242849:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876424916189056:0@lo:400:kworker.0 00000100:00100000:1.0:1789498834.254203:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916188544:0@lo:8:kworker.0 00000100:00100000:2.0:1789498834.254221:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916188416 00000100:00100000:2.0:1789498834.254231:0:24167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916188416 00000100:00100000:1.0:1789498834.254271:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498834.257851:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916188544 00000100:00100000:2.0:1789498834.257870:0:24167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916188544 00000100:00100000:2.0:1789498834.257916:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789498834.257927:0:24167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0f3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1876424916188416:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789498834.257968:0:24167:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 668 last 0 00000020:00000080:2.0:1789498834.258009:0:24167:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x70d6b5fa1825e4c3 00002000:00100000:2.0:1789498834.258029:0:24167:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffffa07686755800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789498834.258035:0:24167:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789498834.258038:0:24167:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789498834.258291:0:24167:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789498834.258332:0:24167:0:(import.c:65:import_set_state_nolock()) ffffa07686751000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789498834.258469:0:24167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0f3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1876424916188416:12345-0@lo:8:kworker.0 Request processed in 542us (19819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498834.258477:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789498834.258496:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789498834.258501:0:24167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1876424916188544:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789498834.258517:0:24167:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1789498834.261497:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa076a9de7480 x1876424916188416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789498859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498834.261519:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789498834.261560:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1789498834.261572:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789498834.261579:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789498834.261583:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076b06fb000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789498834.261607:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789498834.261616:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916188416:0@lo:8:kworker.0 00000004:00080000:1.0:1789498834.262151:0:22683:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:1.0:1789498834.262178:0:22683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22683:1876424916189440:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789498834.262258:0:22683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498834.262303:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07684b37300 going to sleep for 11 seconds 00000004:00080000:1.0:1789498834.262327:0:22682:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789498834.262468:0:22682:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 668537934418ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789498834.262476:0:22682:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1789498834.265023:0:22638:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1789498834.265058:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789498834.265079:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876424916189312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498834.265149:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498834.265210:0:24169:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789498834.265221:0:24169:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789498834.266912:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916189312 00000100:00100000:1.0:1789498834.266931:0:24170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916189312 00000100:00100000:1.0:1789498834.267015:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789498834.267026:0:24170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876424916189312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789498834.267066:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789498834.267168:0:24170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876424916189312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (2018us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498834.267177:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789498834.267232:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa076c0f3ea00 x1876424916189312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498850 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498834.267255:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876424916189312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498834.267350:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916189440 00000100:00100000:1.0:1789498834.267355:0:24169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916189440 00000100:00100000:1.0:1789498834.267465:0:24475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789498834.267473:0:24475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22683:x1876424916189440:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:1.0:1789498834.270774:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1789498834.273927:0:24475:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1789498834.273942:0:24475:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:1.0:1789498834.274925:0:24475:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:65) 00000100:00100000:2.0:1789498834.283700:0:24167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1876424916188544:12345-0@lo:8:kworker.0 Request processed in 25189us (29421us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789498834.283725:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789498834.284427:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076beb13800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789498834.285271:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789498834.285279:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916188544:0@lo:8:kworker.0 00002000:00010000:1.0:1789498834.321503:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498834.321518:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bceb968/0x70d6b5fa1825e4ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.321590:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1789498834.321596:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498834.321603:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bceb968/0x70d6b5fa1825e4ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.322025:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bceb968/0x70d6b5fa1825e4ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.322042:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bceb968/0x70d6b5fa1825e4ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.322051:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bceb968/0x70d6b5fa1825e4ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.322080:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498834.322462:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498834.322472:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bceb968/0x70d6b5fa1825e4ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.322482:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075857b1c00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:3.0:1789498834.322487:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bceb968/0x70d6b5fa1825e4ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.322497:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bceb968/0x70d6b5fa1825e4ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.322518:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bceb968/0x70d6b5fa1825e4ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.322525:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bceb968/0x70d6b5fa1825e4ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.322585:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498834.322587:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498834.322589:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498834.323158:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498834.323169:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4494b5d/0x70d6b5fa1825e4d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.323182:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1789498834.323186:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498834.323192:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4494b5d/0x70d6b5fa1825e4d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.323205:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4494b5d/0x70d6b5fa1825e4d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.323216:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4494b5d/0x70d6b5fa1825e4d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.323241:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4494b5d/0x70d6b5fa1825e4d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.323264:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789498834.325157:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498834.325173:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fb9560c/0x70d6b5fa1825e4d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.325189:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1789498834.325193:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498834.325198:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fb9560c/0x70d6b5fa1825e4d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.325212:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fb9560c/0x70d6b5fa1825e4d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.325223:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fb9560c/0x70d6b5fa1825e4d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.325231:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fb9560c/0x70d6b5fa1825e4d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.325260:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789498834.325630:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789498834.325645:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4494b5d/0x70d6b5fa1825e4d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.325654:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075857b1600 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:3.0:1789498834.325659:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4494b5d/0x70d6b5fa1825e4d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.325669:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4494b5d/0x70d6b5fa1825e4d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.325687:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4494b5d/0x70d6b5fa1825e4d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.325694:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4494b5d/0x70d6b5fa1825e4d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.325726:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498834.325730:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fb9560c/0x70d6b5fa1825e4d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.325737:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075857b1a00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:3.0:1789498834.325740:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fb9560c/0x70d6b5fa1825e4d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.325747:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fb9560c/0x70d6b5fa1825e4d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.325772:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fb9560c/0x70d6b5fa1825e4d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.325779:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fb9560c/0x70d6b5fa1825e4d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.325793:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498834.325795:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498834.325796:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498834.325919:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498834.326073:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498834.326079:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5158a96/0x70d6b5fa1825e4df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.326095:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1789498834.326099:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498834.326104:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5158a96/0x70d6b5fa1825e4df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.326115:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5158a96/0x70d6b5fa1825e4df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.326123:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5158a96/0x70d6b5fa1825e4df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.326130:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5158a96/0x70d6b5fa1825e4df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.326154:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789498834.328042:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789498834.328054:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498834.328056:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000781b5eb/0x70d6b5fa1825e4e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.328063:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5158a96/0x70d6b5fa1825e4df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.328071:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075857b0c00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:1.0:1789498834.328072:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=668s v=(0 0) 00010000:00010000:3.0:1789498834.328076:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5158a96/0x70d6b5fa1825e4df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.328076:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498834.328082:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000781b5eb/0x70d6b5fa1825e4e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.328086:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5158a96/0x70d6b5fa1825e4df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.328094:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000781b5eb/0x70d6b5fa1825e4e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.328100:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5158a96/0x70d6b5fa1825e4df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.328107:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5158a96/0x70d6b5fa1825e4df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.328124:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000781b5eb/0x70d6b5fa1825e4e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.328131:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000781b5eb/0x70d6b5fa1825e4e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.328149:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498834.328154:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000781b5eb/0x70d6b5fa1825e4e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.328154:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789498834.328161:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075857b0600 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:3.0:1789498834.328164:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000781b5eb/0x70d6b5fa1825e4e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.328170:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000781b5eb/0x70d6b5fa1825e4e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.328189:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000781b5eb/0x70d6b5fa1825e4e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.328197:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000781b5eb/0x70d6b5fa1825e4e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.328208:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498834.328210:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498834.328212:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498834.328317:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498834.329046:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498834.329054:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb1c6113/0x70d6b5fa1825e4ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.329066:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1789498834.329069:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498834.329073:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb1c6113/0x70d6b5fa1825e4ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.329084:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb1c6113/0x70d6b5fa1825e4ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.329092:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb1c6113/0x70d6b5fa1825e4ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.329100:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb1c6113/0x70d6b5fa1825e4ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.329126:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789498834.329899:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498834.329907:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6ceb83f/0x70d6b5fa1825e4f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.329918:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1789498834.329921:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498834.329925:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6ceb83f/0x70d6b5fa1825e4f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.329935:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6ceb83f/0x70d6b5fa1825e4f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.329943:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6ceb83f/0x70d6b5fa1825e4f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.330002:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6ceb83f/0x70d6b5fa1825e4f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.330025:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789498834.330911:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498834.330922:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009484e992/0x70d6b5fa1825e4fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.330936:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1789498834.330959:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498834.330964:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009484e992/0x70d6b5fa1825e4fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.330975:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009484e992/0x70d6b5fa1825e4fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.330985:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009484e992/0x70d6b5fa1825e4fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.330992:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009484e992/0x70d6b5fa1825e4fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.331000:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789498834.331156:0:22646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789498834.331165:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb1c6113/0x70d6b5fa1825e4ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.331174:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075857b0200 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:1.0:1789498834.331179:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb1c6113/0x70d6b5fa1825e4ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.331191:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb1c6113/0x70d6b5fa1825e4ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.331211:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb1c6113/0x70d6b5fa1825e4ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.331232:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb1c6113/0x70d6b5fa1825e4ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.331252:0:22646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789498834.331256:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6ceb83f/0x70d6b5fa1825e4f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.331262:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c0daa200 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:1.0:1789498834.331265:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6ceb83f/0x70d6b5fa1825e4f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.331273:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6ceb83f/0x70d6b5fa1825e4f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.331281:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6ceb83f/0x70d6b5fa1825e4f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.331288:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6ceb83f/0x70d6b5fa1825e4f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.331299:0:22646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498834.331302:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009484e992/0x70d6b5fa1825e4fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.331309:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c0dab600 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:1.0:1789498834.331318:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009484e992/0x70d6b5fa1825e4fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.331326:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009484e992/0x70d6b5fa1825e4fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.331336:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009484e992/0x70d6b5fa1825e4fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.331342:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009484e992/0x70d6b5fa1825e4fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.331355:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498834.331356:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498834.331358:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498834.331927:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498834.335249:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498834.335267:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa3030d6/0x70d6b5fa1825e502 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.335292:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1789498834.335298:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498834.335306:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa3030d6/0x70d6b5fa1825e502 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.335323:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa3030d6/0x70d6b5fa1825e502 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.335336:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa3030d6/0x70d6b5fa1825e502 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.335351:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa3030d6/0x70d6b5fa1825e502 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.335379:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789498834.337913:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498834.337930:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eeb0608e/0x70d6b5fa1825e509 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.338045:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1789498834.338052:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498834.338059:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eeb0608e/0x70d6b5fa1825e509 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.338074:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eeb0608e/0x70d6b5fa1825e509 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.338085:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eeb0608e/0x70d6b5fa1825e509 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.338093:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eeb0608e/0x70d6b5fa1825e509 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.338117:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789498834.338132:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789498834.338277:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa3030d6/0x70d6b5fa1825e502 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.338286:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c0daba00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:3.0:1789498834.338297:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa3030d6/0x70d6b5fa1825e502 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.338307:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa3030d6/0x70d6b5fa1825e502 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.338326:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa3030d6/0x70d6b5fa1825e502 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.338333:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa3030d6/0x70d6b5fa1825e502 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.338353:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498834.338356:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eeb0608e/0x70d6b5fa1825e509 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.338363:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c0dab400 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:3.0:1789498834.338366:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eeb0608e/0x70d6b5fa1825e509 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.338374:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eeb0608e/0x70d6b5fa1825e509 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.338383:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eeb0608e/0x70d6b5fa1825e509 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.338389:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eeb0608e/0x70d6b5fa1825e509 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.338407:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498834.338409:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498834.338411:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498834.338601:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498834.338608:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000335d654d/0x70d6b5fa1825e510 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.338738:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1789498834.338742:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498834.338748:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000335d654d/0x70d6b5fa1825e510 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.338759:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000335d654d/0x70d6b5fa1825e510 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.338768:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000335d654d/0x70d6b5fa1825e510 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.338777:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000335d654d/0x70d6b5fa1825e510 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.338797:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498834.338873:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498834.338878:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000335d654d/0x70d6b5fa1825e510 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.338885:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c0daa000 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:3.0:1789498834.338888:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000335d654d/0x70d6b5fa1825e510 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.338895:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000335d654d/0x70d6b5fa1825e510 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.338906:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000335d654d/0x70d6b5fa1825e510 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.338913:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000335d654d/0x70d6b5fa1825e510 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.338928:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498834.338929:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498834.338931:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498834.340299:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498834.340308:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1fc21f/0x70d6b5fa1825e517 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.340321:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1789498834.340325:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498834.340330:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fc21f/0x70d6b5fa1825e517 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.340341:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad1fc21f/0x70d6b5fa1825e517 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.340361:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad1fc21f/0x70d6b5fa1825e517 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.340369:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad1fc21f/0x70d6b5fa1825e517 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.340392:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498834.340528:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498834.340559:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad1fc21f/0x70d6b5fa1825e517 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.340579:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c0daaa00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:3.0:1789498834.340583:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1fc21f/0x70d6b5fa1825e517 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.340592:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad1fc21f/0x70d6b5fa1825e517 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.340606:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad1fc21f/0x70d6b5fa1825e517 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.340612:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad1fc21f/0x70d6b5fa1825e517 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.340629:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498834.340631:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498834.340632:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498834.340808:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498834.340884:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bb57326/0x70d6b5fa1825e51e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.340892:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1789498834.340895:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498834.340899:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bb57326/0x70d6b5fa1825e51e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.340909:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bb57326/0x70d6b5fa1825e51e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.340917:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bb57326/0x70d6b5fa1825e51e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.340924:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bb57326/0x70d6b5fa1825e51e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.341759:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789498834.342194:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498834.342202:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c6e9a94/0x70d6b5fa1825e525 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.342214:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1789498834.342218:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498834.342222:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c6e9a94/0x70d6b5fa1825e525 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.342233:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c6e9a94/0x70d6b5fa1825e525 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.342242:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c6e9a94/0x70d6b5fa1825e525 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.342249:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c6e9a94/0x70d6b5fa1825e525 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.342257:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789498834.342330:0:22646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789498834.342338:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bb57326/0x70d6b5fa1825e51e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.342347:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c0dabc00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498834.342351:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bb57326/0x70d6b5fa1825e51e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.342360:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bb57326/0x70d6b5fa1825e51e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.342376:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bb57326/0x70d6b5fa1825e51e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.342384:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bb57326/0x70d6b5fa1825e51e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.342401:0:22646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498834.342404:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c6e9a94/0x70d6b5fa1825e525 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.342411:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c0daa600 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498834.342415:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c6e9a94/0x70d6b5fa1825e525 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.342435:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c6e9a94/0x70d6b5fa1825e525 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.342446:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c6e9a94/0x70d6b5fa1825e525 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.342453:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c6e9a94/0x70d6b5fa1825e525 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.342467:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498834.342469:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498834.342470:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498834.342504:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498834.342509:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd0e9c6c/0x70d6b5fa1825e52c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.342517:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1789498834.342525:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498834.342529:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd0e9c6c/0x70d6b5fa1825e52c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.342564:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd0e9c6c/0x70d6b5fa1825e52c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.342572:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd0e9c6c/0x70d6b5fa1825e52c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.342578:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd0e9c6c/0x70d6b5fa1825e52c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.342597:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498834.342627:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498834.342632:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd0e9c6c/0x70d6b5fa1825e52c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.342639:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c0daa400 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:3.0:1789498834.342642:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd0e9c6c/0x70d6b5fa1825e52c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.342650:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd0e9c6c/0x70d6b5fa1825e52c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.342679:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd0e9c6c/0x70d6b5fa1825e52c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.342687:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd0e9c6c/0x70d6b5fa1825e52c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.343077:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498834.343079:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498834.343081:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498834.344014:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498834.344024:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000521af4d5/0x70d6b5fa1825e533 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.344037:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1789498834.344040:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498834.344045:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000521af4d5/0x70d6b5fa1825e533 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.344055:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000521af4d5/0x70d6b5fa1825e533 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.344064:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000521af4d5/0x70d6b5fa1825e533 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.344076:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000521af4d5/0x70d6b5fa1825e533 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.344095:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498834.344274:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498834.344281:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000521af4d5/0x70d6b5fa1825e533 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.344448:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498834.344472:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498834.344478:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff27f7af/0x70d6b5fa1825e53a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.344482:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c0daa800 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:3.0:1789498834.344486:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000521af4d5/0x70d6b5fa1825e533 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.344487:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1789498834.344490:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498834.344494:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff27f7af/0x70d6b5fa1825e53a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.344497:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000521af4d5/0x70d6b5fa1825e533 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.344504:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff27f7af/0x70d6b5fa1825e53a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.344512:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff27f7af/0x70d6b5fa1825e53a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.344516:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000521af4d5/0x70d6b5fa1825e533 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.344520:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff27f7af/0x70d6b5fa1825e53a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498834.344525:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000521af4d5/0x70d6b5fa1825e533 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.344556:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498834.344567:0:22646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498834.344799:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498834.344801:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498834.344803:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498834.345055:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498834.345061:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000526a7d79/0x70d6b5fa1825e541 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.345075:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1789498834.345078:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498834.345082:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000526a7d79/0x70d6b5fa1825e541 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.345091:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000526a7d79/0x70d6b5fa1825e541 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.345099:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000526a7d79/0x70d6b5fa1825e541 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.345106:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000526a7d79/0x70d6b5fa1825e541 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.345126:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498834.346813:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498834.346825:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000526a7d79/0x70d6b5fa1825e541 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.346837:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c0dab800 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498834.346842:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000526a7d79/0x70d6b5fa1825e541 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.346853:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000526a7d79/0x70d6b5fa1825e541 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.346870:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000526a7d79/0x70d6b5fa1825e541 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.346889:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000526a7d79/0x70d6b5fa1825e541 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.346910:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498834.346912:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498834.346913:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498834.347106:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498834.347114:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d28592b/0x70d6b5fa1825e548 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.347125:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1789498834.347129:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498834.347134:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d28592b/0x70d6b5fa1825e548 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.347145:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d28592b/0x70d6b5fa1825e548 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.347167:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d28592b/0x70d6b5fa1825e548 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.347175:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d28592b/0x70d6b5fa1825e548 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.347195:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789498834.348315:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498834.348329:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4619990/0x70d6b5fa1825e54f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.348344:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1789498834.348348:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498834.348355:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4619990/0x70d6b5fa1825e54f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.348367:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4619990/0x70d6b5fa1825e54f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.348377:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4619990/0x70d6b5fa1825e54f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.348386:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4619990/0x70d6b5fa1825e54f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.348407:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789498834.349824:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789498834.349837:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d28592b/0x70d6b5fa1825e548 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.349852:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c0dab000 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498834.349858:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d28592b/0x70d6b5fa1825e548 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.349871:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d28592b/0x70d6b5fa1825e548 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.349894:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d28592b/0x70d6b5fa1825e548 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.349902:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d28592b/0x70d6b5fa1825e548 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.349929:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498834.349936:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4619990/0x70d6b5fa1825e54f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.349959:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c0dabe00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498834.349962:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4619990/0x70d6b5fa1825e54f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.349970:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4619990/0x70d6b5fa1825e54f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.349980:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4619990/0x70d6b5fa1825e54f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.349986:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4619990/0x70d6b5fa1825e54f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.349998:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498834.349999:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498834.350001:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498834.350154:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498834.350162:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f080acf/0x70d6b5fa1825e556 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.350173:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1789498834.350177:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498834.350183:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f080acf/0x70d6b5fa1825e556 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.350194:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f080acf/0x70d6b5fa1825e556 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.350202:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f080acf/0x70d6b5fa1825e556 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.350209:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f080acf/0x70d6b5fa1825e556 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.350234:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789498834.350630:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498834.350635:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f44cc6d1/0x70d6b5fa1825e55d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.350644:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1789498834.350654:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498834.350659:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f44cc6d1/0x70d6b5fa1825e55d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.350910:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f44cc6d1/0x70d6b5fa1825e55d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.350921:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f44cc6d1/0x70d6b5fa1825e55d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.350928:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f44cc6d1/0x70d6b5fa1825e55d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.350937:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789498834.351296:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789498834.351302:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f080acf/0x70d6b5fa1825e556 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.351310:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c0daae00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498834.351313:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f080acf/0x70d6b5fa1825e556 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.351321:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f080acf/0x70d6b5fa1825e556 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.351343:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f080acf/0x70d6b5fa1825e556 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.351349:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f080acf/0x70d6b5fa1825e556 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.351365:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498834.351368:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f44cc6d1/0x70d6b5fa1825e55d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.351374:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c0daac00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498834.351378:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f44cc6d1/0x70d6b5fa1825e55d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.351386:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f44cc6d1/0x70d6b5fa1825e55d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.351395:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f44cc6d1/0x70d6b5fa1825e55d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.351401:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f44cc6d1/0x70d6b5fa1825e55d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.351411:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498834.351413:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498834.351420:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498834.351919:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498834.351927:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6111b8a/0x70d6b5fa1825e564 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.351941:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1789498834.352011:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498834.352018:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6111b8a/0x70d6b5fa1825e564 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.352031:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6111b8a/0x70d6b5fa1825e564 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.352041:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6111b8a/0x70d6b5fa1825e564 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.352052:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6111b8a/0x70d6b5fa1825e564 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.352072:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789498834.352931:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498834.352940:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093f778e6/0x70d6b5fa1825e56b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.353012:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1789498834.353016:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498834.353020:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093f778e6/0x70d6b5fa1825e56b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.353031:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093f778e6/0x70d6b5fa1825e56b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.353039:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093f778e6/0x70d6b5fa1825e56b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.353047:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093f778e6/0x70d6b5fa1825e56b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.353056:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789498834.353295:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789498834.353303:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6111b8a/0x70d6b5fa1825e564 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.353313:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0758564fa00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498834.353318:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6111b8a/0x70d6b5fa1825e564 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.353328:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6111b8a/0x70d6b5fa1825e564 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.353344:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6111b8a/0x70d6b5fa1825e564 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.353351:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6111b8a/0x70d6b5fa1825e564 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.353369:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498834.353372:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093f778e6/0x70d6b5fa1825e56b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.353378:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0758564f400 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498834.353381:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093f778e6/0x70d6b5fa1825e56b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.353388:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093f778e6/0x70d6b5fa1825e56b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.353405:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093f778e6/0x70d6b5fa1825e56b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.353413:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093f778e6/0x70d6b5fa1825e56b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.353424:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498834.353426:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498834.353428:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498834.353890:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498834.353897:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f99cd098/0x70d6b5fa1825e572 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.353912:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1789498834.353916:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498834.353920:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f99cd098/0x70d6b5fa1825e572 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.353930:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f99cd098/0x70d6b5fa1825e572 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.353939:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f99cd098/0x70d6b5fa1825e572 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.354004:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f99cd098/0x70d6b5fa1825e572 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.354030:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789498834.354908:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498834.354918:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1286c14/0x70d6b5fa1825e579 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.354929:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1789498834.354932:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498834.354937:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1286c14/0x70d6b5fa1825e579 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.354958:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1286c14/0x70d6b5fa1825e579 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.354980:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1286c14/0x70d6b5fa1825e579 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.354987:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1286c14/0x70d6b5fa1825e579 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.354996:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789498834.355366:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789498834.355373:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f99cd098/0x70d6b5fa1825e572 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.355382:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0758564e000 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498834.355386:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f99cd098/0x70d6b5fa1825e572 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.355396:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f99cd098/0x70d6b5fa1825e572 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.355410:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f99cd098/0x70d6b5fa1825e572 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.355418:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f99cd098/0x70d6b5fa1825e572 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.355445:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1789498834.355447:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789498834.355449:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1286c14/0x70d6b5fa1825e579 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.355452:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004feb8ff5/0x70d6b5fa1825e580 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.355456:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0758564ea00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498834.355459:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1286c14/0x70d6b5fa1825e579 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.355461:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1789498834.355464:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498834.355469:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1286c14/0x70d6b5fa1825e579 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.355469:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004feb8ff5/0x70d6b5fa1825e580 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.355478:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004feb8ff5/0x70d6b5fa1825e580 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.355479:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1286c14/0x70d6b5fa1825e579 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.355487:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1286c14/0x70d6b5fa1825e579 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.355487:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004feb8ff5/0x70d6b5fa1825e580 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.355494:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004feb8ff5/0x70d6b5fa1825e580 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.355498:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498834.355500:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498834.355501:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498834.355561:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498834.355682:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498834.355687:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004feb8ff5/0x70d6b5fa1825e580 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.355694:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0758564fc00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498834.356254:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004feb8ff5/0x70d6b5fa1825e580 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.356265:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004feb8ff5/0x70d6b5fa1825e580 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.356278:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004feb8ff5/0x70d6b5fa1825e580 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.356285:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004feb8ff5/0x70d6b5fa1825e580 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.356300:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498834.356302:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498834.356304:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789498834.357915:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789498834.357929:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000268f5bd0/0x70d6b5fa1825e587 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.357946:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=668s v=(0 0) 00010000:00010000:2.0:1789498834.357950:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498834.357957:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000268f5bd0/0x70d6b5fa1825e587 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.357971:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000268f5bd0/0x70d6b5fa1825e587 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.357980:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000268f5bd0/0x70d6b5fa1825e587 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.358000:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000268f5bd0/0x70d6b5fa1825e587 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.358029:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498834.358371:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498834.358380:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000268f5bd0/0x70d6b5fa1825e587 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.358388:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c1571c00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:1.0:1789498834.358392:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000268f5bd0/0x70d6b5fa1825e587 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.358401:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000268f5bd0/0x70d6b5fa1825e587 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.358419:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000268f5bd0/0x70d6b5fa1825e587 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.358425:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000268f5bd0/0x70d6b5fa1825e587 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.358443:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498834.358445:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498834.358447:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498834.358918:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498834.358921:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498834.358923:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498834.359038:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff27f7af/0x70d6b5fa1825e53a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.359050:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c0dab200 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:1.0:1789498834.359062:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff27f7af/0x70d6b5fa1825e53a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.359071:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff27f7af/0x70d6b5fa1825e53a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.359083:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff27f7af/0x70d6b5fa1825e53a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.359090:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff27f7af/0x70d6b5fa1825e53a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.359108:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498834.359110:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498834.359111:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498834.361807:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498834.361821:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d22d22e1/0x70d6b5fa1825e58e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.361837:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1789498834.361842:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498834.361848:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d22d22e1/0x70d6b5fa1825e58e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.361862:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d22d22e1/0x70d6b5fa1825e58e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.361872:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d22d22e1/0x70d6b5fa1825e58e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.361888:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d22d22e1/0x70d6b5fa1825e58e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.361907:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789498834.363588:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498834.363600:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c4bf66b/0x70d6b5fa1825e595 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.363615:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1789498834.363619:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498834.363631:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c4bf66b/0x70d6b5fa1825e595 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.363644:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c4bf66b/0x70d6b5fa1825e595 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.363655:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c4bf66b/0x70d6b5fa1825e595 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.363662:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c4bf66b/0x70d6b5fa1825e595 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.363687:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789498834.364290:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498834.364298:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2db8bd4/0x70d6b5fa1825e59c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.364315:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1789498834.364318:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498834.364323:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2db8bd4/0x70d6b5fa1825e59c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.364333:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2db8bd4/0x70d6b5fa1825e59c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.364341:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2db8bd4/0x70d6b5fa1825e59c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.364349:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2db8bd4/0x70d6b5fa1825e59c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.364366:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789498834.364377:0:22646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789498834.364383:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d22d22e1/0x70d6b5fa1825e58e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.364391:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0758564e600 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:1.0:1789498834.364396:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d22d22e1/0x70d6b5fa1825e58e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.364404:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d22d22e1/0x70d6b5fa1825e58e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.364432:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d22d22e1/0x70d6b5fa1825e58e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.364440:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d22d22e1/0x70d6b5fa1825e58e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.364460:0:22646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789498834.364463:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c4bf66b/0x70d6b5fa1825e595 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.364470:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0758564e400 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:1.0:1789498834.364474:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4bf66b/0x70d6b5fa1825e595 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.364481:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c4bf66b/0x70d6b5fa1825e595 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.364490:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c4bf66b/0x70d6b5fa1825e595 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.364496:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c4bf66b/0x70d6b5fa1825e595 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.364506:0:22646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498834.364510:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2db8bd4/0x70d6b5fa1825e59c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.364522:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0758564e800 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:1.0:1789498834.364525:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2db8bd4/0x70d6b5fa1825e59c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.364561:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2db8bd4/0x70d6b5fa1825e59c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.364573:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2db8bd4/0x70d6b5fa1825e59c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.364579:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2db8bd4/0x70d6b5fa1825e59c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.364592:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498834.364594:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498834.364596:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498834.365512:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498834.365520:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498834.372731:0:24475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498834.372751:0:24475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2db8bd4/0x70d6b5fa1825e5a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.372777:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=668s v=(0 0) 00010000:00010000:1.0:1789498834.372783:0:24475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498834.372791:0:24475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2db8bd4/0x70d6b5fa1825e5a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.372819:0:24475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2db8bd4/0x70d6b5fa1825e5a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.372841:0:24475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2db8bd4/0x70d6b5fa1825e5a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.372849:0:24475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2db8bd4/0x70d6b5fa1825e5a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498834.372869:0:24475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1789498834.373200:0:24475:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:1.0:1789498834.373321:0:24475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22683:x1876424916189440:12345-0@lo:5:osp-pre-0-0.0 Request processed in 105845us (111059us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498834.373334:0:24475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789498834.373405:0:22683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22683:1876424916189440:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789498834.373423:0:22683:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:1.0:1789498834.373477:0:22683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22683:1876424916189568:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789498834.373514:0:22683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498834.373564:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffffa075876b0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789498834.373583:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916189568 00000100:00100000:1.0:1789498834.373590:0:24169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916189568 00000100:00100000:1.0:1789498834.373645:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789498834.373654:0:24169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22683:x1876424916189568:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789498834.373696:0:24169:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:2.0:1789498834.375930:0:22646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498834.375951:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2db8bd4/0x70d6b5fa1825e5a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.375965:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0758564e800 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498834.376015:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2db8bd4/0x70d6b5fa1825e5a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.376029:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2db8bd4/0x70d6b5fa1825e5a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.376051:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2db8bd4/0x70d6b5fa1825e5a3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.376060:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2db8bd4/0x70d6b5fa1825e5a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498834.376095:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498834.376098:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498834.376100:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789498834.381424:0:24163:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:0.0:1789498834.382398:0:24163:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789498834.382637:0:24169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22683:x1876424916189568:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8979us (9118us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1789498834.382650:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789498834.382905:0:22683:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1789498834.382915:0:22683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22683:1876424916189568:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789498834.382932:0:22683:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:2.0:1789498834.427712:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498834.876931:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498834.881032:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916189696:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789498834.881371:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498834.886370:0:23400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916189696 00000100:00100000:2.0:1789498834.886390:0:23400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916189696 00000100:00100000:2.0:1789498834.887829:0:23400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789498834.887847:0:23400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075883d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916189696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789498834.887900:0:23400:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789498834.887985:0:23400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075883d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916189696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 145us (6616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498834.887993:0:23400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789498834.890239:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916189696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789498835.263431:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789498820/real 1789498820] req@ffffa07586724000 x1876424916180736/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498835 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498835.263466:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa07586724000 x1876424916180736/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498835 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498835.263476:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789498820/real 1789498820] req@ffffa07586725880 x1876424916180864/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498835 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498835.263486:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa07586725880 x1876424916180864/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789498835 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789498835.263506:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa07587559000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789498835.263629:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789498835.263635:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876424916180736:0@lo:8:kworker.0 00000100:00080000:1.0:1789498835.263903:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789498835.263907:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789498835.263910:0:8:0:(import.c:65:import_set_state_nolock()) ffffa076beb13800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789498835.263915:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 668 00000100:00080000:1.0:1789498835.263920:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789498835.263944:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa076beb13800 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:1.0:1789498835.263964:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa076c0f3e300 x1876424916190080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789498835.264000:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789498835.264003:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789498835.264005:0:8:0:(import.c:65:import_set_state_nolock()) ffffa07587559000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789498835.264008:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 654 00000100:00080000:1.0:1789498835.264011:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789498835.264015:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffffa07587559000 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:1.0:1789498835.264026:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa076c0f3d500 x1876424916190464/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789498835.264034:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789498835.264037:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789498835.264071:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876424916189952:0@lo:400:kworker.0 00000100:00100000:2.0:1789498835.264394:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39f24317-e976-4eca-a2df-96def568323f:3643:1876424916189824:0@lo:400:kworker.0 00000100:00100000:2.0:1789498835.264679:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498835.264733:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876424916190592:0@lo:400:kworker.0 00000100:00100000:2.0:1789498835.264762:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498835.264838:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916189824 00000100:00100000:2.0:1789498835.264847:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916189824 00000100:00100000:2.0:1789498835.264894:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789498835.264904:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07682ae8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+21:3643:x1876424916189824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498835.264966:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07682ae8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+21:3643:x1876424916189824:12345-0@lo:400:kworker.0 Request processed in 63us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498835.264972:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789498835.265006:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916190592 00000100:00100000:2.0:1789498835.265010:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916190592 00000100:00100000:2.0:1789498835.265049:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789498835.265054:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876424916190592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498835.265117:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876424916190592:12345-0@lo:400:kworker.0 Request processed in 62us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498835.265123:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789498835.265218:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39f24317-e976-4eca-a2df-96def568323f:3643:1876424916189824:0@lo:400:kworker.0 00010000:00080000:2.0:1789498835.265234:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa076c0f3c380 x1876424916190592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498835.265275:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876424916190592:0@lo:400:kworker.0 00000100:00100000:1.0:1789498835.265706:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498835.265734:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876424916190720:0@lo:400:kworker.0 00000100:00100000:1.0:1789498835.265762:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498835.265834:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876424916190208:0@lo:400:kworker.0 00000100:00100000:1.0:1789498835.265861:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498835.265891:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876424916190848:0@lo:400:kworker.0 00000100:00100000:1.0:1789498835.265917:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498835.265948:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789498835.265954:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916190336:0@lo:400:kworker.0 00000100:00100000:1.0:1789498835.265975:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498835.266005:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916190720 00000100:00100000:1.0:1789498835.266011:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916190720 00000100:00100000:1.0:1789498835.266043:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916190208 00000100:00100000:1.0:1789498835.266046:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916190208 00000100:00100000:1.0:1789498835.266057:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916190848 00000100:00100000:1.0:1789498835.266059:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916190848 00000100:00100000:1.0:1789498835.266076:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789498835.266083:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876424916190720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498835.266363:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876424916190720:12345-0@lo:400:kworker.0 Request processed in 280us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498835.266370:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789498835.266385:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789498835.266390:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876424916190208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498835.266418:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876424916190208:12345-0@lo:400:kworker.0 Request processed in 28us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498835.266423:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789498835.266433:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789498835.266438:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876424916190848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498835.266461:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876424916190848:12345-0@lo:400:kworker.0 Request processed in 24us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498835.266466:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789498835.266482:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916190336 00000100:00100000:1.0:1789498835.266492:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916190336 00000100:00100000:1.0:1789498835.266519:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789498835.266556:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916190336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498835.266588:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916190336:12345-0@lo:400:kworker.0 Request processed in 64us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498835.266595:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1789498835.266610:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789498835.266615:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498835.266653:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916190336:0@lo:400:kworker.0 00010000:00080000:1.0:1789498835.266664:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa076c0f3d180 x1876424916190208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498835.266673:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876424916190208:0@lo:400:kworker.0 00010000:00080000:1.0:1789498835.266743:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa076c0f3e680 x1876424916190848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498835.266752:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876424916190848:0@lo:400:kworker.0 00010000:00080000:1.0:1789498835.266783:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa076c0f3df80 x1876424916190720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498835.266854:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876424916190720:0@lo:400:kworker.0 00000100:00100000:2.0:1789498835.267258:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916189952 00000100:00100000:2.0:1789498835.267263:0:24167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916189952 00000100:00100000:2.0:1789498835.267309:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789498835.267317:0:24167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0f3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876424916189952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498835.267358:0:24167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0f3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876424916189952:12345-0@lo:400:kworker.0 Request processed in 43us (1654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498835.267365:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789498835.267552:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876424916189952:0@lo:400:kworker.0 00000100:00080000:1.0:1789498835.267571:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa07587142800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789498835.267583:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789498835.267587:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876424916180864:0@lo:8:kworker.0 00000100:00100000:1.0:1789498835.267607:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916190080:0@lo:8:kworker.0 00000100:00100000:1.0:1789498835.267651:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498835.267696:0:24475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916190080 00000100:00100000:1.0:1789498835.267700:0:24475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916190080 00000100:00100000:1.0:1789498835.267719:0:24475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789498835.267724:0:24475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0f3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1876424916190080:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789498835.267743:0:24475:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789498835.267770:0:24475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0f3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1876424916190080:12345-0@lo:8:kworker.0 Request processed in 44us (119us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789498835.267775:0:24475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789498835.267897:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789498835.267902:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789498835.267905:0:8:0:(import.c:65:import_set_state_nolock()) ffffa07587142800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789498835.267910:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 654 00000100:00080000:2.0:1789498835.267914:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789498835.267922:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffffa07587142800 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:2.0:1789498835.267961:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa07586727100 x1876424916190976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789498835.268203:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076beb13800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789498835.268208:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789498835.268211:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916190080:0@lo:8:kworker.0 00000100:00100000:1.0:1789498835.268219:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876424916190464:0@lo:8:kworker.0 00000100:00100000:1.0:1789498835.268246:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498835.268293:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876424916190976:0@lo:8:kworker.0 00000100:00100000:1.0:1789498835.268314:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498835.268333:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916190464 00000100:00100000:1.0:1789498835.268336:0:24168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916190464 00000100:00100000:1.0:1789498835.268351:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916190976 00000100:00100000:1.0:1789498835.268354:0:24168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916190976 00000100:00100000:1.0:1789498835.268365:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789498835.268369:0:24168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1876424916190464:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789498835.268388:0:24168:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 669 last 0 00000020:00000080:1.0:1789498835.268427:0:24168:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x70d6b5fa1825e5aa 00002000:00100000:1.0:1789498835.268443:0:24168:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffffa076981d5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1789498835.268459:0:24168:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1789498835.268463:0:24168:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789498835.268569:0:24168:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1789498835.268593:0:24168:0:(import.c:65:import_set_state_nolock()) ffffa076981d1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789498835.268631:0:24168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1876424916190464:12345-0@lo:8:kworker.0 Request processed in 260us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498835.268638:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789498835.268652:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789498835.268669:0:24168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1876424916190976:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789498835.269201:0:24168:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789498835.269258:0:24168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1876424916190976:12345-0@lo:8:kworker.0 Request processed in 587us (941us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789498835.269265:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1789498835.269311:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa07587142800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789498835.269315:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789498835.269319:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876424916190976:0@lo:8:kworker.0 00000100:00100000:1.0:1789498835.269331:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789498835.269338:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1789498835.269345:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789498835.269350:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789498835.269353:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa07587559000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789498835.269377:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789498835.269381:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876424916190464:0@lo:8:kworker.0 00000004:00080000:1.0:1789498835.269430:0:23402:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789498835.269451:0:23402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23402:1876424916191232:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1789498835.269485:0:23402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498835.269500:0:23402:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a9c286c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498835.269512:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876424916191104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789498835.269567:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498835.269596:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916191104 00000100:00100000:1.0:1789498835.269601:0:24170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916191104 00000100:00100000:1.0:1789498835.269638:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789498835.269646:0:24170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1876424916191104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789498835.269788:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789498835.269903:0:24170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1876424916191104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 258us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498835.269910:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789498835.269996:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789498835.270026:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876424916191104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789498835.270046:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916191232 00000100:00100000:1.0:1789498835.270049:0:24168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916191232 00000100:00100000:1.0:1789498835.270070:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789498835.270075:0:24168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23402:x1876424916191232:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1789498835.270579:0:23401:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789498835.270688:0:23401:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 669546147560ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789498835.270696:0:23401:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1789498835.273558:0:23391:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:1.0:1789498835.274427:0:24168:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789498835.274436:0:24168:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1789498835.275369:0:24168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23402:x1876424916191232:12345-0@lo:7:osp-pre-0-1.0 Request processed in 5287us (5877us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498835.275380:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789498835.277965:0:23402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23402:1876424916191232:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1789498835.277983:0:23402:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:2.0:1789498835.278027:0:23402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586727100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23402:1876424916191360:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789498835.278091:0:23402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498835.278297:0:23402:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07684c64cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498835.278422:0:24475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916191360 00000100:00100000:1.0:1789498835.278431:0:24475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916191360 00000100:00100000:1.0:1789498835.278505:0:24475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789498835.278516:0:24475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23402:x1876424916191360:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789498835.278576:0:24475:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1789498835.278616:0:24475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23402:x1876424916191360:12345-0@lo:5:osp-pre-0-1.0 Request processed in 103us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498835.278624:0:24475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789498835.279846:0:23402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586727100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23402:1876424916191360:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1789498835.279863:0:23402:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1789498835.279905:0:23402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586727100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23402:1876424916191488:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789498835.279958:0:23402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498835.279982:0:23402:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07684c64cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789498835.279999:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916191488 00000100:00100000:2.0:1789498835.280003:0:24169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916191488 00000100:00100000:2.0:1789498835.280034:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789498835.280041:0:24169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23402:x1876424916191488:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1789498835.280078:0:24169:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:3.0:1789498835.304513:0:24163:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:3.0:1789498835.304566:0:24163:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1789498835.306010:0:24169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23402:x1876424916191488:12345-0@lo:5:osp-pre-0-1.0 Request processed in 25957us (26038us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1789498835.306030:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789498835.311064:0:23402:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1789498835.311082:0:23402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586727100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23402:1876424916191488:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1789498835.311100:0:23402:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1789498835.312193:0:23402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587662a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23402:1876424916191616:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789498835.312277:0:23402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498835.312318:0:23402:0:(client.c:2716:ptlrpc_set_wait()) set ffffa0758567b540 going to sleep for 11 seconds 00000100:00100000:1.0:1789498835.312453:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916191616 00000100:00100000:1.0:1789498835.312462:0:22670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916191616 00000100:00100000:1.0:1789498835.312514:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789498835.312556:0:22670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07587661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23402:x1876424916191616:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1789498835.312614:0:22670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07587661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23402:x1876424916191616:12345-0@lo:900:osp-pre-0-1.0 Request processed in 92us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498835.312622:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789498835.313038:0:23402:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa07587662a00 x1876424916191616/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789498851 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498835.313054:0:23402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587662a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23402:1876424916191616:0@lo:900:osp-pre-0-1.0 00000001:02000400:2.0:1789498835.359388:0:24534:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg417-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789498835.452080:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498835.900875:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916191744:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789498835.901396:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498835.901460:0:23400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916191744 00000100:00100000:2.0:1789498835.901469:0:23400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916191744 00000100:00100000:2.0:1789498835.901558:0:23400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789498835.901570:0:23400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916191744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789498835.901636:0:23400:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789498835.903882:0:23400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916191744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2301us (2473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498835.903899:0:23400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789498835.905117:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916191744:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789498836.475734:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789498836.848391:0:24587:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789498836.849510:0:24587:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789498837.504065:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789498837.967740:0:24637:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789498837.968237:0:24637:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789498838.523822:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498839.485793:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789498839.485817:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916191872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498839.485897:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498839.485957:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916191872 00000100:00100000:3.0:1789498839.485976:0:24170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916191872 00000100:00100000:3.0:1789498839.486035:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789498839.486043:0:24170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07587662300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876424916191872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498839.486074:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789498839.486127:0:24170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07587662300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876424916191872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498839.486134:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789498839.486152:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498839.486185:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916191872:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789498839.551461:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498839.995756:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916192000:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789498839.995862:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498839.997833:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916192000 00000100:00100000:0.0:1789498839.997848:0:22663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916192000 00000100:00100000:0.0:1789498839.997932:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789498839.997943:0:22663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07587662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916192000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789498839.997992:0:22663:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789498840.002328:0:22663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07587662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916192000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4374us (6453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498840.002346:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789498840.013201:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916192000:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1789498840.508336:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789498840.508343:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789498840.508346:0:8:0:(import.c:65:import_set_state_nolock()) ffffa076beb13800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789498840.508355:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 669 00000100:00080000:3.0:1789498840.508360:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789498840.508373:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa076beb13800 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:3.0:1789498840.508398:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa07587660380 x1876424916192384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789498840.508449:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789498840.508452:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789498840.508454:0:8:0:(import.c:65:import_set_state_nolock()) ffffa07587142800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789498840.508458:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 669 00000100:00080000:3.0:1789498840.508461:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789498840.508476:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffffa07587142800 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:3.0:1789498840.508494:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa07684c17800 x1876424916192896/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789498840.508656:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39f24317-e976-4eca-a2df-96def568323f:3642:1876424916192128:0@lo:400:kworker.0 00000100:00100000:0.0:1789498840.508733:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498840.508778:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876424916192768:0@lo:400:kworker.0 00000100:00100000:0.0:1789498840.508807:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498840.508836:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789498840.508842:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876424916192640:0@lo:400:kworker.0 00000100:00100000:0.0:1789498840.508865:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498840.508885:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07684c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876424916193280:0@lo:400:kworker.0 00000100:00100000:0.0:1789498840.508910:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498840.508942:0:24475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916192768 00000100:00100000:0.0:1789498840.508951:0:24475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916192768 00000100:00100000:0.0:1789498840.509018:0:24475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789498840.509030:0:24475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876424916192768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498840.509093:0:24475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876424916192768:12345-0@lo:400:kworker.0 Request processed in 65us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498840.509100:0:24475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789498840.509125:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916193280 00000100:00100000:0.0:1789498840.509129:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916193280 00000100:00100000:0.0:1789498840.509158:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789498840.509165:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876424916193280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498840.509195:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876424916193280:12345-0@lo:400:kworker.0 Request processed in 32us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498840.509201:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1789498840.509239:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa07684c15180 x1876424916193280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498840.509253:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07684c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876424916193280:0@lo:400:kworker.0 00000100:00100000:0.0:1789498840.509264:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876424916192768:0@lo:400:kworker.0 00000100:00100000:3.0:1789498840.509324:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916192256:0@lo:400:kworker.0 00000100:00100000:3.0:1789498840.509353:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498840.509381:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07684c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876424916193024:0@lo:400:kworker.0 00000100:00100000:3.0:1789498840.509402:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498840.509432:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789498840.509439:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876424916192512:0@lo:400:kworker.0 00000100:00100000:3.0:1789498840.509461:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498840.509477:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07684c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876424916193152:0@lo:400:kworker.0 00000100:00100000:3.0:1789498840.509497:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498840.509524:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916192384:0@lo:8:kworker.0 00000100:00100000:3.0:1789498840.509642:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498840.509659:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07684c17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876424916192896:0@lo:8:kworker.0 00000100:00100000:3.0:1789498840.509686:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498840.509717:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916192128 00000100:00100000:3.0:1789498840.509722:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916192128 00000100:00100000:3.0:1789498840.509752:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789498840.509758:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07682aeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+21:3642:x1876424916192128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498840.509796:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07682aeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+21:3642:x1876424916192128:12345-0@lo:400:kworker.0 Request processed in 38us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498840.509803:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1789498840.509834:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789498840.509839:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498840.509857:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916193024 00000100:00100000:3.0:1789498840.509861:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916193024 00000100:00100000:3.0:1789498840.509879:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916192512 00000100:00100000:3.0:1789498840.509883:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916192512 00000100:00100000:3.0:1789498840.509893:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916193152 00000100:00100000:3.0:1789498840.509896:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916193152 00000100:00100000:3.0:1789498840.509916:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789498840.509921:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07684c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876424916193024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498840.509957:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07684c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876424916193024:12345-0@lo:400:kworker.0 Request processed in 36us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498840.509964:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789498840.509976:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789498840.509982:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07684c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876424916192512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498840.510010:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07684c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876424916192512:12345-0@lo:400:kworker.0 Request processed in 29us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498840.510016:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789498840.510026:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789498840.510032:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07684c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876424916193152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498840.510052:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07684c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876424916193152:12345-0@lo:400:kworker.0 Request processed in 21us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498840.510058:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1789498840.510068:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789498840.510086:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa076a9de7480 x1876424916192512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498840.510098:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876424916192512:0@lo:400:kworker.0 00010000:00080000:3.0:1789498840.510109:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa07684c15c00 x1876424916193152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498840.510128:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07684c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1876424916193152:0@lo:400:kworker.0 00010000:00080000:3.0:1789498840.510139:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa07684c14a80 x1876424916193024/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498840.510147:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07684c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876424916193024:0@lo:400:kworker.0 00000100:00100000:3.0:1789498840.510174:0:24475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916192256 00000100:00100000:3.0:1789498840.510177:0:24475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916192256 00000100:00100000:3.0:1789498840.510196:0:24475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916192384 00000100:00100000:3.0:1789498840.510198:0:24475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916192384 00000100:00100000:3.0:1789498840.510205:0:24475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916192896 00000100:00100000:3.0:1789498840.510207:0:24475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916192896 00000100:00100000:3.0:1789498840.510214:0:24475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789498840.510219:0:24475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07684c17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876424916192256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498840.510247:0:24475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07684c17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876424916192256:12345-0@lo:400:kworker.0 Request processed in 27us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498840.510253:0:24475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789498840.510262:0:24475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789498840.510266:0:24475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07684c17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1876424916192384:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789498840.510288:0:24475:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789498840.510313:0:24475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07684c17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1876424916192384:12345-0@lo:8:kworker.0 Request processed in 46us (670us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789498840.510320:0:24475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789498840.510329:0:24475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789498840.510333:0:24475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07684c16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1876424916192896:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789498840.510342:0:24475:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789498840.510369:0:24475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07684c16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1876424916192896:12345-0@lo:8:kworker.0 Request processed in 35us (683us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789498840.510375:0:24475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789498840.510395:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916192256:0@lo:400:kworker.0 00000100:00080000:3.0:1789498840.510416:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076beb13800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789498840.510432:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789498840.510436:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916192384:0@lo:8:kworker.0 00000100:00080000:3.0:1789498840.510444:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa07587142800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789498840.510448:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789498840.510451:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07684c17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876424916192896:0@lo:8:kworker.0 00000100:00100000:3.0:1789498840.510478:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39f24317-e976-4eca-a2df-96def568323f:3642:1876424916192128:0@lo:400:kworker.0 00000100:00100000:2.0:1789498840.510989:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916192640 00000100:00100000:2.0:1789498840.510995:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916192640 00000100:00100000:2.0:1789498840.511032:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789498840.511038:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876424916192640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498840.511080:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876424916192640:12345-0@lo:400:kworker.0 Request processed in 43us (2214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498840.511086:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789498840.513726:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789498840.513754:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916193408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789498840.513831:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498840.513901:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916193408 00000100:00100000:2.0:1789498840.513911:0:24170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916193408 00000100:00100000:2.0:1789498840.513972:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789498840.513982:0:24170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916193408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789498840.514014:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789498840.514069:0:24170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916193408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498840.514092:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789498840.514151:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916193408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789498840.514396:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876424916192640:0@lo:400:kworker.0 00010000:00010000:2.0:1789498840.577259:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498841.023351:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916193536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789498841.023451:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498841.024727:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916193536 00000100:00100000:1.0:1789498841.024742:0:22663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916193536 00000100:00100000:1.0:1789498841.024806:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789498841.024815:0:22663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07684c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916193536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789498841.024858:0:22663:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789498841.033917:0:22663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07684c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916193536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 9091us (10452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498841.033934:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789498841.034213:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916193536:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789498841.599564:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789498841.982996:0:22692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789498842.049666:0:23413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789498842.624921:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498843.643896:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498844.603963:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789498844.603986:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07684c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916193664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498844.604079:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498844.604172:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916193664 00000100:00100000:3.0:1789498844.604180:0:24170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916193664 00000100:00100000:3.0:1789498844.604238:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789498844.604247:0:24170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07684c15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876424916193664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498844.604296:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789498844.604361:0:24170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07684c15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876424916193664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498844.604368:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1789498844.604391:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498844.604436:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07684c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916193664:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789498844.668908:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498845.115827:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789498845.115858:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07684c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876424916193792:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789498845.115940:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498845.116002:0:23400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916193792 00000100:00100000:3.0:1789498845.116010:0:23400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916193792 00000100:00100000:3.0:1789498845.116073:0:23400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789498845.116084:0:23400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07684c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876424916193792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789498845.116125:0:23400:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789498845.116170:0:23400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07684c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876424916193792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498845.116177:0:23400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789498845.116235:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07684c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876424916193792:0@lo:41:osp-pre-1-0.0 00000020:01000004:0.0:1789498845.556251:0:24983:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789498845.556255:0:24983:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789498845.556256:0:24983:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789498845.556441:0:24983:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa0758755b800 00000020:01000004:0.0:1789498845.556463:0:24983:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789498845.556482:0:24983:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789498845.556497:0:24983:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffffa0758666b380) 00000020:00000080:0.0:1789498845.556518:0:24983:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00000100:00100000:0.0:1789498845.628108:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:3.0:1789498845.628288:0:15719:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789498845.628293:0:15719:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789498845.628297:0:15719:0:(import.c:65:import_set_state_nolock()) ffffa076beb13800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789498845.628308:0:15719:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 674 00000100:00080000:3.0:1789498845.628314:0:15719:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789498845.628339:0:15719:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa076beb13800 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:3.0:1789498845.628365:0:15719:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa07684c16d80 x1876424916194304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789498845.628978:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07684c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876424916194176:0@lo:400:kworker.0 00000100:00100000:1.0:1789498845.629058:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498845.629099:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789498845.629105:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07684c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39f24317-e976-4eca-a2df-96def568323f:3644:1876424916194048:0@lo:400:kworker.0 00000100:00100000:1.0:1789498845.629293:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498845.629360:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916194048 00000100:00100000:1.0:1789498845.629375:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916194048 00000100:00100000:1.0:1789498845.629427:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789498845.629436:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+21:3644:x1876424916194048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498845.629484:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+21:3644:x1876424916194048:12345-0@lo:400:kworker.0 Request processed in 49us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498845.629491:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789498845.629553:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07684c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:39f24317-e976-4eca-a2df-96def568323f:3644:1876424916194048:0@lo:400:kworker.0 00000100:00100000:2.0:1789498845.632875:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07684c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916194304:0@lo:8:kworker.0 00000100:00100000:2.0:1789498845.632967:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498845.633040:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916194176 00000100:00100000:2.0:1789498845.633050:0:24167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916194176 00000100:00100000:1.0:1789498845.633186:0:24475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916194304 00000100:00100000:1.0:1789498845.633192:0:24475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916194304 00000100:00100000:1.0:1789498845.633242:0:24475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789498845.633254:0:24475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876424916194176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498845.633346:0:24475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876424916194176:12345-0@lo:400:kworker.0 Request processed in 95us (4288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498845.636034:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789498845.636049:0:24167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1876424916194304:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789498845.637383:0:24167:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789498845.637526:0:24167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1876424916194304:12345-0@lo:8:kworker.0 Request processed in 1475us (4555us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789498845.637562:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789498845.637702:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07684c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876424916194560:0@lo:400:kworker.0 00000100:00100000:3.0:1789498845.637857:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498845.637912:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916194560 00000100:00100000:3.0:1789498845.637920:0:22663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916194560 00000100:00100000:3.0:1789498845.637973:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789498845.637984:0:22663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07684c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876424916194560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498845.638040:0:22663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07684c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876424916194560:12345-0@lo:400:kworker.0 Request processed in 59us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498845.638047:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789498845.638130:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07684c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876424916194560:0@lo:400:kworker.0 00000100:00080000:3.0:1789498845.638167:0:15719:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789498845.638171:0:15719:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789498845.638174:0:15719:0:(import.c:65:import_set_state_nolock()) ffffa07587142800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789498845.638179:0:15719:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 674 00000100:00080000:3.0:1789498845.638183:0:15719:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789498845.638190:0:15719:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffffa07587142800 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:3.0:1789498845.638200:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07684c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916194688:0@lo:400:kworker.0 00000100:00100000:3.0:1789498845.638228:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498845.638484:0:15719:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa07684c14e00 x1876424916194816/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789498845.638529:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789498845.638550:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07684c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876424916194944:0@lo:400:kworker.0 00000100:00100000:3.0:1789498845.638575:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498845.638596:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916194944 00000100:00100000:3.0:1789498845.638605:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916194944 00000100:00100000:3.0:1789498845.638629:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789498845.638634:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07684c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876424916194944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498845.638664:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07684c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876424916194944:12345-0@lo:400:kworker.0 Request processed in 30us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498845.638670:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1789498845.638693:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa07684c14a80 x1876424916194944/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498845.638704:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07684c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876424916194944:0@lo:400:kworker.0 00000100:00100000:3.0:1789498845.638730:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789498845.638736:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07684c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876424916195072:0@lo:400:kworker.0 00000100:00100000:3.0:1789498845.638768:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498845.638788:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916195072 00000100:00100000:3.0:1789498845.638791:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916195072 00000100:00100000:3.0:1789498845.638813:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789498845.638819:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07587660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876424916195072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498845.638845:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07587660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876424916195072:12345-0@lo:400:kworker.0 Request processed in 26us (76us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498845.638851:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1789498845.638864:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789498845.638895:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa07684c14a80 x1876424916195072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498845.638905:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07684c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876424916195072:0@lo:400:kworker.0 00000100:00100000:3.0:1789498845.638930:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876424916195200:0@lo:400:kworker.0 00000100:00100000:3.0:1789498845.638948:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498845.638973:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916195200 00000100:00100000:3.0:1789498845.638977:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916195200 00000100:00100000:3.0:1789498845.638997:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789498845.639002:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07587663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876424916195200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498845.639028:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07587663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876424916195200:12345-0@lo:400:kworker.0 Request processed in 26us (79us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498845.639033:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1789498845.639043:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789498845.639057:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa07587660380 x1876424916195200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498845.639077:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876424916195200:0@lo:400:kworker.0 00000100:00100000:3.0:1789498845.642988:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07684c14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876424916194816:0@lo:8:kworker.0 00000100:00100000:3.0:1789498845.643204:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498845.644026:0:24475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789498845.644253:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916194688 00000100:00100000:0.0:1789498845.644263:0:24168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916194688 00000100:00100000:0.0:1789498845.644349:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789498845.644359:0:24168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07684c15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916194688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498845.644479:0:24168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07684c15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916194688:12345-0@lo:400:kworker.0 Request processed in 120us (6248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498845.644486:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789498845.644586:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07684c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876424916194176:0@lo:400:kworker.0 00000100:00100000:0.0:1789498845.644629:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07684c14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876424916194432:0@lo:400:kworker.0 00000100:00100000:0.0:1789498845.644665:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498845.644691:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916193920:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789498845.644716:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498845.645013:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916193920 00000100:00100000:0.0:1789498845.645019:0:24170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916193920 00000100:00100000:0.0:1789498845.646814:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789498845.646832:0:24170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916193920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789498845.646860:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789498845.646937:0:24170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916193920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (2219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498845.646944:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789498845.647007:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916193920:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789498845.649381:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076beb13800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789498845.649392:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789498845.649396:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07684c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916194304:0@lo:8:kworker.0 00000100:00080000:3.0:1789498845.649433:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498845.649449:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916194432 00000100:00100000:3.0:1789498845.649455:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916194432 00000100:00100000:3.0:1789498845.649496:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789498845.649504:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876424916194432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498845.649585:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876424916194432:12345-0@lo:400:kworker.0 Request processed in 81us (4919us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498845.649592:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789498845.649612:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916194816 00000100:00100000:3.0:1789498845.649616:0:24168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916194816 00000100:00100000:3.0:1789498845.649639:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789498845.649644:0:24168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07587660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1876424916194816:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789498845.649664:0:24168:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789498845.649700:0:24168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07587660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1876424916194816:12345-0@lo:8:kworker.0 Request processed in 55us (6498us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789498845.649707:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789498845.649748:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07684c15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916194688:0@lo:400:kworker.0 00000100:00080000:3.0:1789498845.649770:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa07587142800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789498845.649775:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789498845.649778:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07684c14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876424916194816:0@lo:8:kworker.0 00010000:00080000:3.0:1789498845.651174:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa07684c14000 x1876424916194432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498845.651201:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07684c14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876424916194432:0@lo:400:kworker.0 00010000:00010000:2.0:1789498845.693769:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1789498845.700816:0:24983:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789498845.712499:0:24983:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789498845.719455:0:24983:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789498845.722011:0:24983:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789498845.722528:0:24983:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789498845.722902:0:24983:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1789498845.723292:0:24983:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1789498845.727506:0:24983:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789498845.728257:0:24983:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789498845.728273:0:24983:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789498845.728289:0:24983:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x70d6b5fa1825e5b8 00000020:01000004:3.0:1789498845.728297:0:24983:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789498845.728332:0:24983:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.117@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789498845.728337:0:24983:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.117@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789498845.728350:0:24983:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789498845.728384:0:24983:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1789498845.728390:0:24983:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.117@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789498845.761515:0:24983:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.117@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789498845.761612:0:24983:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.117@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1789498845.761617:0:24983:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789498845.761619:0:24983:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789498845.761620:0:24983:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789498845.761621:0:24983:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789498845.761622:0:24983:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789498845.761623:0:24983:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789498845.761625:0:24983:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789498845.761627:0:24983:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789498845.761628:0:24983:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789498845.761632:0:24983:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1789498845.761634:0:24983:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789498845.761635:0:24983:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789498845.761637:0:24983:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789498845.761638:0:24983:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789498845.761639:0:24983:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789498845.761646:0:24983:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789498845.761647:0:24983:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789498845.761648:0:24983:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789498845.761649:0:24983:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789498845.761690:0:24983:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789498845.761713:0:24983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916195328:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789498845.761842:0:24983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498845.761903:0:24983:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076bc5169c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789498845.764465:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916195328 00000100:00100000:2.0:1789498845.764488:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916195328 00000100:00100000:2.0:1789498845.764611:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789498845.764624:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+21:24983:x1876424916195328:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789498845.764668:0:22653:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789498845.764674:0:22653:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789498845.764681:0:22653:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789498845.765663:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+21:24983:x1876424916195328:12345-0@lo:253:mount.lustre.0 Request processed in 1033us (3814us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498845.765696:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789498845.765896:0:24983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916195328:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789498845.765914:0:24983:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789498845.765917:0:24983:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789498845.765919:0:24983:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789498845.765920:0:24983:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789498845.765921:0:24983:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789498845.765922:0:24983:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789498845.765924:0:24983:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789498845.765925:0:24983:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789498845.765927:0:24983:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789498845.765928:0:24983:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789498845.765951:0:24983:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0758755b800 from lustre-OST0001 10000000:01000000:3.0:1789498845.765988:0:24983:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789498845.765993:0:24983:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789498845.766009:0:24983:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa075876f8000 local copy 00010000:00010000:3.0:1789498845.766029:0:24983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9000/0x70d6b5fa1825e1eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e1f2 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498845.766292:0:24983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07684c14000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916195456:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498845.766372:0:24983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498845.766439:0:24983:0:(client.c:2716:ptlrpc_set_wait()) set ffffa075877873c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789498845.766859:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916195456 00000100:00100000:2.0:1789498845.766867:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916195456 00000100:00100000:2.0:1789498845.766910:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789498845.766920:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+21:24983:x1876424916195456:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789498845.767022:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+21:24983:x1876424916195456:12345-0@lo:501:mount.lustre.0 Request processed in 103us (651us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789498845.767030:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789498845.767168:0:24983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07684c14000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916195456:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789498845.767188:0:24983:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.117@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789498845.767212:0:24983:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.117@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789498845.767220:0:24983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9000/0x70d6b5fa1825e1eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e1f2 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498845.767231:0:24983:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa076bc6d9000/0x70d6b5fa1825e1eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e1f2 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789498845.767262:0:24983:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0758755b800 10000000:01000000:1.0:1789498845.767267:0:24983:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789498845.767272:0:24983:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789498845.767275:0:24983:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789498845.767279:0:24983:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789498845.767281:0:24983:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789498845.767307:0:24983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa0758564e000/0x70d6b5fa1825e5bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498845.767315:0:24983:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa0758564e000/0x70d6b5fa1825e5bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498845.767336:0:24983:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa0758564e000/0x70d6b5fa1825e5bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498845.767362:0:24983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916195584:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789498845.767392:0:24983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498845.767422:0:24983:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076abd36900 going to sleep for 11 seconds 00000100:00100000:2.0:1789498845.767525:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916195584 00000100:00100000:2.0:1789498845.767555:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916195584 00000100:00100000:2.0:1789498845.767585:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789498845.767592:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+21:24983:x1876424916195584:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789498845.767601:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498845.767613:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa076c1570200/0x70d6b5fa1825e5c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e5bf expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498845.767634:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa076c1570200/0x70d6b5fa1825e5c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e5bf expref: 22 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498845.767645:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa076c1570200/0x70d6b5fa1825e5c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e5bf expref: 22 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498845.767653:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa076c1570200, rc 0) 00000100:00100000:2.0:1789498845.767680:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+22:24983:x1876424916195584:12345-0@lo:101:mount.lustre.0 Request processed in 88us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498845.767686:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789498845.768361:0:24983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916195584:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789498845.768376:0:24983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa0758564e000/0x70d6b5fa1825e5bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e5c6 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498845.768387:0:24983:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa0758564e000/0x70d6b5fa1825e5bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e5c6 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789498845.769650:0:24983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:1.0:1789498845.772462:0:24983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789498845.779301:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1789498845.779390:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1789498845.779408:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1789498845.779423:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1789498845.779437:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1789498845.779450:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1789498845.779465:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1789498845.779480:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1789498845.779497:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:1.0:1789498845.779526:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:1.0:1789498845.779565:0:24983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:1.0:1789498845.779694:0:24983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916195712:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789498845.779788:0:24983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498845.779842:0:24983:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076abd36480 going to sleep for 11 seconds 00000100:00100000:2.0:1789498845.780401:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916195712 00000100:00100000:2.0:1789498845.780440:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916195712 00000100:00100000:2.0:1789498845.780571:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789498845.780590:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+22:24983:x1876424916195712:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789498845.780851:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+22:24983:x1876424916195712:12345-0@lo:501:mount.lustre.0 Request processed in 268us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498845.780859:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789498845.781520:0:24983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916195712:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498845.781663:0:24983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07684c14e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916195840:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789498845.781789:0:24983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498845.781833:0:24983:0:(client.c:2716:ptlrpc_set_wait()) set ffffa075877873c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498845.782049:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916195840 00000100:00100000:0.0:1789498845.782055:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916195840 00000100:00100000:0.0:1789498845.782111:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789498845.782120:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+22:24983:x1876424916195840:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789498845.784032:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+22:24983:x1876424916195840:12345-0@lo:503:mount.lustre.0 Request processed in 1899us (2229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498845.784054:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789498845.785492:0:24983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07684c14e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916195840:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789498845.786494:0:24983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789498845.786671:0:24983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07684c14e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916195968:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789498845.786755:0:24983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498845.786810:0:24983:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076bc5169c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789498845.786973:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916195968 00000100:00100000:1.0:1789498845.786981:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916195968 00000100:00100000:1.0:1789498845.787044:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789498845.787056:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+22:24983:x1876424916195968:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789498845.787859:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+22:24983:x1876424916195968:12345-0@lo:502:mount.lustre.0 Request processed in 803us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498845.787879:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789498845.788748:0:24983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07684c14e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916195968:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789498845.789039:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1789498845.789087:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1789498845.789105:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1789498845.789122:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1789498845.789139:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1789498845.789156:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1789498845.789172:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1789498845.789188:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1789498845.789204:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:3.0:1789498845.789239:0:24983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07684c14e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916196096:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789498845.789296:0:24983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498845.789367:0:24983:0:(client.c:2716:ptlrpc_set_wait()) set ffffa075877873c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498845.789609:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916196096 00000100:00100000:0.0:1789498845.789623:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916196096 00000100:00100000:0.0:1789498845.789689:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789498845.789699:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+22:24983:x1876424916196096:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789498845.789853:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+22:24983:x1876424916196096:12345-0@lo:502:mount.lustre.0 Request processed in 155us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498845.789860:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789498845.790398:0:24983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07684c14e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916196096:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789498845.790603:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:1.0:1789498845.790617:0:24983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1789498845.792352:0:24988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789498845.792364:0:24988:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1789498845.792371:0:24988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789498845.792373:0:24988:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789498845.792380:0:24988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789498845.792396:0:24988:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffffa0769060cd40) 00000020:00000080:3.0:1789498845.792424:0:24988:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789498845.792430:0:24988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789498845.792512:0:24988:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0758755b800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789498845.792522:0:24988:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789498845.792528:0:24988:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x70d6b5fa1825e5d4 00010000:00010000:3.0:1789498845.801417:0:24988:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1789498845.805158:0:24988:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:3.0:1789498845.807475:0:24988:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1789498845.810055:0:24988:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789498845.810097:0:24988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498845.810109:0:24988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498845.810113:0:24988:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789498845.810119:0:24988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498845.810124:0:24988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498845.810125:0:24988:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789498845.810129:0:24988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789498845.810131:0:24988:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789498845.810133:0:24988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498845.810135:0:24988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498845.810136:0:24988:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789498845.810138:0:24988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789498845.810140:0:24988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498845.810141:0:24988:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789498845.810145:0:24988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789498845.810183:0:24988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789498845.810187:0:24988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789498845.810189:0:24988:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789498845.810195:0:24988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1789498845.810606:0:24983:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789498845.810642:0:24983:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789498845.810666:0:24983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa0758564e000/0x70d6b5fa1825e5bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e5c6 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498845.810680:0:24983:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa0758564e000/0x70d6b5fa1825e5bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e5c6 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498845.810689:0:24983:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0758755b800 from 1 10000000:01000000:3.0:1789498845.810692:0:24983:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789498845.810730:0:24983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825e5db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498845.810739:0:24983:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825e5db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498845.810751:0:24983:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825e5db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498845.810779:0:24983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07684c15880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916196224:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789498845.810852:0:24983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498845.810893:0:24983:0:(client.c:2716:ptlrpc_set_wait()) set ffffa0768853f480 going to sleep for 11 seconds 00000100:00100000:0.0:1789498845.811245:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916196224 00000100:00100000:0.0:1789498845.811254:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916196224 00000100:00100000:0.0:1789498845.811312:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789498845.811332:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+22:24983:x1876424916196224:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789498845.811349:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498845.811362:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa076bc6d9200/0x70d6b5fa1825e5e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e5db expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.811389:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa076bc6d9200/0x70d6b5fa1825e5e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e5db expref: 23 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.811401:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa076bc6d9200/0x70d6b5fa1825e5e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e5db expref: 23 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.811411:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa076bc6d9200, rc 0) 00000100:00100000:0.0:1789498845.811465:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+23:24983:x1876424916196224:12345-0@lo:101:mount.lustre.0 Request processed in 145us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498845.811472:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789498845.813242:0:24983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07684c15880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916196224:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789498845.813273:0:24983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825e5db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e5e2 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498845.813289:0:24983:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825e5db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e5e2 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789498845.814702:0:24983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1789498845.815136:0:24983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789498845.815354:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1789498845.815384:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1789498845.815402:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1789498845.815418:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1789498845.815432:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1789498845.815447:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1789498845.815463:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1789498845.815481:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1789498845.815498:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1789498845.815513:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1789498845.815528:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1789498845.815809:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1789498845.815816:0:24983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1789498845.815971:0:24983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586727480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916196352:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789498845.816037:0:24983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498845.817038:0:24983:0:(client.c:2716:ptlrpc_set_wait()) set ffffa0758753d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498845.817227:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916196352 00000100:00100000:3.0:1789498845.817236:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916196352 00000100:00100000:3.0:1789498845.817295:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789498845.817304:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+23:24983:x1876424916196352:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789498845.817470:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+23:24983:x1876424916196352:12345-0@lo:501:mount.lustre.0 Request processed in 166us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498845.817478:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789498845.817648:0:24983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586727480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916196352:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789498845.818263:0:24983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586727480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916196480:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789498845.818333:0:24983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498845.818363:0:24983:0:(client.c:2716:ptlrpc_set_wait()) set ffffa0758753d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498845.818763:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916196480 00000100:00100000:3.0:1789498845.818770:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916196480 00000100:00100000:3.0:1789498845.818812:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789498845.818820:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+23:24983:x1876424916196480:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789498845.818928:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+23:24983:x1876424916196480:12345-0@lo:503:mount.lustre.0 Request processed in 108us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498845.818935:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789498845.819327:0:24983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586727480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916196480:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789498845.820181:0:24983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789498845.820278:0:24983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586727480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916196608:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789498845.820338:0:24983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498845.820384:0:24983:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076befa2840 going to sleep for 11 seconds 00000100:00100000:0.0:1789498845.820457:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916196608 00000100:00100000:0.0:1789498845.820463:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916196608 00000100:00100000:0.0:1789498845.820594:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789498845.820603:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+23:24983:x1876424916196608:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789498845.820723:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+23:24983:x1876424916196608:12345-0@lo:502:mount.lustre.0 Request processed in 121us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498845.820730:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789498845.820871:0:24983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586727480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916196608:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789498845.821057:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1789498845.821158:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1789498845.821172:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1789498845.821185:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1789498845.821197:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1789498845.821210:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1789498845.821223:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1789498845.821236:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1789498845.821248:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1789498845.821261:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1789498845.821273:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1789498845.821295:0:24983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586727480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916196736:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789498845.821346:0:24983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498845.821373:0:24983:0:(client.c:2716:ptlrpc_set_wait()) set ffffa0758567b300 going to sleep for 11 seconds 00000100:00100000:1.0:1789498845.821415:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916196736 00000100:00100000:1.0:1789498845.821421:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916196736 00000100:00100000:1.0:1789498845.821453:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789498845.821460:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+23:24983:x1876424916196736:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789498845.821559:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+23:24983:x1876424916196736:12345-0@lo:502:mount.lustre.0 Request processed in 99us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498845.821566:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789498845.821639:0:24983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586727480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916196736:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789498845.821673:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1789498845.821680:0:24983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789498845.823010:0:24992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789498845.823020:0:24992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498845.823023:0:24992:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789498845.823029:0:24992:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0758755b800 00000020:00000080:1.0:1789498845.823032:0:24992:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789498845.823039:0:24992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498845.823042:0:24992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498845.823043:0:24992:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789498845.823045:0:24992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789498845.823047:0:24992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498845.823049:0:24992:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789498845.823052:0:24992:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0758755b800 00000020:00000080:1.0:1789498845.823054:0:24992:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789498845.823220:0:24992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498845.823233:0:24992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498845.823235:0:24992:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789498845.823238:0:24992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789498845.823241:0:24992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498845.823242:0:24992:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789498845.823246:0:24992:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0758755b800 00000020:00000080:1.0:1789498845.823248:0:24992:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789498845.827091:0:24992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498845.827105:0:24992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498845.827107:0:24992:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789498845.827112:0:24992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789498845.827189:0:24992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498845.827192:0:24992:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789498845.827198:0:24992:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0758755b800 00000020:00000080:1.0:1789498845.827201:0:24992:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789498845.827274:0:24992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789498845.827277:0:24992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789498845.827278:0:24992:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789498845.827282:0:24992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1789498845.830874:0:24983:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789498845.830938:0:24983:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789498845.830966:0:24983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825e5db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e5e2 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498845.830980:0:24983:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825e5db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e5e2 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498845.831074:0:24983:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789498845.831079:0:24983:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0758755b800 10000000:01000000:2.0:1789498845.831091:0:24983:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0758755b800 10000000:01000000:2.0:1789498845.831096:0:24983:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789498845.831103:0:24983:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0758755b800 from 1 10000000:01000000:2.0:1789498845.831106:0:24983:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789498845.831164:0:24983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1570800/0x70d6b5fa1825e5e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498845.831173:0:24983:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa076c1570800/0x70d6b5fa1825e5e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498845.831186:0:24983:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa076c1570800/0x70d6b5fa1825e5e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498845.831219:0:24983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586727480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916196864:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789498845.831334:0:24983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498845.831400:0:24983:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076904da780 going to sleep for 11 seconds 00000100:00100000:1.0:1789498845.832726:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916196864 00000100:00100000:1.0:1789498845.832737:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916196864 00000100:00100000:1.0:1789498845.832790:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789498845.832801:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+23:24983:x1876424916196864:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789498845.832818:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498845.832836:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0758564f400/0x70d6b5fa1825e5f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e5e9 expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498845.832869:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0758564f400/0x70d6b5fa1825e5f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e5e9 expref: 24 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498845.832881:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0758564f400/0x70d6b5fa1825e5f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e5e9 expref: 24 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498845.832902:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0758564f400, rc 0) 00000100:00100000:1.0:1789498845.832977:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+24:24983:x1876424916196864:12345-0@lo:101:mount.lustre.0 Request processed in 178us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498845.832996:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789498845.833064:0:24983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586727480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916196864:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789498845.833082:0:24983:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa076c1570800/0x70d6b5fa1825e5e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e5f0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498845.833092:0:24983:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa076c1570800/0x70d6b5fa1825e5e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e5f0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789498845.854822:0:24983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1789498845.855686:0:24983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789498845.855960:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1789498845.855988:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1789498845.856021:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1789498845.856039:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1789498845.856056:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1789498845.856152:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1789498845.856170:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1789498845.856184:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1789498845.856200:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1789498845.856216:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1789498845.856233:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1789498845.856247:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1789498845.856262:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1789498845.856277:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1789498845.856291:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1789498845.856317:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1789498845.856347:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1789498845.856364:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1789498845.856392:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1789498845.856408:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1789498845.856424:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1789498845.857029:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1789498845.857522:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1789498845.857577:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1789498845.857595:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1789498845.857610:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1789498845.857625:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1789498845.857640:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1789498845.857654:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1789498845.857671:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1789498845.857685:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1789498845.857700:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1789498845.857716:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1789498845.858570:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1789498845.858609:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1789498845.858624:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1789498845.858637:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1789498845.858651:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1789498845.858665:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1789498845.858678:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1789498845.858691:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1789498845.858705:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1789498845.858718:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1789498845.859569:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1789498845.859591:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1789498845.859605:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1789498845.859618:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1789498845.859632:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1789498845.859875:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1789498845.859909:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1789498845.859930:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1789498845.859934:0:24983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1789498845.860619:0:24983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586727100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916196992:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789498845.860685:0:24983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498845.861018:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916196992 00000100:00100000:3.0:1789498845.861027:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916196992 00000100:00100000:3.0:1789498845.861080:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789498845.861089:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+24:24983:x1876424916196992:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789498845.861127:0:24983:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07688d48000 going to sleep for 11 seconds 00000100:00100000:3.0:1789498845.861302:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+24:24983:x1876424916196992:12345-0@lo:501:mount.lustre.0 Request processed in 210us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498845.861314:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789498845.861587:0:24983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586727100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916196992:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789498845.861656:0:24983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586727100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916197120:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789498845.861739:0:24983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498845.861764:0:24983:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07688d48000 going to sleep for 11 seconds 00000100:00100000:0.0:1789498845.861827:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916197120 00000100:00100000:0.0:1789498845.861833:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916197120 00000100:00100000:0.0:1789498845.861866:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789498845.861873:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+24:24983:x1876424916197120:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789498845.861983:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+24:24983:x1876424916197120:12345-0@lo:503:mount.lustre.0 Request processed in 111us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498845.861990:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789498845.862140:0:24983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586727100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916197120:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789498845.862621:0:24983:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789498845.863913:0:24983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586727100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916197248:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789498845.864006:0:24983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498845.864366:0:24983:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07688d48000 going to sleep for 11 seconds 00000100:00100000:0.0:1789498845.870844:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916197248 00000100:00100000:0.0:1789498845.870862:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916197248 00000100:00100000:2.0:1789498845.878458:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789498845.878481:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+24:24983:x1876424916197248:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789498845.878806:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+24:24983:x1876424916197248:12345-0@lo:502:mount.lustre.0 Request processed in 331us (14798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498845.878817:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789498845.878954:0:24983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586727100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916197248:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789498845.879237:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1789498845.879272:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1789498845.879288:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1789498845.879315:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1789498845.879345:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1789498845.879361:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1789498845.879377:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1789498845.879393:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1789498845.879410:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1789498845.879427:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1789498845.879443:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1789498845.879460:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1789498845.888234:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1789498845.888369:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1789498845.888407:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1789498845.888444:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1789498845.888473:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1789498845.888506:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1789498845.888605:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1789498845.888645:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1789498845.888678:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1789498845.889033:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1789498845.889052:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1789498845.889071:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1789498845.889088:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1789498845.889102:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1789498845.889687:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1789498845.889789:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1789498845.889810:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1789498845.889850:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1789498845.889868:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1789498845.889885:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1789498845.889900:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1789498845.889916:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1789498845.889933:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1789498845.889948:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1789498845.889976:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1789498845.889992:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1789498845.890008:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1789498845.890023:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1789498845.890038:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1789498845.890053:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1789498845.890070:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1789498845.890086:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1789498845.890101:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1789498845.891918:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1789498845.891964:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1789498845.891983:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1789498845.892055:0:24983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586727100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916197376:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789498845.893114:0:24983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498845.893343:0:24983:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07688d48000 going to sleep for 11 seconds 00000100:00100000:3.0:1789498845.893389:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916197376 00000100:00100000:3.0:1789498845.893398:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916197376 00000100:00100000:3.0:1789498845.893489:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789498845.893500:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586704c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+24:24983:x1876424916197376:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789498845.893933:0:24983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586727100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916197376:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789498845.894281:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1789498845.894352:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1789498845.894413:0:24983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916197504:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789498845.895033:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586704c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+24:24983:x1876424916197376:12345-0@lo:502:mount.lustre.0 Request processed in 193us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498845.895055:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789498845.895509:0:24983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498845.896052:0:24983:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a9c28900 going to sleep for 11 seconds 00000100:00100000:2.0:1789498845.896112:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916197504 00000100:00100000:2.0:1789498845.896129:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916197504 00000100:00100000:0.0:1789498845.896382:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789498845.896393:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+24:24983:x1876424916197504:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789498845.896656:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+24:24983:x1876424916197504:12345-0@lo:502:mount.lustre.0 Request processed in 265us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498845.896663:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789498845.896938:0:24983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916197504:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789498845.897031:0:24983:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1789498845.897046:0:24983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789498845.901356:0:24998:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789498845.901393:0:24998:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffffa0758664cd40) 00000020:00000080:2.0:1789498845.901419:0:24998:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1789498845.901511:0:24998:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0758755b800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789498845.901515:0:24998:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0758755b800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789498845.901518:0:24998:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0758755b800 3 00010000:00080000:2.0:1789498845.901588:0:24998:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa076a9c52000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.117@tcp at head 00010000:00010000:3.0:1789498845.903623:0:24998:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1789498845.903840:0:24998:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789498845.903896:0:24998:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789498845.903910:0:24998:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x70d6b5fa1825e5fe 00000100:00080000:3.0:1789498845.903921:0:24998:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789498845.903937:0:24998:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa076a9c52000 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:3.0:1789498845.903973:0:24998:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa07684c16d80 x1876424916197632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789498845.904014:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07684c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1876424916197632:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789498845.904086:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498845.904150:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916197632 00000100:00100000:3.0:1789498845.904158:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916197632 00000100:00100000:3.0:1789498845.904190:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789498845.904198:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07684c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1876424916197632:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789498845.904223:0:22660:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 680 last 0 00000020:00000080:3.0:1789498845.904254:0:22660:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x70d6b5fa1825e605 00000004:00100000:3.0:1789498845.904268:0:22660:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789498845.904298:0:22660:0:(import.c:65:import_set_state_nolock()) ffffa075880d1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789498845.904359:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07684c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876424916197632:12345-0@lo:38:llog_process_th.0 Request processed in 160us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498845.904366:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789498845.904429:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa07684c16d80 x1876424916197632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789498855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498845.904442:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789498845.904452:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1789498845.904463:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789498845.904469:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789498845.904472:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076a9c52000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789498845.904484:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07684c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1876424916197632:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789498845.904516:0:24998:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789498845.905142:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789498845.905147:0:20398:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789498845.905150:0:20398:0:(import.c:65:import_set_state_nolock()) ffffa076beb13800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789498845.905154:0:20398:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 679 00000100:00080000:2.0:1789498845.905157:0:20398:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789498845.905164:0:20398:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa076beb13800 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:2.0:1789498845.905187:0:20398:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa07588145500 x1876424916198016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789498845.905227:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789498845.905230:0:20398:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789498845.905232:0:20398:0:(import.c:65:import_set_state_nolock()) ffffa07587142800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789498845.905235:0:20398:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 679 00000100:00080000:2.0:1789498845.905237:0:20398:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789498845.905242:0:20398:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffffa07587142800 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:2.0:1789498845.905251:0:20398:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa07588144e00 x1876424916198528/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789498845.905286:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876424916197888:0@lo:400:kworker.0 00000100:00100000:2.0:1789498845.905341:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498845.905376:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588144380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876424916198656:0@lo:400:kworker.0 00000100:00100000:2.0:1789498845.905398:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498845.905418:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789498845.905423:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876424916197760:0@lo:400:kworker.0 00000100:00100000:2.0:1789498845.905445:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498845.905462:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588145f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876424916198400:0@lo:400:kworker.0 00000100:00100000:2.0:1789498845.905482:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498845.905507:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876424916198144:0@lo:400:kworker.0 00000100:00100000:2.0:1789498845.905550:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498845.905568:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876424916198784:0@lo:400:kworker.0 00000100:00100000:2.0:1789498845.905589:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498845.905603:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789498845.905615:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916198272:0@lo:400:kworker.0 00000100:00100000:2.0:1789498845.905637:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498845.905654:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876424916198912:0@lo:400:kworker.0 00000100:00100000:2.0:1789498845.905820:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498845.905850:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916197888 00000100:00100000:2.0:1789498845.905856:0:24168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916197888 00000100:00100000:2.0:1789498845.905899:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916198400 00000100:00100000:2.0:1789498845.905902:0:24168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916198400 00000100:00100000:2.0:1789498845.905924:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789498845.905931:0:24168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876424916197888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498845.905975:0:24168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876424916197888:12345-0@lo:400:kworker.0 Request processed in 44us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498845.905982:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789498845.905994:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789498845.906000:0:24168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876424916198400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498845.906023:0:24168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588147480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876424916198400:12345-0@lo:400:kworker.0 Request processed in 23us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498845.906028:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789498845.906043:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916198656 00000100:00100000:2.0:1789498845.906046:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916198656 00000100:00100000:2.0:1789498845.906061:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916198144 00000100:00100000:2.0:1789498845.906063:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916198144 00000100:00100000:2.0:1789498845.906073:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916198784 00000100:00100000:2.0:1789498845.906075:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916198784 00000100:00100000:2.0:1789498845.906084:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916198912 00000100:00100000:2.0:1789498845.906085:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916198912 00000100:00100000:2.0:1789498845.906095:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789498845.906100:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876424916198656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498845.906270:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876424916198656:12345-0@lo:400:kworker.0 Request processed in 168us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498845.906276:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789498845.906288:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789498845.906294:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876424916198144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498845.906373:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876424916198144:12345-0@lo:400:kworker.0 Request processed in 78us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498845.906379:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789498845.906391:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789498845.906397:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876424916198784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498845.906424:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876424916198784:12345-0@lo:400:kworker.0 Request processed in 27us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498845.906430:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789498845.906440:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789498845.906446:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876424916198912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498845.906471:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876424916198912:12345-0@lo:400:kworker.0 Request processed in 27us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498845.906477:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789498845.906495:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916197760 00000100:00100000:2.0:1789498845.906499:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916197760 00000100:00100000:2.0:1789498845.906522:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916198272 00000100:00100000:2.0:1789498845.906525:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916198272 00000100:00100000:2.0:1789498845.906560:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789498845.906567:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876424916197760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498845.906598:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876424916197760:12345-0@lo:400:kworker.0 Request processed in 33us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498845.906614:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789498845.906627:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789498845.906632:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916198272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498845.906675:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916198272:12345-0@lo:400:kworker.0 Request processed in 43us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498845.906682:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789498845.906873:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916198016:0@lo:8:kworker.0 00000100:00100000:2.0:1789498845.906902:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498845.906923:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876424916198528:0@lo:8:kworker.0 00000100:00100000:2.0:1789498845.906947:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498845.906970:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916198016 00000100:00100000:2.0:1789498845.906974:0:24169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916198016 00000100:00100000:2.0:1789498845.906991:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916198528 00000100:00100000:2.0:1789498845.906993:0:24169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916198528 00000100:00100000:2.0:1789498845.907005:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789498845.907009:0:24169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1876424916198016:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789498845.907055:0:24169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1876424916198016:12345-0@lo:8:kworker.0 Request processed in 45us (152us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789498845.907062:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789498845.907073:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789498845.907076:0:24169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1876424916198528:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789498845.907106:0:24169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1876424916198528:12345-0@lo:8:kworker.0 Request processed in 28us (158us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789498845.907112:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789498845.907407:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876424916197760:0@lo:400:kworker.0 00000100:00100000:2.0:1789498845.907420:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588145f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876424916198400:0@lo:400:kworker.0 00000100:00100000:2.0:1789498845.907442:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876424916197888:0@lo:400:kworker.0 00010000:00080000:2.0:1789498845.907454:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa07588144380 x1876424916198656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498845.907465:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588144380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876424916198656:0@lo:400:kworker.0 00000100:00100000:2.0:1789498845.907493:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789498845.907499:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076beb13800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789498845.907502:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789498845.907504:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588145500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916198016:0@lo:8:kworker.0 00000100:00100000:2.0:1789498845.907511:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789498845.907514:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa07587142800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789498845.907517:0:3640:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789498845.907519:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588144e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876424916198528:0@lo:8:kworker.0 00000020:01000004:3.0:1789498845.909819:0:24998:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789498845.909837:0:24998:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffffa076906099c0) 00000020:00000080:3.0:1789498845.909867:0:24998:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1789498845.909966:0:24998:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0758755b800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789498845.909971:0:24998:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0758755b800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789498845.909974:0:24998:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0758755b800 3 00010000:00080000:3.0:1789498845.910016:0:24998:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa075880d4000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.117@tcp at head 00010000:00080000:1.0:1789498845.911248:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa07588146d80 x1876424916198144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498845.911269:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876424916198144:0@lo:400:kworker.0 00010000:00080000:1.0:1789498845.911296:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa07588145880 x1876424916198784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498845.911308:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876424916198784:0@lo:400:kworker.0 00000100:00100000:1.0:1789498845.911365:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916198272:0@lo:400:kworker.0 00010000:00080000:1.0:1789498845.911389:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa07588144000 x1876424916198912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498845.911417:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588144000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876424916198912:0@lo:400:kworker.0 00010000:00010000:3.0:1789498845.917382:0:24998:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1789498845.917844:0:24998:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1789498845.917901:0:24998:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789498845.917916:0:24998:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x70d6b5fa1825e613 00000100:00080000:3.0:1789498845.917929:0:24998:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789498845.917945:0:24998:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffffa075880d4000 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:3.0:1789498845.919277:0:24998:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa07684c16d80 x1876424916199040/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789498845.919313:0:24998:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789498845.919747:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07684c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1876424916199040:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789498845.919827:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498845.920004:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916199040 00000100:00100000:3.0:1789498845.920012:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916199040 00000100:00100000:3.0:1789498845.920054:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789498845.920063:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1876424916199040:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789498845.920092:0:22658:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 680 last 0 00000020:00000080:3.0:1789498845.920165:0:22658:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x70d6b5fa1825e61a 00000004:00100000:3.0:1789498845.920182:0:22658:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789498845.920227:0:22658:0:(import.c:65:import_set_state_nolock()) ffffa07585695000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789498845.920278:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876424916199040:12345-0@lo:38:llog_process_th.0 Request processed in 215us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498845.920285:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789498845.920355:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa07684c16d80 x1876424916199040/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789498855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498845.920364:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789498845.920372:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1789498845.920381:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789498845.920386:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789498845.920388:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa075880d4000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789498845.920394:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07684c16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1876424916199040:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1789498845.920515:0:24998:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1789498845.921316:0:24983:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789498845.921393:0:24983:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789498845.921446:0:24983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1570800/0x70d6b5fa1825e5e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e5f0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.921461:0:24983:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa076c1570800/0x70d6b5fa1825e5e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e5f0 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789498845.921597:0:24983:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789498845.921602:0:24983:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789498845.921604:0:24983:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789498845.921605:0:24983:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789498845.921607:0:24983:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789498845.921609:0:24983:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789498845.921611:0:24983:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789498845.921614:0:24983:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789498845.921616:0:24983:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789498845.921623:0:24983:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1789498845.921627:0:24983:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789498845.921628:0:24983:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789498845.921630:0:24983:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789498845.921631:0:24983:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789498845.921632:0:24983:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789498845.921634:0:24983:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789498845.921635:0:24983:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789498845.921636:0:24983:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789498845.921637:0:24983:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789498845.921676:0:24983:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789498845.921786:0:24983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916199168:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789498845.921846:0:24983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498845.921888:0:24983:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a9c28d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789498845.922232:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916199168 00000100:00100000:0.0:1789498845.922241:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916199168 00000100:00100000:0.0:1789498845.922296:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789498845.922306:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586705c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+24:24983:x1876424916199168:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789498845.922347:0:22653:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789498845.922370:0:22653:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789498845.942366:0:22653:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789498845.942391:0:22653:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789498845.942511:0:22674:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789498845.942516:0:22674:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789498845.942567:0:22674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0758564fa00/0x70d6b5fa1825e621 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498845.942589:0:22674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa076c1570a00/0x70d6b5fa1825e4ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e4a7 expref: 24 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498845.942597:0:22674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa075874a0200/0x70d6b5fa1825e4bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e4b5 expref: 24 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498845.942604:0:22674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0758564fa00/0x70d6b5fa1825e621 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498845.942649:0:22674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa075874a0200/0x70d6b5fa1825e4bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70d6b5fa1825e4b5 expref: 24 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498845.942667:0:22674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa075874a0200/0x70d6b5fa1825e4bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70d6b5fa1825e4b5 expref: 24 pid: 22653 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498845.942683:0:22674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22674:1876424916199296:0@lo:104: 00000100:00100000:1.0:1789498845.942765:0:22674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789498845.942810:0:22674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa076c1570a00/0x70d6b5fa1825e4ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70d6b5fa1825e4a7 expref: 24 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498845.942819:0:22674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa076c1570a00/0x70d6b5fa1825e4ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70d6b5fa1825e4a7 expref: 24 pid: 22653 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498845.942849:0:22674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588237b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22674:1876424916199424:0@lo:104: 00000100:00100000:1.0:1789498845.942882:0:22674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498845.942902:0:22674:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07683077b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789498845.943169:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916199296 00000100:00100000:0.0:1789498845.943179:0:22641:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916199296 00000100:00100000:0.0:1789498845.943219:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916199424 00000100:00100000:0.0:1789498845.943223:0:22641:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916199424 00000100:00100000:0.0:1789498845.943237:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789498845.943246:0:22641:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588234380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39f24317-e976-4eca-a2df-96def568323f+4:22674:x1876424916199296:12345-0@lo:104: 00010000:00010000:0.0:1789498845.943259:0:22641:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.117@tcp lock: ffffa076c1571000/0x70d6b5fa1825e4b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x70d6b5fa1825e4bc expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.943328:0:22641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789498845.943336:0:22641:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588234380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39f24317-e976-4eca-a2df-96def568323f+4:22674:x1876424916199296:12345-0@lo:104: Request processed in 91us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498845.943343:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789498845.943361:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789498845.943366:0:22641:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588234000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39f24317-e976-4eca-a2df-96def568323f+3:22674:x1876424916199424:12345-0@lo:104: 00010000:00010000:0.0:1789498845.943375:0:22641:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.117@tcp lock: ffffa075874a0800/0x70d6b5fa1825e4a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x70d6b5fa1825e4ae expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.943405:0:22641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789498845.943410:0:22641:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588234000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:39f24317-e976-4eca-a2df-96def568323f+3:22674:x1876424916199424:12345-0@lo:104: Request processed in 45us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498845.943416:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789498845.943433:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789498845.943439:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.117@tcp lock: ffffa076c1571000/0x70d6b5fa1825e4b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x70d6b5fa1825e4bc expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.943446:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c1571000 already unused, calling callback (ffffffffc13e6c20) 10000000:00010000:0.0:1789498845.943458:0:22647:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.117@tcp lock: ffffa076c1571000/0x70d6b5fa1825e4b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x70d6b5fa1825e4bc expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.943467:0:22647:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa076c1571000/0x70d6b5fa1825e4b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x70d6b5fa1825e4bc expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498845.943474:0:22647:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa076c1571000/0x70d6b5fa1825e4b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x70d6b5fa1825e4bc expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498845.943480:0:22647:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789498845.943508:0:22647:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.117@tcp lock: ffffa076c1571000/0x70d6b5fa1825e4b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e4bc expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.943515:0:22647:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789498845.943557:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.117@tcp lock: ffffa076c1571000/0x70d6b5fa1825e4b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e4bc expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.943565:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa076c1571000/0x70d6b5fa1825e4b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e4bc expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.943580:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498845.943583:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.117@tcp lock: ffffa075874a0800/0x70d6b5fa1825e4a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70d6b5fa1825e4ae expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.943590:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a0800 already unused, calling callback (ffffffffc13e6c20) 10000000:00010000:0.0:1789498845.943592:0:22647:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.117@tcp lock: ffffa075874a0800/0x70d6b5fa1825e4a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x70d6b5fa1825e4ae expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.943599:0:22647:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa075874a0800/0x70d6b5fa1825e4a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x70d6b5fa1825e4ae expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789498845.943615:0:22647:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa075874a0800/0x70d6b5fa1825e4a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x70d6b5fa1825e4ae expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789498845.943621:0:22647:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789498845.943635:0:22647:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.117@tcp lock: ffffa075874a0800/0x70d6b5fa1825e4a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e4ae expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.943641:0:22647:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789498845.943647:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.117@tcp lock: ffffa075874a0800/0x70d6b5fa1825e4a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e4ae expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.943654:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa075874a0800/0x70d6b5fa1825e4a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e4ae expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.943667:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498845.943668:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498845.943670:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498845.943677:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498845.943700:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39f24317-e976-4eca-a2df-96def568323f:3643:1876424916199552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789498845.943839:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498845.943938:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789498845.943946:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39f24317-e976-4eca-a2df-96def568323f:3643:1876424916199680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789498845.943967:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498845.943997:0:23814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916199552 00000100:00100000:0.0:1789498845.944002:0:23814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916199552 00010000:00010000:0.0:1789498845.944020:0:23814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa075874a0200/0x70d6b5fa1825e4bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70d6b5fa1825e4b5 expref: 25 pid: 22653 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498845.944038:0:23814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916199680 00000100:00100000:0.0:1789498845.944047:0:23814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916199680 00010000:00010000:0.0:1789498845.944059:0:23814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa076c1570a00/0x70d6b5fa1825e4ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70d6b5fa1825e4a7 expref: 26 pid: 22653 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498845.944078:0:23814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789498845.944085:0:23814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9de4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:39f24317-e976-4eca-a2df-96def568323f+26:3643:x1876424916199552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789498845.944096:0:23814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498845.944101:0:23814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa075874a0200/0x70d6b5fa1825e4bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70d6b5fa1825e4b5 expref: 26 pid: 22653 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.944112:0:23814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa075874a0200/0x70d6b5fa1825e4bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70d6b5fa1825e4b5 expref: 26 pid: 22653 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.944126:0:23814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498845.944153:0:23814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9de4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:39f24317-e976-4eca-a2df-96def568323f+26:3643:x1876424916199552:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498845.944159:0:23814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789498845.944172:0:23814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789498845.944178:0:23814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9de7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:39f24317-e976-4eca-a2df-96def568323f+25:3643:x1876424916199680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789498845.944185:0:23814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498845.944190:0:23814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa076c1570a00/0x70d6b5fa1825e4ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70d6b5fa1825e4a7 expref: 25 pid: 22653 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.944198:0:23814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa076c1570a00/0x70d6b5fa1825e4ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70d6b5fa1825e4a7 expref: 25 pid: 22653 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.944209:0:23814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0758564fa00/0x70d6b5fa1825e621 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.944216:0:23814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0758564fa00/0x70d6b5fa1825e621 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789498845.944235:0:23814:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013328241s 00010000:00010000:0.0:1789498845.944240:0:23814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0758564fa00/0x70d6b5fa1825e621 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.944246:0:23814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0758564fa00/0x70d6b5fa1825e621 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.944253:0:23814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0758564fa00/0x70d6b5fa1825e621 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.944259:0:23814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0758564fa00/0x70d6b5fa1825e621 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.944265:0:23814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0758564fa00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:0.0:1789498845.944269:0:23814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0758564fa00/0x70d6b5fa1825e621 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.944277:0:23814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0758564fa00/0x70d6b5fa1825e621 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.944286:0:23814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0758564fa00/0x70d6b5fa1825e621 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.944295:0:23814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498845.944329:0:23814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9de7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:39f24317-e976-4eca-a2df-96def568323f+25:3643:x1876424916199680:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498845.944336:0:23814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789498845.944376:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39f24317-e976-4eca-a2df-96def568323f:3643:1876424916199680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789498845.944385:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39f24317-e976-4eca-a2df-96def568323f:3643:1876424916199552:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789498845.944438:0:22674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa075874a0200/0x70d6b5fa1825e4bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70d6b5fa1825e4b5 expref: 24 pid: 22653 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498845.944448:0:22674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22674:1876424916199296:0@lo:104: 00010000:00010000:0.0:1789498845.944457:0:22674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa076c1570a00/0x70d6b5fa1825e4ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70d6b5fa1825e4a7 expref: 23 pid: 22653 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498845.944468:0:22674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588237b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22674:1876424916199424:0@lo:104: 00010000:00010000:0.0:1789498845.944483:0:22674:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0758564fa00/0x70d6b5fa1825e621 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.944491:0:22674:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0758564fa00/0x70d6b5fa1825e621 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.944498:0:22674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0758564fa00/0x70d6b5fa1825e621 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498845.944504:0:22674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0758564fa00/0x70d6b5fa1825e621 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498845.946977:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586705c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+22:24983:x1876424916199168:12345-0@lo:253:mount.lustre.0 Request processed in 24662us (25119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498845.946993:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789498845.947250:0:24983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:39f24317-e976-4eca-a2df-96def568323f:24983:1876424916199168:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789498845.947278:0:24983:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789498845.947283:0:24983:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789498845.947286:0:24983:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789498845.947288:0:24983:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789498845.947290:0:24983:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789498845.947291:0:24983:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789498845.947293:0:24983:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789498845.947295:0:24983:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789498845.947298:0:24983:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789498845.947300:0:24983:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789498845.947346:0:24983:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1789498845.962188:0:24983:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1789498845.970977:0:24983:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789498845.970991:0:24983:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789498845.971034:0:24983:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789498845.971111:0:24983:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.117@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789498845.971134:0:24983:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1789498845.971169:0:24983:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1789498845.972359:0:24983:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789498845.972859:0:24983:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789498846.140102:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789498846.140137:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876424916199808:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789498846.140212:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498846.140370:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916199808 00000100:00100000:0.0:1789498846.140379:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916199808 00000100:00100000:0.0:1789498846.140431:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789498846.140451:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07684c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876424916199808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789498846.140488:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789498846.140567:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07684c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876424916199808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498846.140574:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789498846.140626:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876424916199808:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789498846.718165:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789498847.125326:0:25052:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789498847.125932:0:25052:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1789498847.613071:0:22655:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789498847.613080:0:22655:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa076bc350800 from 14 10000000:01000000:2.0:1789498847.613085:0:22655:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789498847.613129:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1571c00/0x70d6b5fa1825e628 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498847.613152:0:22655:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa076c1571c00/0x70d6b5fa1825e628 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498847.613166:0:22655:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa076c1571c00/0x70d6b5fa1825e628 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498847.613192:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588144e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916199936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789498847.613258:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498847.613307:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07688d48c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789498847.616587:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916199936 00000100:00100000:0.0:1789498847.616607:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916199936 00000100:00100000:0.0:1789498847.616697:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789498847.616709:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586707c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+22:22655:x1876424916199936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789498847.616733:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498847.616758:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa076bc6d8000/0x70d6b5fa1825e62f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e628 expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498847.616797:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa076bc6d8000/0x70d6b5fa1825e62f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e628 expref: 23 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498847.616811:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa076bc6d8000/0x70d6b5fa1825e62f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e628 expref: 23 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498847.616821:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa076bc6d8000, rc 0) 00000100:00100000:0.0:1789498847.617070:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586707c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+23:22655:x1876424916199936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 362us (3810us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498847.617077:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789498847.617222:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588144e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916199936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789498847.617249:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa076c1571c00/0x70d6b5fa1825e628 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e62f expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498847.617259:0:22655:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa076c1571c00/0x70d6b5fa1825e628 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e62f expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498847.617359:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588144e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916200064:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789498847.617406:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498847.617467:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07688d48c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789498847.617598:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916200064 00000100:00100000:1.0:1789498847.617604:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916200064 00000100:00100000:1.0:1789498847.617644:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789498847.617652:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586705450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+23:22655:x1876424916200064:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789498847.617669:0:22651:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789498847.617702:0:22651:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789498847.617707:0:22651:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1789498847.617804:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586705450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+23:22655:x1876424916200064:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 152us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498847.617812:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789498847.618020:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588144e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916200064:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789498847.618082:0:22655:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789498847.618090:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1571c00/0x70d6b5fa1825e628 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e62f expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498847.618099:0:22655:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa076c1571c00/0x70d6b5fa1825e628 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e62f expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498847.618118:0:22655:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789498847.618120:0:22655:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0758605a000 from 14 10000000:01000000:2.0:1789498847.618123:0:22655:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789498847.618143:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1570600/0x70d6b5fa1825e636 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498847.618150:0:22655:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa076c1570600/0x70d6b5fa1825e636 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498847.618158:0:22655:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa076c1570600/0x70d6b5fa1825e636 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498847.618169:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588144e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916200192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789498847.618193:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498847.618223:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07688d48c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789498847.618303:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916200192 00000100:00100000:0.0:1789498847.618307:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916200192 00000100:00100000:0.0:1789498847.618342:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789498847.618349:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586707850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+23:22655:x1876424916200192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789498847.618357:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498847.618369:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa076bc6d9400/0x70d6b5fa1825e63d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e636 expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498847.618384:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa076bc6d9400/0x70d6b5fa1825e63d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e636 expref: 24 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498847.618401:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa076bc6d9400/0x70d6b5fa1825e63d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e636 expref: 24 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498847.618408:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa076bc6d9400, rc 0) 00000100:00100000:0.0:1789498847.618443:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586707850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+24:22655:x1876424916200192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498847.618450:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789498847.618480:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588144e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916200192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789498847.618491:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa076c1570600/0x70d6b5fa1825e636 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e63d expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498847.618498:0:22655:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa076c1570600/0x70d6b5fa1825e636 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e63d expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498847.618566:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916200320:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789498847.618597:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498847.618611:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a9c28f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789498847.618622:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916200320 00000100:00100000:0.0:1789498847.618626:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916200320 00000100:00100000:0.0:1789498847.618644:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789498847.618650:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586704050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+24:22655:x1876424916200320:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789498847.618660:0:22653:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789498847.618672:0:22653:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789498847.618676:0:22653:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1789498847.618806:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586704050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+24:22655:x1876424916200320:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 156us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498847.618822:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789498847.618850:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916200320:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789498847.620552:0:22655:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789498847.620569:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c1570600/0x70d6b5fa1825e636 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e63d expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498847.620582:0:22655:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa076c1570600/0x70d6b5fa1825e636 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e63d expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498847.740694:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498848.764709:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498849.723739:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789498849.726706:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07684c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916200448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789498849.726795:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498849.726939:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916200448 00000100:00100000:0.0:1789498849.726950:0:24170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916200448 00000100:00100000:0.0:1789498849.727027:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789498849.727037:0:24170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916200448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789498849.727078:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1789498849.727602:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789498849.745007:0:24170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916200448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 17960us (18201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498849.745024:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789498849.752026:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07684c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916200448:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789498849.788894:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498850.236751:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916200576:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789498850.236829:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498850.236919:0:23400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916200576 00000100:00100000:1.0:1789498850.236930:0:23400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916200576 00000100:00100000:1.0:1789498850.237034:0:23400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789498850.237044:0:23400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876424916200576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789498850.237086:0:23400:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789498850.237129:0:23400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876424916200576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498850.237149:0:23400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789498850.237198:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916200576:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789498850.747939:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789498850.747975:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07684c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916200704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789498850.748051:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498850.748339:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916200704 00000100:00100000:3.0:1789498850.748348:0:24171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916200704 00000100:00100000:3.0:1789498850.748418:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789498850.748430:0:24171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588235880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916200704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789498850.748468:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789498850.748518:0:24171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588235880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916200704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498850.748526:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789498850.748656:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07684c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916200704:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789498850.748839:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789498850.813137:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789498851.199700:0:22692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789498851.259658:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789498851.259683:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076a9de5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876424916200832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789498851.259759:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498851.260105:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916200832 00000100:00100000:3.0:1789498851.260117:0:22663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916200832 00000100:00100000:3.0:1789498851.260857:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789498851.260870:0:22663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876424916200832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789498851.260917:0:22663:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789498851.260992:0:22663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876424916200832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498851.260999:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1789498851.261136:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789498851.261141:0:20398:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789498851.261145:0:20398:0:(import.c:65:import_set_state_nolock()) ffffa076beb13800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789498851.261164:0:20398:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa076beb13800 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:0.0:1789498851.261188:0:20398:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0758819ed80 x1876424916201344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789498851.261222:0:20398:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789498851.261226:0:20398:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789498851.261228:0:20398:0:(import.c:65:import_set_state_nolock()) ffffa07587142800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789498851.261234:0:20398:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffffa07587142800 using connection 192.168.204.117@tcp/0@lo 00000100:00100000:0.0:1789498851.261245:0:20398:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0758819d880 x1876424916201600/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789498851.261311:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876424916201216:0@lo:400:kworker.0 00000100:00100000:0.0:1789498851.261345:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498851.261369:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876424916201984:0@lo:400:kworker.0 00000100:00100000:0.0:1789498851.261392:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498851.261410:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789498851.261415:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876424916201088:0@lo:400:kworker.0 00000100:00100000:0.0:1789498851.261434:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498851.261471:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876424916201472:0@lo:400:kworker.0 00000100:00100000:2.0:1789498851.261499:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498851.261516:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1876424916202112:0@lo:400:kworker.0 00000100:00100000:2.0:1789498851.261554:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498851.261571:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789498851.261575:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075874f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39f24317-e976-4eca-a2df-96def568323f:3641:1876424916200960:0@lo:400:kworker.0 00000100:00100000:2.0:1789498851.261609:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498851.261633:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876424916201728:0@lo:400:kworker.0 00000100:00100000:2.0:1789498851.261653:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498851.261661:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876424916202240:0@lo:400:kworker.0 00000100:00100000:2.0:1789498851.261679:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498851.261698:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916201984 00000100:00100000:2.0:1789498851.261703:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916201984 00000100:00100000:2.0:1789498851.261740:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916201472 00000100:00100000:2.0:1789498851.261743:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916201472 00000100:00100000:2.0:1789498851.261753:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916202112 00000100:00100000:2.0:1789498851.261755:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916202112 00000100:00100000:2.0:1789498851.261765:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916201728 00000100:00100000:2.0:1789498851.261767:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916201728 00000100:00100000:2.0:1789498851.261776:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916202240 00000100:00100000:2.0:1789498851.261779:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916202240 00000100:00100000:2.0:1789498851.261792:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789498851.261798:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876424916201984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498851.261832:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876424916201984:12345-0@lo:400:kworker.0 Request processed in 34us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498851.261838:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789498851.261851:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789498851.261856:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876424916201472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498851.261882:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876424916201472:12345-0@lo:400:kworker.0 Request processed in 27us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498851.261889:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789498851.261899:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789498851.261905:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876424916202112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498851.261939:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876424916202112:12345-0@lo:400:kworker.0 Request processed in 34us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498851.261945:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789498851.261955:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789498851.261961:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876424916201728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498851.261985:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876424916201728:12345-0@lo:400:kworker.0 Request processed in 24us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498851.261990:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789498851.262000:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789498851.262005:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876424916202240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498851.262029:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876424916202240:12345-0@lo:400:kworker.0 Request processed in 25us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498851.262034:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789498851.262054:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916200960 00000100:00100000:2.0:1789498851.262058:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916200960 00000100:00100000:2.0:1789498851.262083:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789498851.262089:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586707050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+24:3641:x1876424916200960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498851.262117:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586707050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+24:3641:x1876424916200960:12345-0@lo:400:kworker.0 Request processed in 29us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498851.262125:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789498851.262168:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:39f24317-e976-4eca-a2df-96def568323f:3641:1876424916200960:0@lo:400:kworker.0 00010000:00080000:2.0:1789498851.262182:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0758819c380 x1876424916201728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498851.262193:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876424916201728:0@lo:400:kworker.0 00010000:00080000:2.0:1789498851.262212:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0758819f480 x1876424916202240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498851.262233:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1876424916202240:0@lo:400:kworker.0 00010000:00080000:2.0:1789498851.262245:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0758819f100 x1876424916201472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498851.262251:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876424916201472:0@lo:400:kworker.0 00010000:00080000:2.0:1789498851.262260:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0758819dc00 x1876424916202112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498851.262266:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1876424916202112:0@lo:400:kworker.0 00000100:00100000:0.0:1789498851.262838:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876424916201856:0@lo:400:kworker.0 00000100:00100000:0.0:1789498851.262994:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789498851.263022:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0758819df80 x1876424916201984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498851.263033:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1876424916201984:0@lo:400:kworker.0 00000100:00100000:0.0:1789498851.263058:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916201216 00000100:00100000:0.0:1789498851.263063:0:24169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916201216 00000100:00100000:0.0:1789498851.263102:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789498851.263117:0:24169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876424916201216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498851.263154:0:24169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876424916201216:12345-0@lo:400:kworker.0 Request processed in 39us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498851.263160:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789498851.263177:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916201856 00000100:00100000:0.0:1789498851.263180:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916201856 00000100:00100000:0.0:1789498851.263199:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789498851.263204:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876424916201856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498851.263243:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876424916201856:12345-0@lo:400:kworker.0 Request processed in 38us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498851.263249:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1789498851.263270:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0758819c000 x1876424916201856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498851.263279:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876424916201856:0@lo:400:kworker.0 00000100:00100000:0.0:1789498851.263291:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876424916201216:0@lo:400:kworker.0 00000100:00100000:1.0:1789498851.263370:0:23400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916201088 00000100:00100000:1.0:1789498851.263375:0:23400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916201088 00000100:00100000:1.0:1789498851.263402:0:23400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789498851.263408:0:23400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876424916201088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498851.263492:0:23400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876424916201088:12345-0@lo:400:kworker.0 Request processed in 85us (2057us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498851.263499:0:23400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1789498851.263516:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789498851.263521:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789498851.263524:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789498851.263660:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916201344:0@lo:8:kworker.0 00000100:00100000:3.0:1789498851.263691:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498851.263718:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876424916201600:0@lo:8:kworker.0 00000100:00100000:3.0:1789498851.263737:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498851.263767:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916201344 00000100:00100000:3.0:1789498851.263770:0:24168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916201344 00000100:00100000:3.0:1789498851.263788:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916201600 00000100:00100000:3.0:1789498851.263791:0:24168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916201600 00000100:00100000:3.0:1789498851.263800:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789498851.263805:0:24168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07684c14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1876424916201344:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789498851.263841:0:24168:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 685 last 0 00000020:00000080:3.0:1789498851.263982:0:24168:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x70d6b5fa1825e644 00002000:00100000:3.0:1789498851.263996:0:24168:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffffa07585690800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789498851.264007:0:24168:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789498851.264010:0:24168:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789498851.264200:0:24168:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789498851.264236:0:24168:0:(import.c:65:import_set_state_nolock()) ffffa07585696800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789498851.264281:0:24168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07684c14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1876424916201344:12345-0@lo:8:kworker.0 Request processed in 474us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498851.264288:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789498851.264304:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789498851.264308:0:24168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07684c15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1876424916201600:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789498851.264323:0:24168:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 685 last 0 00000020:00000080:3.0:1789498851.264339:0:24168:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x70d6b5fa1825e64b 00002000:00100000:3.0:1789498851.264345:0:24168:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffffa07585690000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1789498851.264348:0:24168:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1789498851.264350:0:24168:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789498851.264375:0:24168:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1789498851.264386:0:24168:0:(import.c:65:import_set_state_nolock()) ffffa07585694000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789498851.264411:0:24168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07684c15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1876424916201600:12345-0@lo:8:kworker.0 Request processed in 102us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498851.264417:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1789498851.264449:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0758819ed80 x1876424916201344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789498876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789498851.264462:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1789498851.264469:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789498851.264474:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789498851.264477:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa076beb13800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789498851.264489:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789498851.264498:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1876424916201344:0@lo:8:kworker.0 00010000:00080000:3.0:1789498851.264512:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0758819d880 x1876424916201600/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789498876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789498851.264521:0:3640:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1789498851.264526:0:3640:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789498851.264529:0:3640:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789498851.264560:0:3640:0:(import.c:65:import_set_state_nolock()) ffffa07587142800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789498851.264573:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789498851.264577:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1876424916201600:0@lo:8:kworker.0 00000004:00080000:3.0:1789498851.264620:0:22685:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:3.0:1789498851.264636:0:22685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07684c14000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22685:1876424916202496:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789498851.264661:0:22685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498851.264674:0:22685:0:(client.c:2716:ptlrpc_set_wait()) set ffffa0769fa85900 going to sleep for 11 seconds 00000004:00080000:3.0:1789498851.264694:0:23404:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789498851.264707:0:23404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc570e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23404:1876424916202752:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1789498851.264726:0:23404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498851.264734:0:23404:0:(client.c:2716:ptlrpc_set_wait()) set ffffa0769fa85540 going to sleep for 11 seconds 00000100:00100000:3.0:1789498851.264745:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07684c14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916202368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498851.264765:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498851.264783:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789498851.264788:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916202624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789498851.264807:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498851.264958:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916202496 00000100:00100000:3.0:1789498851.264963:0:24168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916202496 00000100:00100000:3.0:1789498851.264988:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916202752 00000100:00100000:3.0:1789498851.264991:0:24168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916202752 00000100:00100000:3.0:1789498851.265016:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789498851.265022:0:24168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22685:x1876424916202496:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789498851.265269:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916202368 00000100:00100000:3.0:1789498851.265273:0:24171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916202368 00000100:00100000:3.0:1789498851.265293:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916202624 00000100:00100000:3.0:1789498851.265295:0:24171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916202624 00000100:00100000:3.0:1789498851.265307:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789498851.265313:0:24171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1876424916202368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789498851.265331:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1789498851.265370:0:24171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1876424916202368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498851.265377:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789498851.265391:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789498851.265397:0:24171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3643:x1876424916202624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789498851.265421:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1789498851.265445:0:24171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3643:x1876424916202624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498851.265451:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1789498851.265468:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789498851.265489:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa076bc572300 x1876424916202624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498851.265506:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916202624:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1789498851.265516:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa07684c14e00 x1876424916202368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789498867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498851.265527:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07684c14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916202368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498851.265577:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789498851.265591:0:24169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23404:x1876424916202752:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1789498851.266000:0:22684:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789498851.266087:0:22684:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 685541553554ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789498851.266094:0:22684:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1789498851.267332:0:22638:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1789498851.267588:0:23403:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789498851.267681:0:23403:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 685543147398ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789498851.267686:0:23403:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789498851.268006:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076a9de5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876424916200832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789498851.270037:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075874f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876424916201088:0@lo:400:kworker.0 00002000:00080000:0.0:1789498851.272983:0:24168:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1789498851.272995:0:24168:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1789498851.273002:0:24168:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00080000:3.0:1789498851.280726:0:24169:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1789498851.280740:0:24169:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000004:00080000:2.0:1789498851.280980:0:23391:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1789498851.281033:0:24169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23404:x1876424916202752:12345-0@lo:7:osp-pre-1-1.0 Request processed in 15249us (16111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498851.281046:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1789498851.281117:0:23404:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa076bc570e00 x1876424916202752/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789498867 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498851.281134:0:23404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc570e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23404:1876424916202752:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1789498851.281149:0:23404:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1789498851.281192:0:23404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc570e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23404:1876424916202880:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789498851.281239:0:23404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498851.281306:0:23404:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076bc526f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789498851.288963:0:24475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916202880 00000100:00100000:2.0:1789498851.288983:0:24475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916202880 00000100:00100000:2.0:1789498851.289056:0:24475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789498851.289942:0:24475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23404:x1876424916202880:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1789498851.289986:0:24475:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1789498851.290157:0:24475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23404:x1876424916202880:12345-0@lo:5:osp-pre-1-1.0 Request processed in 1091us (8915us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498851.290164:0:24475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1789498851.290720:0:23404:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa076bc570e00 x1876424916202880/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789498867 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498851.290738:0:23404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc570e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23404:1876424916202880:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1789498851.290754:0:23404:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1789498851.290804:0:23404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc570e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23404:1876424916203008:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789498851.290843:0:23404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498851.291975:0:23404:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076bc526f00 going to sleep for 11 seconds 00002000:00010000:0.0:1789498851.294984:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789498851.295004:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000868f0103/0x70d6b5fa1825e652 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.295027:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1789498851.295033:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498851.295048:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000868f0103/0x70d6b5fa1825e652 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.295084:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000868f0103/0x70d6b5fa1825e652 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.295098:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000868f0103/0x70d6b5fa1825e652 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.295106:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000868f0103/0x70d6b5fa1825e652 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.295128:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789498851.295144:0:24478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498851.295150:0:24478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000868f0103/0x70d6b5fa1825e652 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.295158:0:24478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076bc6d8e00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:0.0:1789498851.295163:0:24478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000868f0103/0x70d6b5fa1825e652 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.295172:0:24478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000868f0103/0x70d6b5fa1825e652 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.295191:0:24478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000868f0103/0x70d6b5fa1825e652 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.295209:0:24478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000868f0103/0x70d6b5fa1825e652 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.295238:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498851.295240:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498851.295242:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498851.296263:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789498851.296273:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014012181/0x70d6b5fa1825e659 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.296285:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1789498851.296289:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498851.296294:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014012181/0x70d6b5fa1825e659 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.296305:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014012181/0x70d6b5fa1825e659 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.296314:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014012181/0x70d6b5fa1825e659 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.296322:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014012181/0x70d6b5fa1825e659 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.296343:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789498851.296682:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789498851.296693:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3d03e3a/0x70d6b5fa1825e660 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.296702:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1789498851.296705:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498851.296709:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3d03e3a/0x70d6b5fa1825e660 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.296719:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3d03e3a/0x70d6b5fa1825e660 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.296727:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3d03e3a/0x70d6b5fa1825e660 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.296734:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3d03e3a/0x70d6b5fa1825e660 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.296749:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789498851.296758:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789498851.296763:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014012181/0x70d6b5fa1825e659 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.296770:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076bc6d9c00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:0.0:1789498851.296775:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014012181/0x70d6b5fa1825e659 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.296784:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014012181/0x70d6b5fa1825e659 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.296804:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014012181/0x70d6b5fa1825e659 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.296812:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014012181/0x70d6b5fa1825e659 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.296827:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498851.296830:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3d03e3a/0x70d6b5fa1825e660 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.296837:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076bc6d9a00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:0.0:1789498851.296840:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3d03e3a/0x70d6b5fa1825e660 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.297147:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3d03e3a/0x70d6b5fa1825e660 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.297160:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3d03e3a/0x70d6b5fa1825e660 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.297168:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3d03e3a/0x70d6b5fa1825e660 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.297181:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498851.297183:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498851.297191:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498851.297434:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498851.297440:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcba1032/0x70d6b5fa1825e667 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.297449:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=685s v=(0 0) 00010000:00010000:1.0:1789498851.297458:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498851.297461:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcba1032/0x70d6b5fa1825e667 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.297472:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bcba1032/0x70d6b5fa1825e667 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.297480:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcba1032/0x70d6b5fa1825e667 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.297486:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bcba1032/0x70d6b5fa1825e667 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.297506:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789498851.301720:0:24478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498851.301735:0:24478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bcba1032/0x70d6b5fa1825e667 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.301754:0:24478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0758564ee00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:0.0:1789498851.301759:0:24478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcba1032/0x70d6b5fa1825e667 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.301772:0:24478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcba1032/0x70d6b5fa1825e667 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.301797:0:24478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bcba1032/0x70d6b5fa1825e667 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.301804:0:24478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcba1032/0x70d6b5fa1825e667 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.301826:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498851.301828:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498851.301829:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498851.302145:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498851.302153:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003bb0bb9/0x70d6b5fa1825e66e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.302166:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=685s v=(0 0) 00010000:00010000:1.0:1789498851.302171:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498851.302177:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003bb0bb9/0x70d6b5fa1825e66e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.302190:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003bb0bb9/0x70d6b5fa1825e66e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.302200:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003bb0bb9/0x70d6b5fa1825e66e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.302226:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003bb0bb9/0x70d6b5fa1825e66e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.302253:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789498851.302727:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498851.302734:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fbbdfe3/0x70d6b5fa1825e675 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.302744:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=685s v=(0 0) 00010000:00010000:1.0:1789498851.302747:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498851.302752:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fbbdfe3/0x70d6b5fa1825e675 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.302761:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fbbdfe3/0x70d6b5fa1825e675 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.302769:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fbbdfe3/0x70d6b5fa1825e675 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.302776:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fbbdfe3/0x70d6b5fa1825e675 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.302798:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789498851.302809:0:24478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789498851.302814:0:24478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003bb0bb9/0x70d6b5fa1825e66e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.302829:0:24478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0758564ec00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:1.0:1789498851.302833:0:24478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003bb0bb9/0x70d6b5fa1825e66e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.302843:0:24478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003bb0bb9/0x70d6b5fa1825e66e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.302936:0:24478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003bb0bb9/0x70d6b5fa1825e66e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.302944:0:24478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003bb0bb9/0x70d6b5fa1825e66e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.302961:0:24478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498851.302964:0:24478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fbbdfe3/0x70d6b5fa1825e675 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.302971:0:24478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0758564e200 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:1.0:1789498851.302974:0:24478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fbbdfe3/0x70d6b5fa1825e675 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.302981:0:24478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fbbdfe3/0x70d6b5fa1825e675 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.302990:0:24478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fbbdfe3/0x70d6b5fa1825e675 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.303004:0:24478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fbbdfe3/0x70d6b5fa1825e675 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.303018:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498851.303020:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498851.303022:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498851.303310:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498851.303315:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057d74ace/0x70d6b5fa1825e67c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.303323:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=685s v=(0 0) 00010000:00010000:1.0:1789498851.303327:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498851.303331:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057d74ace/0x70d6b5fa1825e67c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.303340:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057d74ace/0x70d6b5fa1825e67c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.303348:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057d74ace/0x70d6b5fa1825e67c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.303354:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057d74ace/0x70d6b5fa1825e67c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.303370:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498851.303377:0:24478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498851.303386:0:24478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057d74ace/0x70d6b5fa1825e67c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.303393:0:24478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0758564f600 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:1.0:1789498851.303397:0:24478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057d74ace/0x70d6b5fa1825e67c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.303404:0:24478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057d74ace/0x70d6b5fa1825e67c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.303416:0:24478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057d74ace/0x70d6b5fa1825e67c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.303424:0:24478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057d74ace/0x70d6b5fa1825e67c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.303438:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498851.303439:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498851.303441:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498851.303713:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916203008 00000100:00100000:2.0:1789498851.303725:0:24169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916203008 00010000:00010000:2.0:1789498851.303739:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498851.303802:0:24475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789498851.303816:0:24475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23404:x1876424916203008:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1789498851.303968:0:24475:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00010000:00010000:0.0:1789498851.305326:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789498851.305461:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789498851.305469:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051941c44/0x70d6b5fa1825e683 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.305484:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=685s v=(0 0) 00010000:00010000:1.0:1789498851.305488:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498851.305494:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051941c44/0x70d6b5fa1825e683 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.305517:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051941c44/0x70d6b5fa1825e683 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.305527:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051941c44/0x70d6b5fa1825e683 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.305561:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051941c44/0x70d6b5fa1825e683 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.305581:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789498851.306126:0:24478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498851.306136:0:24478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051941c44/0x70d6b5fa1825e683 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.306146:0:24478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0758564fe00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:0.0:1789498851.306152:0:24478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051941c44/0x70d6b5fa1825e683 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.306170:0:24478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051941c44/0x70d6b5fa1825e683 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.306190:0:24478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051941c44/0x70d6b5fa1825e683 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.306197:0:24478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051941c44/0x70d6b5fa1825e683 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.306231:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498851.306234:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498851.306235:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498851.322292:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789498851.322306:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000868f0103/0x70d6b5fa1825e68a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.322325:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1789498851.322330:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498851.322337:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000868f0103/0x70d6b5fa1825e68a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.322353:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000868f0103/0x70d6b5fa1825e68a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.322364:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000868f0103/0x70d6b5fa1825e68a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.322379:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000868f0103/0x70d6b5fa1825e68a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.322404:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498851.322735:0:22646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498851.322743:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000868f0103/0x70d6b5fa1825e68a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.322752:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076bc6d8e00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498851.322757:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000868f0103/0x70d6b5fa1825e68a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.322766:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000868f0103/0x70d6b5fa1825e68a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.322789:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000868f0103/0x70d6b5fa1825e68a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.322797:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000868f0103/0x70d6b5fa1825e68a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.322816:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498851.322818:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498851.322820:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498851.323643:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789498851.323651:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e052a8d/0x70d6b5fa1825e691 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.323663:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1789498851.323667:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498851.323671:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e052a8d/0x70d6b5fa1825e691 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.323682:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e052a8d/0x70d6b5fa1825e691 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.323690:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e052a8d/0x70d6b5fa1825e691 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.323697:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e052a8d/0x70d6b5fa1825e691 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.323718:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498851.324116:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498851.324123:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e052a8d/0x70d6b5fa1825e691 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.324131:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076bc6d9e00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498851.324135:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e052a8d/0x70d6b5fa1825e691 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.324152:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e052a8d/0x70d6b5fa1825e691 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.324179:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e052a8d/0x70d6b5fa1825e691 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.324188:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e052a8d/0x70d6b5fa1825e691 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.324205:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498851.324207:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498851.324208:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498851.325412:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789498851.325421:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2e7654d/0x70d6b5fa1825e698 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.325441:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1789498851.325445:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498851.325452:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2e7654d/0x70d6b5fa1825e698 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.325464:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2e7654d/0x70d6b5fa1825e698 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.325474:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2e7654d/0x70d6b5fa1825e698 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.325480:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2e7654d/0x70d6b5fa1825e698 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.325506:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789498851.325700:0:24478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789498851.325706:0:24478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2e7654d/0x70d6b5fa1825e698 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.325715:0:24478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076bc6d8800 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:3.0:1789498851.325726:0:24478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2e7654d/0x70d6b5fa1825e698 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.325737:0:24478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2e7654d/0x70d6b5fa1825e698 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.325756:0:24478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2e7654d/0x70d6b5fa1825e698 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.325764:0:24478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2e7654d/0x70d6b5fa1825e698 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.325783:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498851.325785:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789498851.325787:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498851.329405:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789498851.329421:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3d03e3a/0x70d6b5fa1825e69f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.329437:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1789498851.329443:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498851.329450:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3d03e3a/0x70d6b5fa1825e69f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.329464:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3d03e3a/0x70d6b5fa1825e69f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.329490:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3d03e3a/0x70d6b5fa1825e69f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.329499:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3d03e3a/0x70d6b5fa1825e69f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.329521:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498851.330093:0:22646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498851.330104:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3d03e3a/0x70d6b5fa1825e69f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.330113:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076bc6d9a00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498851.330119:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3d03e3a/0x70d6b5fa1825e69f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.330134:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3d03e3a/0x70d6b5fa1825e69f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.330157:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3d03e3a/0x70d6b5fa1825e69f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.330177:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3d03e3a/0x70d6b5fa1825e69f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.330199:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498851.330200:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498851.330202:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498851.332249:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789498851.332261:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014012181/0x70d6b5fa1825e6a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.332279:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1789498851.332284:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498851.332291:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014012181/0x70d6b5fa1825e6a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.332306:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014012181/0x70d6b5fa1825e6a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.332318:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014012181/0x70d6b5fa1825e6a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.332326:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014012181/0x70d6b5fa1825e6a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.332363:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498851.332700:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498851.332707:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014012181/0x70d6b5fa1825e6a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.332715:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076bc6d9c00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498851.332720:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014012181/0x70d6b5fa1825e6a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.332729:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014012181/0x70d6b5fa1825e6a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.332745:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014012181/0x70d6b5fa1825e6a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.332753:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014012181/0x70d6b5fa1825e6a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.332772:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498851.332774:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498851.332776:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498851.334105:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789498851.334115:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f932366e/0x70d6b5fa1825e6ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.334130:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1789498851.334135:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498851.334141:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f932366e/0x70d6b5fa1825e6ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.334154:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f932366e/0x70d6b5fa1825e6ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.334164:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f932366e/0x70d6b5fa1825e6ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.334172:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f932366e/0x70d6b5fa1825e6ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.334193:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789498851.334202:0:24478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789498851.334206:0:24478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f932366e/0x70d6b5fa1825e6ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.334224:0:24478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076bc6d9800 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:0.0:1789498851.334237:0:24478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f932366e/0x70d6b5fa1825e6ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.334246:0:24478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f932366e/0x70d6b5fa1825e6ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.334260:0:24478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f932366e/0x70d6b5fa1825e6ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.334267:0:24478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f932366e/0x70d6b5fa1825e6ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.334282:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498851.334284:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498851.334285:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789498851.335244:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789498851.335252:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aadc6159/0x70d6b5fa1825e6b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.335264:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1789498851.335268:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498851.335272:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aadc6159/0x70d6b5fa1825e6b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.335284:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aadc6159/0x70d6b5fa1825e6b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.335292:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aadc6159/0x70d6b5fa1825e6b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.335306:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aadc6159/0x70d6b5fa1825e6b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498851.335325:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498851.335860:0:22646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498851.335869:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aadc6159/0x70d6b5fa1825e6b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.335877:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0768bda9200 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498851.335882:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aadc6159/0x70d6b5fa1825e6b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.335891:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aadc6159/0x70d6b5fa1825e6b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.335905:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aadc6159/0x70d6b5fa1825e6b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.335913:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aadc6159/0x70d6b5fa1825e6b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.335927:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498851.335929:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498851.335931:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789498851.339037:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789498851.339050:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000892b67bb/0x70d6b5fa1825e6bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.339068:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1789498851.339073:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498851.339079:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000892b67bb/0x70d6b5fa1825e6bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.339093:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000892b67bb/0x70d6b5fa1825e6bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.339104:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000892b67bb/0x70d6b5fa1825e6bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.339119:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000892b67bb/0x70d6b5fa1825e6bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.339133:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498851.339420:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498851.339428:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000892b67bb/0x70d6b5fa1825e6bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.339437:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a0c00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498851.339443:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000892b67bb/0x70d6b5fa1825e6bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.339462:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000892b67bb/0x70d6b5fa1825e6bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.339479:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000892b67bb/0x70d6b5fa1825e6bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.339487:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000892b67bb/0x70d6b5fa1825e6bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.339503:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498851.339505:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498851.339507:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789498851.341748:0:24984:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:0.0:1789498851.341779:0:24984:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789498851.341796:0:24984:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:3.0:1789498851.345842:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789498851.345865:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c898b7cc/0x70d6b5fa1825e6c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.345883:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1789498851.345888:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498851.345895:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c898b7cc/0x70d6b5fa1825e6c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.345909:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c898b7cc/0x70d6b5fa1825e6c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.345919:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c898b7cc/0x70d6b5fa1825e6c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.345927:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c898b7cc/0x70d6b5fa1825e6c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.345954:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498851.346247:0:24478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498851.346256:0:24478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c898b7cc/0x70d6b5fa1825e6c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.346265:0:24478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a0a00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498851.346270:0:24478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c898b7cc/0x70d6b5fa1825e6c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.346281:0:24478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c898b7cc/0x70d6b5fa1825e6c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.346300:0:24478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c898b7cc/0x70d6b5fa1825e6c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.346320:0:24478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c898b7cc/0x70d6b5fa1825e6c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.346338:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498851.346340:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498851.346342:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789498851.347560:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789498851.347571:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061ef2099/0x70d6b5fa1825e6c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.347589:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1789498851.347593:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498851.347598:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061ef2099/0x70d6b5fa1825e6c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.347609:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061ef2099/0x70d6b5fa1825e6c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.347631:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061ef2099/0x70d6b5fa1825e6c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.347639:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061ef2099/0x70d6b5fa1825e6c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498851.348625:0:24475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23404:x1876424916203008:12345-0@lo:5:osp-pre-1-1.0 Request processed in 44794us (57762us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1789498851.348638:0:24475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789498851.348695:0:23404:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1789498851.348703:0:23404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc570e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23404:1876424916203008:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1789498851.348719:0:23404:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:1.0:1789498851.348767:0:23404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588237800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23404:1876424916203136:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1789498851.348804:0:23404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498851.348826:0:23404:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076ab3e2000 going to sleep for 11 seconds 00000100:00100000:1.0:1789498851.348957:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916203136 00000100:00100000:1.0:1789498851.348965:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916203136 00000100:00100000:1.0:1789498851.349005:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789498851.349015:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23404:x1876424916203136:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1789498851.349062:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23404:x1876424916203136:12345-0@lo:900:osp-pre-1-1.0 Request processed in 49us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498851.349076:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789498851.349113:0:23404:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa07588237800 x1876424916203136/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789498867 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498851.349124:0:23404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588237800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23404:1876424916203136:0@lo:900:osp-pre-1-1.0 00010000:00010000:3.0:1789498851.352886:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789498851.353714:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789498851.353723:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc0d60a0/0x70d6b5fa1825e6d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.353740:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1789498851.353745:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498851.353751:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc0d60a0/0x70d6b5fa1825e6d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.353765:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc0d60a0/0x70d6b5fa1825e6d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.353788:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc0d60a0/0x70d6b5fa1825e6d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.353796:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc0d60a0/0x70d6b5fa1825e6d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.353813:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789498851.354207:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789498851.354224:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005aa6c222/0x70d6b5fa1825e6d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.354234:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1789498851.354237:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498851.354241:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005aa6c222/0x70d6b5fa1825e6d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.354251:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005aa6c222/0x70d6b5fa1825e6d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.354259:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005aa6c222/0x70d6b5fa1825e6d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.354267:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005aa6c222/0x70d6b5fa1825e6d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.354298:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789498851.354676:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789498851.354683:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000082ddf4b/0x70d6b5fa1825e6de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.354693:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1789498851.354696:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498851.354700:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000082ddf4b/0x70d6b5fa1825e6de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.354709:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000082ddf4b/0x70d6b5fa1825e6de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.354717:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000082ddf4b/0x70d6b5fa1825e6de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.354724:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000082ddf4b/0x70d6b5fa1825e6de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.354733:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1789498851.355277:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789498851.355283:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000892b67bb/0x70d6b5fa1825e6e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.355292:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1789498851.355302:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498851.355307:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000892b67bb/0x70d6b5fa1825e6e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.355318:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000892b67bb/0x70d6b5fa1825e6e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.355327:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000892b67bb/0x70d6b5fa1825e6e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.355334:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000892b67bb/0x70d6b5fa1825e6e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.355343:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1789498851.355639:0:22646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789498851.355648:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061ef2099/0x70d6b5fa1825e6c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.355657:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a0400 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498851.355661:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061ef2099/0x70d6b5fa1825e6c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.355671:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061ef2099/0x70d6b5fa1825e6c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.355687:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061ef2099/0x70d6b5fa1825e6c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.355694:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061ef2099/0x70d6b5fa1825e6c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.355713:0:22646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789498851.355716:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc0d60a0/0x70d6b5fa1825e6d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.355729:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a1e00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498851.355732:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc0d60a0/0x70d6b5fa1825e6d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.355740:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc0d60a0/0x70d6b5fa1825e6d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.355749:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc0d60a0/0x70d6b5fa1825e6d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.355756:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc0d60a0/0x70d6b5fa1825e6d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.355767:0:22646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789498851.355771:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005aa6c222/0x70d6b5fa1825e6d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.355777:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a0600 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498851.355781:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005aa6c222/0x70d6b5fa1825e6d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.355788:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005aa6c222/0x70d6b5fa1825e6d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.355797:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005aa6c222/0x70d6b5fa1825e6d7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.355809:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005aa6c222/0x70d6b5fa1825e6d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.355822:0:22646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789498851.355825:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000082ddf4b/0x70d6b5fa1825e6de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.355831:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a1200 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498851.355834:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000082ddf4b/0x70d6b5fa1825e6de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.355842:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000082ddf4b/0x70d6b5fa1825e6de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.355862:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000082ddf4b/0x70d6b5fa1825e6de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.355870:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000082ddf4b/0x70d6b5fa1825e6de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.355882:0:22646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498851.355885:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000892b67bb/0x70d6b5fa1825e6e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.355891:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a0c00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498851.355900:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000892b67bb/0x70d6b5fa1825e6e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.355909:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000892b67bb/0x70d6b5fa1825e6e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.355919:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000892b67bb/0x70d6b5fa1825e6e5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.355926:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000892b67bb/0x70d6b5fa1825e6e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.355940:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498851.355941:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498851.355943:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498851.355951:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498851.355957:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789498851.356142:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789498851.356148:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d073fbd8/0x70d6b5fa1825e6ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.356157:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1789498851.356161:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498851.356165:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d073fbd8/0x70d6b5fa1825e6ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.356176:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d073fbd8/0x70d6b5fa1825e6ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.356184:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d073fbd8/0x70d6b5fa1825e6ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.356197:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d073fbd8/0x70d6b5fa1825e6ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.356228:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789498851.356501:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789498851.356507:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f529e53d/0x70d6b5fa1825e6f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.356516:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1789498851.356519:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498851.356524:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f529e53d/0x70d6b5fa1825e6f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.356596:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f529e53d/0x70d6b5fa1825e6f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.356606:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f529e53d/0x70d6b5fa1825e6f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.356666:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f529e53d/0x70d6b5fa1825e6f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.356681:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789498851.356985:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789498851.356991:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c73e8ca/0x70d6b5fa1825e6fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.357006:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1789498851.357010:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498851.357015:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c73e8ca/0x70d6b5fa1825e6fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.357024:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c73e8ca/0x70d6b5fa1825e6fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.357033:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c73e8ca/0x70d6b5fa1825e6fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.357039:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c73e8ca/0x70d6b5fa1825e6fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.357051:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789498851.357326:0:22646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789498851.357335:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d073fbd8/0x70d6b5fa1825e6ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.357343:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a0200 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498851.357347:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d073fbd8/0x70d6b5fa1825e6ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.357356:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d073fbd8/0x70d6b5fa1825e6ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.357383:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d073fbd8/0x70d6b5fa1825e6ec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.357389:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d073fbd8/0x70d6b5fa1825e6ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.357409:0:22646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789498851.357413:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f529e53d/0x70d6b5fa1825e6f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.357419:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a0800 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498851.357422:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f529e53d/0x70d6b5fa1825e6f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.357429:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f529e53d/0x70d6b5fa1825e6f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.357438:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f529e53d/0x70d6b5fa1825e6f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.357445:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f529e53d/0x70d6b5fa1825e6f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.357455:0:22646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498851.357459:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c73e8ca/0x70d6b5fa1825e6fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.357471:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a1000 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498851.357475:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c73e8ca/0x70d6b5fa1825e6fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.357483:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c73e8ca/0x70d6b5fa1825e6fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.357495:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c73e8ca/0x70d6b5fa1825e6fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.357502:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c73e8ca/0x70d6b5fa1825e6fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.357517:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498851.357519:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498851.357520:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498851.357529:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789498851.357723:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789498851.357729:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3cd7775/0x70d6b5fa1825e701 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.357738:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1789498851.357742:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498851.357746:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3cd7775/0x70d6b5fa1825e701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.357757:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3cd7775/0x70d6b5fa1825e701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.357776:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3cd7775/0x70d6b5fa1825e701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.357783:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3cd7775/0x70d6b5fa1825e701 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.357797:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498851.357948:0:24478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498851.357954:0:24478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3cd7775/0x70d6b5fa1825e701 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.357962:0:24478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a1800 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498851.357965:0:24478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3cd7775/0x70d6b5fa1825e701 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.357985:0:24478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3cd7775/0x70d6b5fa1825e701 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.357998:0:24478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3cd7775/0x70d6b5fa1825e701 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.358005:0:24478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3cd7775/0x70d6b5fa1825e701 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.358020:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498851.358022:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498851.358024:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498851.358029:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789498851.361116:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789498851.361134:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff27f7af/0x70d6b5fa1825e708 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.361152:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1789498851.361157:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498851.361164:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff27f7af/0x70d6b5fa1825e708 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.361180:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff27f7af/0x70d6b5fa1825e708 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.361192:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff27f7af/0x70d6b5fa1825e708 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.361200:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff27f7af/0x70d6b5fa1825e708 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.361249:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789498851.361959:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498851.361970:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff27f7af/0x70d6b5fa1825e708 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.361981:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c0dab200 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:2.0:1789498851.361986:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff27f7af/0x70d6b5fa1825e708 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.361997:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff27f7af/0x70d6b5fa1825e708 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.362020:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff27f7af/0x70d6b5fa1825e708 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.362036:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff27f7af/0x70d6b5fa1825e708 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498851.362055:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498851.362056:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498851.362058:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789498851.365074:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789498851.365092:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f44cc6d1/0x70d6b5fa1825e70f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.365108:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1789498851.365112:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498851.365119:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f44cc6d1/0x70d6b5fa1825e70f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.365133:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f44cc6d1/0x70d6b5fa1825e70f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.365143:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f44cc6d1/0x70d6b5fa1825e70f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.365151:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f44cc6d1/0x70d6b5fa1825e70f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.365180:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498851.365510:0:24478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498851.365519:0:24478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f44cc6d1/0x70d6b5fa1825e70f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.365527:0:24478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c0daac00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:1.0:1789498851.365554:0:24478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f44cc6d1/0x70d6b5fa1825e70f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.365564:0:24478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f44cc6d1/0x70d6b5fa1825e70f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.365582:0:24478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f44cc6d1/0x70d6b5fa1825e70f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.365589:0:24478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f44cc6d1/0x70d6b5fa1825e70f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.365605:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498851.365607:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498851.365608:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789498851.365813:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789498851.365819:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f080acf/0x70d6b5fa1825e716 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.365828:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1789498851.365837:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498851.365842:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f080acf/0x70d6b5fa1825e716 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.365864:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f080acf/0x70d6b5fa1825e716 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.365873:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f080acf/0x70d6b5fa1825e716 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.365880:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f080acf/0x70d6b5fa1825e716 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.365900:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498851.366184:0:22646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498851.366190:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f080acf/0x70d6b5fa1825e716 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.366204:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c0daae00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:1.0:1789498851.366208:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f080acf/0x70d6b5fa1825e716 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.366227:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f080acf/0x70d6b5fa1825e716 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.366239:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f080acf/0x70d6b5fa1825e716 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.366245:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f080acf/0x70d6b5fa1825e716 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.366260:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498851.366262:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498851.366264:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789498851.366334:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789498851.366339:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4619990/0x70d6b5fa1825e71d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.366348:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1789498851.366351:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498851.366355:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4619990/0x70d6b5fa1825e71d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.366365:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4619990/0x70d6b5fa1825e71d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.366374:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4619990/0x70d6b5fa1825e71d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.366387:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4619990/0x70d6b5fa1825e71d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.366408:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789498851.366641:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498851.366648:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4619990/0x70d6b5fa1825e71d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.366656:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c0dabe00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:1.0:1789498851.366659:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4619990/0x70d6b5fa1825e71d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.366667:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4619990/0x70d6b5fa1825e71d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.366684:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4619990/0x70d6b5fa1825e71d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.366692:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4619990/0x70d6b5fa1825e71d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.366704:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498851.366706:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498851.366708:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789498851.366824:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789498851.366831:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d28592b/0x70d6b5fa1825e724 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.366841:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=685s v=(0 0) 00010000:00010000:3.0:1789498851.366856:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498851.366860:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d28592b/0x70d6b5fa1825e724 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.366870:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d28592b/0x70d6b5fa1825e724 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.366880:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d28592b/0x70d6b5fa1825e724 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.366887:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d28592b/0x70d6b5fa1825e724 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498851.366906:0:24168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1789498851.366939:0:24168:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:3.0:1789498851.367038:0:24168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22685:x1876424916202496:12345-0@lo:5:osp-pre-1-0.0 Request processed in 102012us (102372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498851.367054:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789498851.367115:0:22685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07684c14000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22685:1876424916202496:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789498851.367131:0:22685:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:3.0:1789498851.367180:0:22685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc573800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22685:1876424916203264:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789498851.367229:0:22685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498851.367258:0:22685:0:(client.c:2716:ptlrpc_set_wait()) set ffffa0769fa85900 going to sleep for 11 seconds 00000100:00100000:3.0:1789498851.367274:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916203264 00000100:00100000:3.0:1789498851.367279:0:24168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916203264 00000100:00100000:3.0:1789498851.367317:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789498851.367326:0:24168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22685:x1876424916203264:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789498851.367364:0:24168:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00010000:00010000:1.0:1789498851.367678:0:24478:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498851.367684:0:24478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d28592b/0x70d6b5fa1825e724 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.367693:0:24478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c0dab000 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:1.0:1789498851.367697:0:24478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d28592b/0x70d6b5fa1825e724 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.367706:0:24478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d28592b/0x70d6b5fa1825e724 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.367723:0:24478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d28592b/0x70d6b5fa1825e724 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.367730:0:24478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d28592b/0x70d6b5fa1825e724 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498851.367758:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498851.367759:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498851.367761:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498851.378517:0:24168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22685:x1876424916203264:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11185us (11281us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1789498851.378558:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789498851.378737:0:22685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc573800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22685:1876424916203264:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789498851.378752:0:22685:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:1.0:1789498851.837356:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789498852.286702:0:23413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789498852.860103:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789498853.219039:0:25342:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg417-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789498853.884019:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789498854.258425:0:25394:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789498854.258993:0:25394:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789498854.843887:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789498854.843911:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876424916203392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789498854.843979:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498854.844090:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916203392 00000100:00100000:3.0:1789498854.844098:0:24171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916203392 00000100:00100000:3.0:1789498854.844201:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789498854.844212:0:24171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876424916203392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498854.844243:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789498854.844289:0:24171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876424916203392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498854.844296:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789498854.845611:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789498854.846932:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876424916203392:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789498854.916608:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789498855.257075:0:25444:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789498855.257431:0:25444:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789498855.359886:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876424916203520:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789498855.359963:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498855.360048:0:23400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916203520 00000100:00100000:3.0:1789498855.360058:0:23400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916203520 00000100:00100000:3.0:1789498855.360116:0:23400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789498855.360146:0:23400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876424916203520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789498855.360187:0:23400:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789498855.369866:0:23400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876424916203520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 9722us (9890us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498855.369883:0:23400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789498855.370941:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876424916203520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789498855.488383:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498855.488498:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896165888 00000100:00100000:1.0:1789498855.488509:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896165888 00000100:00100000:1.0:1789498855.488576:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 119 00000100:00100000:1.0:1789498855.488586:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586704850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2391:x1876424896165888:12345-192.168.204.17@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789498855.488619:0:22651:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 116bdd0f-0dd7-4d85-9352-94b0af277561@192.168.204.17@tcp t0 exp 0000000000000000 cur 689 last 0 00000020:00000080:1.0:1789498855.488646:0:22651:0:(genops.c:1384:class_connect()) connect: client 116bdd0f-0dd7-4d85-9352-94b0af277561, cookie 0x70d6b5fa1825e72b 00000100:00080000:1.0:1789498855.488852:0:22651:0:(import.c:65:import_set_state_nolock()) ffffa0769f634000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789498855.488926:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586704850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:116bdd0f-0dd7-4d85-9352-94b0af277561+5:2391:x1876424896165888:12345-192.168.204.17@tcp:250:mount.lustre.0 Request processed in 339us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498855.488935:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 119 00000100:00100000:0.0:1789498855.496606:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498855.496826:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896166016 00000100:00100000:2.0:1789498855.496837:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896166016 00000100:00100000:2.0:1789498855.496927:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 120 00000100:00100000:2.0:1789498855.496939:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586706050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:116bdd0f-0dd7-4d85-9352-94b0af277561+5:18035:x1876424896166016:12345-192.168.204.17@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789498855.496959:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498855.496981:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa076c1571000/0x70d6b5fa1825e732 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f244 expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498855.497013:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa076c1571000/0x70d6b5fa1825e732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f244 expref: 6 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498855.497025:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa076c1571000/0x70d6b5fa1825e732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f244 expref: 6 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498855.497050:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa076c1571000, rc 0) 00000100:00100000:2.0:1789498855.497112:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586706050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:116bdd0f-0dd7-4d85-9352-94b0af277561+6:18035:x1876424896166016:12345-192.168.204.17@tcp:101:mount.lustre.0 Request processed in 176us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498855.497119:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 120 00000100:00100000:3.0:1789498855.499223:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:0.0:1789498855.499499:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896166144 00000100:00100000:0.0:1789498855.499508:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896166144 00000100:00100000:0.0:1789498855.499861:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 121 00000100:00100000:0.0:1789498855.499874:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586706850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:116bdd0f-0dd7-4d85-9352-94b0af277561+6:18035:x1876424896166144:12345-192.168.204.17@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789498855.500027:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586706850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:116bdd0f-0dd7-4d85-9352-94b0af277561+6:18035:x1876424896166144:12345-192.168.204.17@tcp:501:mount.lustre.0 Request processed in 156us (813us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789498855.500035:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 121 00000100:00100000:3.0:1789498855.506983:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498855.507067:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896166272 00000100:00100000:2.0:1789498855.507077:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896166272 00000100:00100000:2.0:1789498855.507129:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 122 00000100:00100000:2.0:1789498855.507150:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:116bdd0f-0dd7-4d85-9352-94b0af277561+6:18035:x1876424896166272:12345-192.168.204.17@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789498855.507167:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498855.507185:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa076c1570a00/0x70d6b5fa1825e739 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f24b expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498855.507212:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa076c1570a00/0x70d6b5fa1825e739 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f24b expref: 7 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498855.507222:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa076c1570a00/0x70d6b5fa1825e739 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f24b expref: 7 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498855.507232:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa076c1570a00, rc 0) 00000100:00100000:2.0:1789498855.507294:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:116bdd0f-0dd7-4d85-9352-94b0af277561+7:18035:x1876424896166272:12345-192.168.204.17@tcp:101:mount.lustre.0 Request processed in 146us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498855.507301:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 122 00000100:00100000:3.0:1789498855.520329:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:0.0:1789498855.520459:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896166400 00000100:00100000:0.0:1789498855.520471:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896166400 00000100:00100000:0.0:1789498855.520598:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 123 00000100:00100000:1.0:1789498855.520644:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586707450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:116bdd0f-0dd7-4d85-9352-94b0af277561+7:18035:x1876424896166400:12345-192.168.204.17@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789498855.520847:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586707450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:116bdd0f-0dd7-4d85-9352-94b0af277561+8:18035:x1876424896166400:12345-192.168.204.17@tcp:501:mount.lustre.0 Request processed in 239us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498855.520856:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 123 00000100:00100000:3.0:1789498855.523988:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498855.524113:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896166528 00000100:00100000:1.0:1789498855.524125:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896166528 00000100:00100000:1.0:1789498855.524277:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 124 00000100:00100000:1.0:1789498855.524290:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586706450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:116bdd0f-0dd7-4d85-9352-94b0af277561+8:18035:x1876424896166528:12345-192.168.204.17@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789498855.524462:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586706450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:116bdd0f-0dd7-4d85-9352-94b0af277561+8:18035:x1876424896166528:12345-192.168.204.17@tcp:503:mount.lustre.0 Request processed in 173us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498855.524471:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 124 00000100:00100000:3.0:1789498855.528955:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498855.529082:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896166656 00000100:00100000:1.0:1789498855.529094:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896166656 00000100:00100000:1.0:1789498855.529200:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 125 00000100:00100000:1.0:1789498855.529211:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586705850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:116bdd0f-0dd7-4d85-9352-94b0af277561+8:18053:x1876424896166656:12345-192.168.204.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789498855.529432:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586705850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:116bdd0f-0dd7-4d85-9352-94b0af277561+8:18053:x1876424896166656:12345-192.168.204.17@tcp:502:llog_process_th.0 Request processed in 223us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498855.529441:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 125 00000100:00100000:3.0:1789498855.551642:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498855.551933:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896166784 00000100:00100000:1.0:1789498855.551948:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896166784 00000100:00100000:1.0:1789498855.552043:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 126 00000100:00100000:1.0:1789498855.552059:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076b7161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:116bdd0f-0dd7-4d85-9352-94b0af277561+8:18053:x1876424896166784:12345-192.168.204.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789498855.552320:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076b7161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:116bdd0f-0dd7-4d85-9352-94b0af277561+8:18053:x1876424896166784:12345-192.168.204.17@tcp:502:llog_process_th.0 Request processed in 264us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498855.552330:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 126 00000100:00100000:3.0:1789498855.566363:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498855.566712:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896166912 00000100:00100000:1.0:1789498855.566725:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896166912 00000100:00100000:1.0:1789498855.567663:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 127 00000100:00100000:1.0:1789498855.567681:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076b7161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:116bdd0f-0dd7-4d85-9352-94b0af277561+8:18053:x1876424896166912:12345-192.168.204.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789498855.567868:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076b7161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:116bdd0f-0dd7-4d85-9352-94b0af277561+8:18053:x1876424896166912:12345-192.168.204.17@tcp:502:llog_process_th.0 Request processed in 193us (1620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498855.567887:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 127 00000100:00100000:3.0:1789498855.583778:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498855.584940:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896167040 00000100:00100000:2.0:1789498855.584956:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896167040 00000100:00100000:2.0:1789498855.585037:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 128 00000100:00100000:2.0:1789498855.585047:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:116bdd0f-0dd7-4d85-9352-94b0af277561+8:18035:x1876424896167040:12345-192.168.204.17@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789498855.585076:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498855.585096:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa075874a1800/0x70d6b5fa1825e740 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f27c expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498855.585126:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa075874a1800/0x70d6b5fa1825e740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f27c expref: 9 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498855.585152:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa075874a1800/0x70d6b5fa1825e740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f27c expref: 9 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498855.585160:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa075874a1800, rc 0) 00000100:00100000:2.0:1789498855.585225:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:116bdd0f-0dd7-4d85-9352-94b0af277561+9:18035:x1876424896167040:12345-192.168.204.17@tcp:101:mount.lustre.0 Request processed in 180us (1458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498855.585232:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 128 00000100:00100000:3.0:1789498855.592050:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498855.592116:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896167168 00000100:00100000:1.0:1789498855.592140:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896167168 00000100:00100000:1.0:1789498855.592204:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 129 00000100:00100000:1.0:1789498855.592217:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:116bdd0f-0dd7-4d85-9352-94b0af277561+9:18035:x1876424896167168:12345-192.168.204.17@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789498855.592252:0:22653:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789498855.592280:0:22653:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789498855.592284:0:22653:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789498855.592287:0:22653:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789498855.592290:0:22653:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789498855.592293:0:22653:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1789498855.596172:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:116bdd0f-0dd7-4d85-9352-94b0af277561+9:18035:x1876424896167168:12345-192.168.204.17@tcp:256:mount.lustre.0 Request processed in 3945us (4120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498855.596187:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 129 00000100:00100000:2.0:1789498855.608886:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:0.0:1789498855.610127:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896167296 00000100:00100000:0.0:1789498855.610151:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896167296 00000100:00100000:0.0:1789498855.610219:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 130 00000100:00100000:0.0:1789498855.610229:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:116bdd0f-0dd7-4d85-9352-94b0af277561+9:18035:x1876424896167296:12345-192.168.204.17@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789498855.610247:0:22651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498855.610276:0:22651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0768bda8000/0x70d6b5fa1825e747 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f283 expref: -99 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498855.610307:0:22651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0768bda8000/0x70d6b5fa1825e747 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f283 expref: 10 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498855.610320:0:22651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0768bda8000/0x70d6b5fa1825e747 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f283 expref: 10 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498855.610329:0:22651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0768bda8000, rc 0) 00000100:00100000:0.0:1789498855.610523:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:116bdd0f-0dd7-4d85-9352-94b0af277561+10:18035:x1876424896167296:12345-192.168.204.17@tcp:101:mount.lustre.0 Request processed in 295us (1647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498855.610684:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 130 00000100:00100000:2.0:1789498855.612421:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498855.612744:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896167424 00000100:00100000:1.0:1789498855.612754:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896167424 00000100:00100000:1.0:1789498855.612805:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 131 00000100:00100000:1.0:1789498855.612815:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:116bdd0f-0dd7-4d85-9352-94b0af277561+10:18035:x1876424896167424:12345-192.168.204.17@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789498855.612964:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:116bdd0f-0dd7-4d85-9352-94b0af277561+10:18035:x1876424896167424:12345-192.168.204.17@tcp:501:mount.lustre.0 Request processed in 149us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498855.612982:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 131 00000100:00100000:1.0:1789498855.618230:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498855.618351:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896167552 00000100:00100000:2.0:1789498855.618363:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896167552 00000100:00100000:2.0:1789498855.618428:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 132 00000100:00100000:2.0:1789498855.618439:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:116bdd0f-0dd7-4d85-9352-94b0af277561+10:18035:x1876424896167552:12345-192.168.204.17@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789498855.618950:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:116bdd0f-0dd7-4d85-9352-94b0af277561+10:18035:x1876424896167552:12345-192.168.204.17@tcp:503:mount.lustre.0 Request processed in 510us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498855.618958:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 132 00000100:00100000:2.0:1789498855.623020:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:0.0:1789498855.623503:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896167680 00000100:00100000:0.0:1789498855.623515:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896167680 00000100:00100000:0.0:1789498855.623623:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 133 00000100:00100000:0.0:1789498855.623635:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:116bdd0f-0dd7-4d85-9352-94b0af277561+10:18060:x1876424896167680:12345-192.168.204.17@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789498855.623812:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:116bdd0f-0dd7-4d85-9352-94b0af277561+10:18060:x1876424896167680:12345-192.168.204.17@tcp:502:llog_process_th.0 Request processed in 178us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498855.623820:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 133 00000100:00100000:0.0:1789498855.629715:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498855.629896:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896167808 00000100:00100000:2.0:1789498855.629908:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896167808 00000100:00100000:2.0:1789498855.629959:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 134 00000100:00100000:2.0:1789498855.630160:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:116bdd0f-0dd7-4d85-9352-94b0af277561+10:18060:x1876424896167808:12345-192.168.204.17@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789498855.630465:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:116bdd0f-0dd7-4d85-9352-94b0af277561+10:18060:x1876424896167808:12345-192.168.204.17@tcp:502:llog_process_th.0 Request processed in 308us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498855.630472:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 134 00000100:00100000:1.0:1789498855.639446:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498855.639675:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:0.0:1789498855.644760:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896167936 00000100:00100000:0.0:1789498855.644793:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896167936 00000100:00100000:0.0:1789498855.644883:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896168192 00000100:00100000:0.0:1789498855.644887:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896168192 00000100:00100000:0.0:1789498855.644911:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 7 00000100:00100000:0.0:1789498855.644920:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2391:x1876424896167936:12345-192.168.204.17@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789498855.644955:0:22660:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 7f01496a-f99d-4000-a86c-f777ddf70925@192.168.204.17@tcp t0 exp 0000000000000000 cur 689 last 0 00000020:00000080:0.0:1789498855.646691:0:22660:0:(genops.c:1384:class_connect()) connect: client 7f01496a-f99d-4000-a86c-f777ddf70925, cookie 0x70d6b5fa1825e74e 00000004:00100000:0.0:1789498855.646731:0:22660:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789498855.646968:0:22660:0:(import.c:65:import_set_state_nolock()) ffffa076bbe3e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789498855.647795:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f01496a-f99d-4000-a86c-f777ddf70925+6:2391:x1876424896167936:12345-192.168.204.17@tcp:38:mount.lustre.0 Request processed in 2872us (8358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498855.647811:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 7 00000100:00100000:0.0:1789498855.647844:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 8 00000100:00100000:0.0:1789498855.647850:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2391:x1876424896168192:12345-192.168.204.17@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789498855.647874:0:22660:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 7f01496a-f99d-4000-a86c-f777ddf70925@192.168.204.17@tcp t0 exp 0000000000000000 cur 689 last 0 00000020:00000080:0.0:1789498855.647909:0:22660:0:(genops.c:1384:class_connect()) connect: client 7f01496a-f99d-4000-a86c-f777ddf70925, cookie 0x70d6b5fa1825e755 00000004:00100000:0.0:1789498855.647926:0:22660:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789498855.648796:0:22660:0:(import.c:65:import_set_state_nolock()) ffffa076bbe3a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789498855.648840:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f01496a-f99d-4000-a86c-f777ddf70925+6:2391:x1876424896168192:12345-192.168.204.17@tcp:38:mount.lustre.0 Request processed in 988us (9164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498855.648848:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 8 00000100:00100000:0.0:1789498855.664215:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:0.0:1789498855.664345:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498855.664492:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896168064 00000100:00100000:1.0:1789498855.664505:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896168064 00000100:00100000:1.0:1789498855.664648:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896168448 00000100:00100000:1.0:1789498855.664652:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896168448 00000100:00100000:1.0:1789498855.664674:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 9 00000100:00100000:1.0:1789498855.664686:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f01496a-f99d-4000-a86c-f777ddf70925+7:0:x1876424896168064:12345-192.168.204.17@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789498855.664738:0:22660:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789498855.664836:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f01496a-f99d-4000-a86c-f777ddf70925+7:0:x1876424896168064:12345-192.168.204.17@tcp:41:mount.lustre.0 Request processed in 151us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498855.664843:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 9 00000100:00100000:1.0:1789498855.664861:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 10 00000100:00100000:1.0:1789498855.664868:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f01496a-f99d-4000-a86c-f777ddf70925+6:18035:x1876424896168448:12345-192.168.204.17@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789498855.664879:0:22660:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789498855.664900:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f01496a-f99d-4000-a86c-f777ddf70925+6:18035:x1876424896168448:12345-192.168.204.17@tcp:41:mount.lustre.0 Request processed in 32us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498855.664906:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 10 00000100:00100000:3.0:1789498855.665509:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00080000:0.0:1789498855.665650:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498855.665716:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896168320 00000100:00100000:2.0:1789498855.665723:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896168320 00000100:00100000:2.0:1789498855.665779:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 11 00000100:00100000:2.0:1789498855.665788:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f01496a-f99d-4000-a86c-f777ddf70925+6:0:x1876424896168320:12345-192.168.204.17@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789498855.665803:0:22659:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789498855.665853:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f01496a-f99d-4000-a86c-f777ddf70925+6:0:x1876424896168320:12345-192.168.204.17@tcp:41:mount.lustre.0 Request processed in 67us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498855.665860:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 11 00000100:00080000:0.0:1789498855.666041:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789498855.667352:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498855.667445:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896168576 00000100:00100000:2.0:1789498855.667453:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896168576 00000100:00100000:2.0:1789498855.667506:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 12 00000100:00100000:2.0:1789498855.667516:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f01496a-f99d-4000-a86c-f777ddf70925+6:18035:x1876424896168576:12345-192.168.204.17@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789498855.667614:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f01496a-f99d-4000-a86c-f777ddf70925+6:18035:x1876424896168576:12345-192.168.204.17@tcp:40:mount.lustre.0 Request processed in 100us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498855.667621:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 12 00000100:00100000:1.0:1789498855.675720:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498855.675821:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498855.675896:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498855.677974:0:24475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896168704 00000100:00100000:2.0:1789498855.677990:0:24475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896168704 00000100:00100000:2.0:1789498855.678051:0:24475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896168832 00000100:00100000:2.0:1789498855.678055:0:24475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896168832 00000100:00100000:2.0:1789498855.678084:0:24475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 23 00000100:00100000:2.0:1789498855.678093:0:24475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588237480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2391:x1876424896168704:12345-192.168.204.17@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789498855.678139:0:24475:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 7f01496a-f99d-4000-a86c-f777ddf70925@192.168.204.17@tcp t0 exp 0000000000000000 cur 689 last 0 00000020:00000080:2.0:1789498855.678184:0:24475:0:(genops.c:1384:class_connect()) connect: client 7f01496a-f99d-4000-a86c-f777ddf70925, cookie 0x70d6b5fa1825e75c 00002000:00100000:2.0:1789498855.678195:0:24475:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7f01496a-f99d-4000-a86c-f777ddf70925/ffffa076a9c52800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789498855.678207:0:24475:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789498855.678620:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 24 00000100:00100000:1.0:1789498855.678629:0:24169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2391:x1876424896168832:12345-192.168.204.17@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789498855.678651:0:24169:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 7f01496a-f99d-4000-a86c-f777ddf70925@192.168.204.17@tcp t0 exp 0000000000000000 cur 689 last 0 00000020:00000080:1.0:1789498855.678672:0:24169:0:(genops.c:1384:class_connect()) connect: client 7f01496a-f99d-4000-a86c-f777ddf70925, cookie 0x70d6b5fa1825e763 00002000:00100000:1.0:1789498855.678678:0:24169:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7f01496a-f99d-4000-a86c-f777ddf70925/ffffa0769f632800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789498855.678696:0:24169:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789498855.678847:0:24169:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789498855.678882:0:24169:0:(import.c:65:import_set_state_nolock()) ffffa0769f634800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789498855.678967:0:24169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f01496a-f99d-4000-a86c-f777ddf70925+6:2391:x1876424896168832:12345-192.168.204.17@tcp:8:mount.lustre.0 Request processed in 337us (3069us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498855.678975:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 24 00002000:00080000:2.0:1789498855.679327:0:24475:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789498855.679481:0:24475:0:(import.c:65:import_set_state_nolock()) ffffa076a9c53000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789498855.679678:0:24475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588237480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f01496a-f99d-4000-a86c-f777ddf70925+6:2391:x1876424896168704:12345-192.168.204.17@tcp:8:mount.lustre.0 Request processed in 1584us (3855us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498855.679685:0:24475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 23 00000100:00100000:3.0:1789498855.686312:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896168960 00000100:00100000:3.0:1789498855.686348:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896168960 00000100:00100000:3.0:1789498855.686433:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 3 00000100:00100000:3.0:1789498855.686445:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7f01496a-f99d-4000-a86c-f777ddf70925+6:18035:x1876424896168960:12345-192.168.204.17@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789498855.686573:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7f01496a-f99d-4000-a86c-f777ddf70925+6:18035:x1876424896168960:12345-192.168.204.17@tcp:900:mount.lustre.0 Request processed in 130us (11073us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498855.688594:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 3 00000100:00100000:1.0:1789498855.695365:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498855.695491:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896169088 00000100:00100000:2.0:1789498855.695658:0:22661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896169088 00000100:00100000:2.0:1789498855.695729:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 0 00000100:00100000:2.0:1789498855.695741:0:22661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f01496a-f99d-4000-a86c-f777ddf70925+6:18035:x1876424896169088:12345-192.168.204.17@tcp:33:mount.lustre.0 00000004:00080000:3.0:1789498855.705043:0:22661:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 9186us 00000004:00200000:1.0:1789498855.712227:0:22661:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789498855.712359:0:22661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f01496a-f99d-4000-a86c-f777ddf70925+6:18035:x1876424896169088:12345-192.168.204.17@tcp:33:mount.lustre.0 Request processed in 16615us (17004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498855.712374:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 0 00000100:00100000:2.0:1789498855.867851:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789498855.867882:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876424916203648:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789498855.867997:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498855.868222:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916203648 00000100:00100000:3.0:1789498855.868230:0:24171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916203648 00000100:00100000:3.0:1789498855.869222:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789498855.869242:0:24171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876424916203648:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789498855.869267:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789498855.869281:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789498855.869370:0:24171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876424916203648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 133us (1372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498855.869379:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789498855.869498:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1876424916203648:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789498855.934081:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498855.953942:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498855.961889:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896169216 00000100:00100000:1.0:1789498855.961908:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896169216 00000100:00100000:1.0:1789498855.962112:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 13 00000100:00100000:1.0:1789498855.962135:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f01496a-f99d-4000-a86c-f777ddf70925+6:18083:x1876424896169216:12345-192.168.204.17@tcp:101:mkdir.0 00010000:00010000:1.0:1789498855.962164:0:22660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498855.962195:0:22660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e800/0x70d6b5fa1825e76a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f2b4 expref: -99 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498855.962264:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e400/0x70d6b5fa1825e771 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498855.962279:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e400/0x70d6b5fa1825e771 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498855.962297:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e400/0x70d6b5fa1825e771 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498855.962370:0:22660:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789498855.962374:0:22660:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789498855.962441:0:22660:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e400/0x70d6b5fa1825e771 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498855.962474:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e800/0x70d6b5fa1825e76a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f2b4 expref: 8 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498855.962495:0:22660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e400/0x70d6b5fa1825e771 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f2b4 expref: 7 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498855.962505:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa076be804000) 00010000:00010000:1.0:1789498855.962509:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789498855.962512:0:22660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0758564e400, rc 0) 00000100:00100000:1.0:1789498855.962787:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f01496a-f99d-4000-a86c-f777ddf70925+7:18083:x1876424896169216:12345-192.168.204.17@tcp:101:mkdir.0 Request processed in 662us (8853us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498855.962795:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 13 00000100:00100000:2.0:1789498856.379699:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789498856.379726:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876424916203776:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789498856.379780:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789498856.379792:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916203904:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789498856.379800:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498856.379848:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498856.379858:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876424916204032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789498856.379887:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498856.379893:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916203904 00000100:00100000:1.0:1789498856.379901:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916203904 00000100:00100000:2.0:1789498856.379921:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916203776 00000100:00100000:2.0:1789498856.379927:0:24170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916203776 00000100:00100000:1.0:1789498856.379956:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789498856.379966:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916204032 00000100:00100000:1.0:1789498856.379968:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916203904:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789498856.379970:0:24170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916204032 00000100:00100000:2.0:1789498856.379990:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000004:00000024:1.0:1789498856.380012:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789498856.380059:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916203904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498856.380066:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789498856.380110:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588146d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916203904:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1789498856.380307:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789498856.380421:0:24170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9de5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876424916203776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789498856.380438:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1789498856.380474:0:24170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9de5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876424916203776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498856.383596:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789498856.383645:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789498856.383663:0:24170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876424916204032:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789498856.383673:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876424916203776:0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789498856.383689:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1789498856.383774:0:24170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876424916204032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (3886us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498856.383782:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789498856.383835:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588235180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876424916204032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498856.391682:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39f24317-e976-4eca-a2df-96def568323f:3643:1876424916204160:0@lo:400:kworker.0 00000100:00100000:1.0:1789498856.391782:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498856.391939:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876424916204288:0@lo:400:kworker.0 00000100:00100000:2.0:1789498856.391975:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498856.392036:0:23400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916204288 00000100:00100000:2.0:1789498856.392045:0:23400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916204288 00000100:00100000:2.0:1789498856.392090:0:23400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789498856.392111:0:23400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876424916204288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498856.392175:0:23400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876424916204288:12345-0@lo:400:kworker.0 Request processed in 77us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498856.392183:0:23400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789498856.392220:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876424916204288:0@lo:400:kworker.0 00000100:00100000:0.0:1789498856.393458:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916204160 00000100:00100000:0.0:1789498856.393470:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916204160 00000100:00100000:0.0:1789498856.393563:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789498856.393573:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+24:3643:x1876424916204160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498856.395969:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876424916204800:0@lo:400:kworker.0 00000100:00100000:3.0:1789498856.396035:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498856.396075:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789498856.396082:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876424916204672:0@lo:400:kworker.0 00000100:00100000:2.0:1789498856.396308:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916204416:0@lo:400:kworker.0 00000100:00100000:2.0:1789498856.396494:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498856.396519:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876424916204928:0@lo:400:kworker.0 00000100:00100000:2.0:1789498856.396563:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498856.396602:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789498856.396608:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876424916204544:0@lo:400:kworker.0 00000100:00100000:2.0:1789498856.396632:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498856.396651:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1876424916205056:0@lo:400:kworker.0 00000100:00100000:2.0:1789498856.396673:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498856.396701:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916204800 00000100:00100000:2.0:1789498856.396710:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916204800 00000100:00100000:2.0:1789498856.396771:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916204928 00000100:00100000:2.0:1789498856.396775:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916204928 00000100:00100000:2.0:1789498856.396789:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916204544 00000100:00100000:2.0:1789498856.396791:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916204544 00000100:00100000:2.0:1789498856.399733:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916205056 00000100:00100000:2.0:1789498856.399749:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916205056 00000100:00100000:2.0:1789498856.399794:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789498856.399805:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876424916204800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498856.399919:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876424916204800:12345-0@lo:400:kworker.0 Request processed in 115us (3882us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498856.399926:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789498856.399947:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789498856.399955:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876424916204928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498856.400033:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876424916204928:12345-0@lo:400:kworker.0 Request processed in 79us (3469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498856.400039:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789498856.400052:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789498856.400057:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876424916204544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498856.400087:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876424916204544:12345-0@lo:400:kworker.0 Request processed in 30us (3454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498856.401206:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789498856.401233:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789498856.401243:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075877e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876424916205056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498856.401365:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075877e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876424916205056:12345-0@lo:400:kworker.0 Request processed in 124us (4690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498856.401371:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789498856.401423:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876424916204544:0@lo:400:kworker.0 00000100:00100000:2.0:1789498856.401436:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1876424916205056:0@lo:400:kworker.0 00010000:00080000:2.0:1789498856.401450:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa076bc570a80 x1876424916204928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498856.401460:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876424916204928:0@lo:400:kworker.0 00000100:00100000:2.0:1789498856.401561:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916204416 00000100:00100000:2.0:1789498856.401567:0:24169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916204416 00000100:00100000:2.0:1789498856.401612:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789498856.401619:0:24169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075874f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916204416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498856.401660:0:24169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075874f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916204416:12345-0@lo:400:kworker.0 Request processed in 42us (5167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498856.401667:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789498856.401694:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916204416:0@lo:400:kworker.0 00000100:00080000:2.0:1789498856.401733:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789498856.401740:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789498856.401742:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498856.403024:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+24:3643:x1876424916204160:12345-0@lo:400:kworker.0 Request processed in 9448us (11237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498856.403038:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789498856.404198:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498856.404250:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1876424916205184:0@lo:400:kworker.0 00000100:00100000:3.0:1789498856.404557:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498856.404608:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876424916204800:0@lo:400:kworker.0 00000100:00100000:0.0:1789498856.404720:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916204672 00000100:00100000:0.0:1789498856.404727:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916204672 00000100:00100000:0.0:1789498856.404784:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916205184 00000100:00100000:0.0:1789498856.404787:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916205184 00000100:00080000:0.0:1789498856.404810:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789498856.404844:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789498856.404852:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876424916204672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498856.404903:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876424916204672:12345-0@lo:400:kworker.0 Request processed in 52us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498856.404909:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789498856.404923:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789498856.404930:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876424916205184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498856.404959:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876424916205184:12345-0@lo:400:kworker.0 Request processed in 29us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498856.404964:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789498856.405247:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876424916204672:0@lo:400:kworker.0 00010000:00080000:3.0:1789498856.405331:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa076bc572d80 x1876424916205184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498856.405344:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1876424916205184:0@lo:400:kworker.0 00000100:00100000:1.0:1789498856.406994:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39f24317-e976-4eca-a2df-96def568323f:3643:1876424916204160:0@lo:400:kworker.0 00000001:00100000:0.0:1789498856.894059:0:24984:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7f01496a-f99d-4000-a86c-f777ddf70925 00000001:00080000:0.0:1789498856.894082:0:24984:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:1.0:1789498856.956848:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498857.979898:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498858.090827:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:0.0:1789498858.093680:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896169344 00000100:00100000:0.0:1789498858.093699:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896169344 00000100:00080000:2.0:1789498858.093879:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498858.094752:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 14 00000100:00100000:0.0:1789498858.094770:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f01496a-f99d-4000-a86c-f777ddf70925+7:18135:x1876424896169344:12345-192.168.204.17@tcp:41:lfs.0 00000004:00000024:0.0:1789498858.094825:0:22658:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789498858.094938:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f01496a-f99d-4000-a86c-f777ddf70925+7:18135:x1876424896169344:12345-192.168.204.17@tcp:41:lfs.0 Request processed in 175us (4125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498858.094947:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 14 00000100:00100000:1.0:1789498858.099644:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498858.099759:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896169472 00000100:00100000:3.0:1789498858.099770:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896169472 00000100:00100000:3.0:1789498858.099881:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 15 00000100:00100000:3.0:1789498858.099893:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f01496a-f99d-4000-a86c-f777ddf70925+6:18135:x1876424896169472:12345-192.168.204.17@tcp:41:lfs.0 00000004:00000024:3.0:1789498858.099950:0:22660:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789498858.100066:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f01496a-f99d-4000-a86c-f777ddf70925+6:18135:x1876424896169472:12345-192.168.204.17@tcp:41:lfs.0 Request processed in 175us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498858.100074:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 15 00000100:00080000:2.0:1789498858.103635:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789498858.104666:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498858.104721:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896169600 00000100:00100000:3.0:1789498858.104734:0:24171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896169600 00000100:00080000:2.0:1789498858.104930:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498858.107220:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 14 00000100:00100000:3.0:1789498858.107248:0:24171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7f01496a-f99d-4000-a86c-f777ddf70925+6:18135:x1876424896169600:12345-192.168.204.17@tcp:13:lfs.0 00002000:00000024:3.0:1789498858.107291:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789498858.107400:0:24171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7f01496a-f99d-4000-a86c-f777ddf70925+6:18135:x1876424896169600:12345-192.168.204.17@tcp:13:lfs.0 Request processed in 167us (2742us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498858.107409:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 14 00000100:00100000:1.0:1789498858.112028:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:0.0:1789498858.113307:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896169728 00000100:00100000:0.0:1789498858.113321:0:24170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896169728 00000100:00100000:0.0:1789498858.113559:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 15 00000100:00100000:0.0:1789498858.113574:0:24170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588235180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7f01496a-f99d-4000-a86c-f777ddf70925+5:18135:x1876424896169728:12345-192.168.204.17@tcp:13:lfs.0 00002000:00000024:0.0:1789498858.113613:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1789498858.113710:0:24170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588235180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7f01496a-f99d-4000-a86c-f777ddf70925+5:18135:x1876424896169728:12345-192.168.204.17@tcp:13:lfs.0 Request processed in 140us (1693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498858.113719:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 15 00000100:00080000:2.0:1789498858.113795:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789498858.362202:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498858.362391:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896169856 00000100:00100000:3.0:1789498858.362408:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896169856 00000100:00100000:3.0:1789498858.362492:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 136 00000100:00100000:3.0:1789498858.362504:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:116bdd0f-0dd7-4d85-9352-94b0af277561+10:18168:x1876424896169856:12345-192.168.204.17@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789498858.362526:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498858.362585:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa076c0dab800/0x70d6b5fa1825e778 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f2bb expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498858.362621:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa076c0dab800/0x70d6b5fa1825e778 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f2bb expref: 11 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498858.362634:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa076c0dab800/0x70d6b5fa1825e778 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f2bb expref: 11 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498858.362646:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa076c0dab800, rc 0) 00000100:00100000:3.0:1789498858.362956:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:116bdd0f-0dd7-4d85-9352-94b0af277561+11:18168:x1876424896169856:12345-192.168.204.17@tcp:101:mount.lustre.0 Request processed in 453us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498858.362965:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 136 00000100:00100000:1.0:1789498858.380508:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:0.0:1789498858.380681:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896169984 00000100:00100000:0.0:1789498858.380693:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896169984 00000100:00100000:0.0:1789498858.380755:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 137 00000100:00100000:0.0:1789498858.380766:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:116bdd0f-0dd7-4d85-9352-94b0af277561+11:18168:x1876424896169984:12345-192.168.204.17@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789498858.380955:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:116bdd0f-0dd7-4d85-9352-94b0af277561+11:18168:x1876424896169984:12345-192.168.204.17@tcp:501:mount.lustre.0 Request processed in 191us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498858.380964:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 137 00000100:00100000:0.0:1789498858.385126:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498858.385322:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896170112 00000100:00100000:3.0:1789498858.385333:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896170112 00000100:00100000:3.0:1789498858.385388:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 138 00000100:00100000:3.0:1789498858.385399:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076beb6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:116bdd0f-0dd7-4d85-9352-94b0af277561+11:18168:x1876424896170112:12345-192.168.204.17@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789498858.385608:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076beb6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:116bdd0f-0dd7-4d85-9352-94b0af277561+11:18168:x1876424896170112:12345-192.168.204.17@tcp:503:mount.lustre.0 Request processed in 210us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498858.385616:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 138 00000100:00100000:2.0:1789498858.400740:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498858.404947:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896170240 00000100:00100000:1.0:1789498858.404967:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896170240 00000100:00100000:1.0:1789498858.405047:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 139 00000100:00100000:1.0:1789498858.405058:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:116bdd0f-0dd7-4d85-9352-94b0af277561+11:18174:x1876424896170240:12345-192.168.204.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789498858.405273:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:116bdd0f-0dd7-4d85-9352-94b0af277561+11:18174:x1876424896170240:12345-192.168.204.17@tcp:502:llog_process_th.0 Request processed in 216us (4548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498858.405282:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 139 00000100:00100000:1.0:1789498858.441811:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:0.0:1789498858.441961:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896170368 00000100:00100000:0.0:1789498858.441976:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896170368 00000100:00100000:0.0:1789498858.442069:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 140 00000100:00100000:0.0:1789498858.442094:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:116bdd0f-0dd7-4d85-9352-94b0af277561+11:18174:x1876424896170368:12345-192.168.204.17@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789498858.442293:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:116bdd0f-0dd7-4d85-9352-94b0af277561+11:18174:x1876424896170368:12345-192.168.204.17@tcp:502:llog_process_th.0 Request processed in 201us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498858.442302:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 140 00000100:00100000:0.0:1789498858.448319:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498858.448405:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896170496 00000100:00100000:3.0:1789498858.448416:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896170496 00000100:00100000:3.0:1789498858.448479:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 141 00000100:00100000:3.0:1789498858.448492:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:116bdd0f-0dd7-4d85-9352-94b0af277561+11:18174:x1876424896170496:12345-192.168.204.17@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789498858.448720:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685117450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:116bdd0f-0dd7-4d85-9352-94b0af277561+11:18174:x1876424896170496:12345-192.168.204.17@tcp:502:llog_process_th.0 Request processed in 228us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498858.448727:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 141 00000100:00100000:2.0:1789498858.458523:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498858.458684:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896170624 00000100:00100000:1.0:1789498858.458695:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896170624 00000100:00100000:1.0:1789498858.458756:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 142 00000100:00100000:1.0:1789498858.458767:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:116bdd0f-0dd7-4d85-9352-94b0af277561+11:18168:x1876424896170624:12345-192.168.204.17@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789498858.458786:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498858.458808:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0758564ec00/0x70d6b5fa1825e77f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f2ec expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498858.458861:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0758564ec00/0x70d6b5fa1825e77f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f2ec expref: 12 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498858.458871:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0758564ec00/0x70d6b5fa1825e77f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f2ec expref: 12 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498858.458881:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0758564ec00, rc 0) 00000100:00100000:1.0:1789498858.458944:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685115c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:116bdd0f-0dd7-4d85-9352-94b0af277561+12:18168:x1876424896170624:12345-192.168.204.17@tcp:101:mount.lustre.0 Request processed in 178us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498858.458950:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 142 00000100:00100000:1.0:1789498858.467954:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:0.0:1789498858.468061:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896170752 00000100:00100000:0.0:1789498858.468086:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896170752 00000100:00100000:0.0:1789498858.468148:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 143 00000100:00100000:0.0:1789498858.468160:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:116bdd0f-0dd7-4d85-9352-94b0af277561+12:18168:x1876424896170752:12345-192.168.204.17@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789498858.468192:0:22651:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789498858.468218:0:22651:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789498858.468223:0:22651:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789498858.468226:0:22651:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789498858.468229:0:22651:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789498858.468232:0:22651:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1789498858.475963:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685114050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:116bdd0f-0dd7-4d85-9352-94b0af277561+12:18168:x1876424896170752:12345-192.168.204.17@tcp:256:mount.lustre.0 Request processed in 7792us (8015us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498858.475979:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 143 00000100:00100000:2.0:1789498858.480828:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498858.480921:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896170880 00000100:00100000:3.0:1789498858.480932:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896170880 00000100:00100000:3.0:1789498858.481030:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 144 00000100:00100000:3.0:1789498858.481041:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:116bdd0f-0dd7-4d85-9352-94b0af277561+12:18168:x1876424896170880:12345-192.168.204.17@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789498858.481059:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498858.481087:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa076c0daa800/0x70d6b5fa1825e786 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f2f3 expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498858.481115:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa076c0daa800/0x70d6b5fa1825e786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f2f3 expref: 13 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498858.481139:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa076c0daa800/0x70d6b5fa1825e786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f2f3 expref: 13 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498858.481148:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa076c0daa800, rc 0) 00000100:00100000:3.0:1789498858.481219:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685116c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:116bdd0f-0dd7-4d85-9352-94b0af277561+13:18168:x1876424896170880:12345-192.168.204.17@tcp:101:mount.lustre.0 Request processed in 181us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498858.481225:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 144 00000100:00100000:0.0:1789498858.484004:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498858.484118:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896171008 00000100:00100000:1.0:1789498858.484128:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896171008 00000100:00100000:1.0:1789498858.484240:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 145 00000100:00100000:1.0:1789498858.484251:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:116bdd0f-0dd7-4d85-9352-94b0af277561+13:18168:x1876424896171008:12345-192.168.204.17@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789498858.484401:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685117c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:116bdd0f-0dd7-4d85-9352-94b0af277561+13:18168:x1876424896171008:12345-192.168.204.17@tcp:501:mount.lustre.0 Request processed in 151us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498858.484407:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 145 00000100:00100000:0.0:1789498858.486500:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498858.487193:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896171136 00000100:00100000:2.0:1789498858.487213:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896171136 00000100:00100000:2.0:1789498858.487256:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 146 00000100:00100000:2.0:1789498858.487263:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:116bdd0f-0dd7-4d85-9352-94b0af277561+13:18168:x1876424896171136:12345-192.168.204.17@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789498858.487391:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685116050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:116bdd0f-0dd7-4d85-9352-94b0af277561+13:18168:x1876424896171136:12345-192.168.204.17@tcp:503:mount.lustre.0 Request processed in 128us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498858.487399:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 146 00000100:00100000:3.0:1789498858.497880:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498858.497973:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896171264 00000100:00100000:2.0:1789498858.497991:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896171264 00000100:00100000:2.0:1789498858.498052:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 147 00000100:00100000:2.0:1789498858.498062:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:116bdd0f-0dd7-4d85-9352-94b0af277561+13:18178:x1876424896171264:12345-192.168.204.17@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789498858.498254:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:116bdd0f-0dd7-4d85-9352-94b0af277561+13:18178:x1876424896171264:12345-192.168.204.17@tcp:502:llog_process_th.0 Request processed in 192us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498858.498267:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 147 00000100:00100000:0.0:1789498858.509975:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498858.510054:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896171392 00000100:00100000:3.0:1789498858.510065:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896171392 00000100:00100000:3.0:1789498858.510132:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 148 00000100:00100000:3.0:1789498858.510142:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:116bdd0f-0dd7-4d85-9352-94b0af277561+13:18178:x1876424896171392:12345-192.168.204.17@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789498858.510306:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685116850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:116bdd0f-0dd7-4d85-9352-94b0af277561+13:18178:x1876424896171392:12345-192.168.204.17@tcp:502:llog_process_th.0 Request processed in 166us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498858.510314:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 148 00000100:00100000:0.0:1789498858.520837:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:0.0:1789498858.520871:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:0.0:1789498858.520892:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:0.0:1789498858.520914:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498858.520921:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896171520 00000100:00100000:1.0:1789498858.520930:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896171520 00000100:00100000:0.0:1789498858.520931:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:0.0:1789498858.520945:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498858.520960:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896171776 00000100:00100000:0.0:1789498858.520961:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896172160 00000100:00100000:1.0:1789498858.520963:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896171776 00000100:00100000:0.0:1789498858.520964:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896172160 00000100:00100000:1.0:1789498858.520970:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896172288 00000100:00100000:1.0:1789498858.520980:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896172288 00000100:00100000:1.0:1789498858.521008:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 50 00000100:00100000:1.0:1789498858.521017:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f01496a-f99d-4000-a86c-f777ddf70925+7:2394:x1876424896172160:12345-192.168.204.17@tcp:400:kworker.0 00000100:00100000:2.0:1789498858.521084:0:24475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896172416 00000100:00100000:2.0:1789498858.521089:0:24475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896172416 00000100:00100000:2.0:1789498858.521120:0:24475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896172544 00000100:00100000:2.0:1789498858.521122:0:24475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896172544 00000100:00100000:1.0:1789498858.521124:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f01496a-f99d-4000-a86c-f777ddf70925+7:2394:x1876424896172160:12345-192.168.204.17@tcp:400:kworker.0 Request processed in 108us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498858.521147:0:24475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 9 00000100:00100000:2.0:1789498858.521155:0:24475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f01496a-f99d-4000-a86c-f777ddf70925+6:2394:x1876424896172416:12345-192.168.204.17@tcp:400:kworker.0 00000100:00100000:2.0:1789498858.521187:0:24475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f01496a-f99d-4000-a86c-f777ddf70925+6:2394:x1876424896172416:12345-192.168.204.17@tcp:400:kworker.0 Request processed in 33us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498858.521207:0:24475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 9 00000100:00100000:0.0:1789498858.521427:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 51 00000100:00100000:0.0:1789498858.521437:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f01496a-f99d-4000-a86c-f777ddf70925+6:2394:x1876424896172288:12345-192.168.204.17@tcp:400:kworker.0 00000100:00100000:0.0:1789498858.521464:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f01496a-f99d-4000-a86c-f777ddf70925+6:2394:x1876424896172288:12345-192.168.204.17@tcp:400:kworker.0 Request processed in 31us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498858.521470:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 51 00000100:00100000:0.0:1789498858.521630:0:22658:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789498858.521639:0:22658:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789498858.521771:0:24475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 10 00000100:00100000:2.0:1789498858.521778:0:24475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f01496a-f99d-4000-a86c-f777ddf70925+5:2394:x1876424896172544:12345-192.168.204.17@tcp:400:kworker.0 00000100:00100000:2.0:1789498858.521805:0:24475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f01496a-f99d-4000-a86c-f777ddf70925+5:2394:x1876424896172544:12345-192.168.204.17@tcp:400:kworker.0 Request processed in 28us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498858.521810:0:24475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 10 00000100:00100000:1.0:1789498858.523282:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 50 00000100:00100000:1.0:1789498858.523326:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 16 00000100:00100000:1.0:1789498858.523334:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2391:x1876424896171520:12345-192.168.204.17@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789498858.523385:0:22659:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 20fd504a-e0e6-4fa7-9b68-620798d3c4f1@192.168.204.17@tcp t0 exp 0000000000000000 cur 692 last 0 00000020:00000080:1.0:1789498858.523428:0:22659:0:(genops.c:1384:class_connect()) connect: client 20fd504a-e0e6-4fa7-9b68-620798d3c4f1, cookie 0x70d6b5fa1825e78d 00000004:00100000:1.0:1789498858.523455:0:22659:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789498858.523570:0:22659:0:(import.c:65:import_set_state_nolock()) ffffa0769f637800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789498858.523624:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+6:2391:x1876424896171520:12345-192.168.204.17@tcp:38:mount.lustre.0 Request processed in 289us (2797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498858.523631:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 16 00000100:00100000:1.0:1789498858.523648:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 17 00000100:00100000:1.0:1789498858.523652:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2391:x1876424896171776:12345-192.168.204.17@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789498858.523669:0:22659:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 20fd504a-e0e6-4fa7-9b68-620798d3c4f1@192.168.204.17@tcp t0 exp 0000000000000000 cur 692 last 0 00000020:00000080:1.0:1789498858.523689:0:22659:0:(genops.c:1384:class_connect()) connect: client 20fd504a-e0e6-4fa7-9b68-620798d3c4f1, cookie 0x70d6b5fa1825e794 00000004:00100000:1.0:1789498858.523703:0:22659:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789498858.523751:0:22659:0:(import.c:65:import_set_state_nolock()) ffffa076bbe16800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789498858.523773:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+6:2391:x1876424896171776:12345-192.168.204.17@tcp:38:mount.lustre.0 Request processed in 119us (2902us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498858.523779:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 17 00000100:00100000:0.0:1789498858.536870:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498858.536977:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896171648 00000100:00100000:1.0:1789498858.536989:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896171648 00000100:00100000:1.0:1789498858.537069:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 18 00000100:00100000:1.0:1789498858.537097:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+6:0:x1876424896171648:12345-192.168.204.17@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789498858.537133:0:22659:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00080000:2.0:1789498858.537155:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789498858.537223:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+6:0:x1876424896171648:12345-192.168.204.17@tcp:41:mount.lustre.0 Request processed in 129us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498858.537231:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 18 00000100:00100000:1.0:1789498858.539062:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498858.539419:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498858.539828:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896172032 00000100:00100000:3.0:1789498858.539838:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896172032 00000100:00100000:3.0:1789498858.539886:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896171904 00000100:00100000:3.0:1789498858.539889:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896171904 00000100:00100000:3.0:1789498858.539919:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 19 00000100:00100000:3.0:1789498858.539927:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+6:18168:x1876424896172032:12345-192.168.204.17@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789498858.539958:0:22660:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789498858.540025:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+6:18168:x1876424896172032:12345-192.168.204.17@tcp:41:mount.lustre.0 Request processed in 99us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498858.540032:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 19 00000100:00100000:3.0:1789498858.540063:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 20 00000100:00100000:3.0:1789498858.540068:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588146d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+6:0:x1876424896171904:12345-192.168.204.17@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789498858.540091:0:22660:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789498858.540119:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588146d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+6:0:x1876424896171904:12345-192.168.204.17@tcp:41:mount.lustre.0 Request processed in 51us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498858.540125:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 20 00000100:00080000:3.0:1789498858.540140:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789498858.548848:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498858.549487:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896172672 00000100:00100000:1.0:1789498858.549497:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896172672 00000100:00100000:1.0:1789498858.549581:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 21 00000100:00100000:1.0:1789498858.549593:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+6:18168:x1876424896172672:12345-192.168.204.17@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789498858.549682:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+6:18168:x1876424896172672:12345-192.168.204.17@tcp:40:mount.lustre.0 Request processed in 92us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498858.549689:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 21 00000100:00100000:2.0:1789498858.558306:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498858.558366:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498858.558437:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896172800 00000100:00100000:3.0:1789498858.558447:0:24168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896172800 00000100:00100000:0.0:1789498858.558464:0:24475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896172928 00000100:00100000:0.0:1789498858.558468:0:24475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896172928 00000100:00100000:3.0:1789498858.558503:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 25 00000100:00100000:0.0:1789498858.558510:0:24475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 26 00000100:00100000:3.0:1789498858.558513:0:24168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075877e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2391:x1876424896172800:12345-192.168.204.17@tcp:8:mount.lustre.0 00000100:00100000:0.0:1789498858.558515:0:24475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075877e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2391:x1876424896172928:12345-192.168.204.17@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789498858.558641:0:24475:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 20fd504a-e0e6-4fa7-9b68-620798d3c4f1@192.168.204.17@tcp t0 exp 0000000000000000 cur 692 last 0 00000020:00000080:0.0:1789498858.558683:0:24475:0:(genops.c:1384:class_connect()) connect: client 20fd504a-e0e6-4fa7-9b68-620798d3c4f1, cookie 0x70d6b5fa1825e79b 00002000:00100000:0.0:1789498858.558697:0:24475:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 20fd504a-e0e6-4fa7-9b68-620798d3c4f1/ffffa076bbe3e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789498858.558709:0:24475:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789498858.558805:0:24475:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789498858.558839:0:24475:0:(import.c:65:import_set_state_nolock()) ffffa076bbe38800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789498858.558906:0:24475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075877e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+6:2391:x1876424896172928:12345-192.168.204.17@tcp:8:mount.lustre.0 Request processed in 389us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498858.558914:0:24475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 26 00000100:00100000:0.0:1789498858.563179:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00010000:00080000:1.0:1789498858.563617:0:24168:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 20fd504a-e0e6-4fa7-9b68-620798d3c4f1@192.168.204.17@tcp t0 exp 0000000000000000 cur 692 last 0 00000020:00000080:1.0:1789498858.563673:0:24168:0:(genops.c:1384:class_connect()) connect: client 20fd504a-e0e6-4fa7-9b68-620798d3c4f1, cookie 0x70d6b5fa1825e7a2 00002000:00100000:1.0:1789498858.563690:0:24168:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 20fd504a-e0e6-4fa7-9b68-620798d3c4f1/ffffa076bbe12800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789498858.563703:0:24168:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789498858.563781:0:24168:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789498858.563814:0:24168:0:(import.c:65:import_set_state_nolock()) ffffa076bbe13800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789498858.563896:0:24168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075877e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+6:2391:x1876424896172800:12345-192.168.204.17@tcp:8:mount.lustre.0 Request processed in 5383us (5600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498858.563915:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 25 00000100:00100000:3.0:1789498858.564821:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896173056 00000100:00100000:3.0:1789498858.564832:0:22669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896173056 00000100:00100000:3.0:1789498858.564894:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 4 00000100:00100000:3.0:1789498858.564905:0:22669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+6:18168:x1876424896173056:12345-192.168.204.17@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789498858.564969:0:22669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+6:18168:x1876424896173056:12345-192.168.204.17@tcp:900:mount.lustre.0 Request processed in 66us (1806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498858.564975:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 4 00000100:00100000:1.0:1789498858.569983:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498858.570105:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896173184 00000100:00100000:3.0:1789498858.570120:0:22662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896173184 00000100:00100000:3.0:1789498858.570177:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 1 00000100:00100000:3.0:1789498858.570188:0:22662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076981b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+6:18168:x1876424896173184:12345-192.168.204.17@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789498858.570401:0:22662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789498858.570816:0:22662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076981b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+6:18168:x1876424896173184:12345-192.168.204.17@tcp:33:mount.lustre.0 Request processed in 628us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498858.570824:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 1 00000100:00100000:2.0:1789498858.819968:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:0.0:1789498858.820114:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896173312 00000100:00100000:0.0:1789498858.820127:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896173312 00000100:00100000:0.0:1789498858.820198:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 22 00000100:00100000:0.0:1789498858.820228:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075877e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+6:18201:x1876424896173312:12345-192.168.204.17@tcp:101:mkdir.0 00010000:00010000:0.0:1789498858.820251:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498858.820278:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0768bda9200/0x70d6b5fa1825e7a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f324 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498858.820356:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0768bda9000/0x70d6b5fa1825e7b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498858.820371:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0768bda9000/0x70d6b5fa1825e7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498858.820387:0:22658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0768bda9000/0x70d6b5fa1825e7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789498858.820452:0:22658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789498858.820457:0:22658:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789498858.820500:0:22658:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0768bda9000/0x70d6b5fa1825e7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498858.820580:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0768bda9200/0x70d6b5fa1825e7a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f324 expref: 8 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498858.820603:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0768bda9000/0x70d6b5fa1825e7b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f324 expref: 7 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498858.820611:0:22658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa076be804000) 00010000:00010000:0.0:1789498858.820613:0:22658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789498858.820617:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0768bda9000, rc 0) 00000100:00100000:0.0:1789498858.822423:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075877e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+7:18201:x1876424896173312:12345-192.168.204.17@tcp:101:mkdir.0 Request processed in 2184us (2458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498858.822462:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 22 00010000:00010000:2.0:1789498859.006403:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498859.965519:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876424916205312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498859.965620:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498859.965774:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916205312 00000100:00100000:3.0:1789498859.965784:0:24170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916205312 00000100:00100000:3.0:1789498859.965854:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789498859.965864:0:24170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076981b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876424916205312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498859.965897:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0:1789498859.965959:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498859.966482:0:24170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076981b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876424916205312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 617us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498859.966492:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789498859.966924:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876424916205312:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789498860.030353:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498860.476424:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916205440:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789498860.476829:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498860.476949:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916205440 00000100:00100000:3.0:1789498860.476961:0:22663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916205440 00000100:00100000:3.0:1789498860.477067:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789498860.477080:0:22663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075877e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916205440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789498860.477122:0:22663:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789498860.485504:0:22663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075877e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916205440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 8410us (8889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498860.485523:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789498860.488463:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916205440:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789498860.987887:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789498860.987914:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916205568:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789498860.988043:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498860.988132:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916205568 00000100:00100000:3.0:1789498860.988141:0:24170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916205568 00000100:00100000:3.0:1789498860.988213:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789498860.988224:0:24170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075877e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916205568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789498860.988251:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0:1789498860.988323:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789498860.988384:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916205568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789498860.988477:0:24170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075877e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916205568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 255us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498860.988485:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1789498861.051918:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789498861.441701:0:22692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789498861.499706:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916205696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498861.499767:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076981b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916205952:0@lo:400:kworker.0 00000100:00100000:3.0:1789498861.499785:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498861.499798:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498861.499824:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076981b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876424916206464:0@lo:400:kworker.0 00000100:00100000:3.0:1789498861.499825:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076981b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916206208:0@lo:400:kworker.0 00000100:00100000:3.0:1789498861.499863:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498861.499892:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498861.499896:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076981b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916206720:0@lo:400:kworker.0 00000100:00100000:3.0:1789498861.499920:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498861.499920:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076981b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876424916206976:0@lo:400:kworker.0 00000100:00100000:3.0:1789498861.499935:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076981b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876424916207232:0@lo:400:kworker.0 00000100:00100000:1.0:1789498861.499939:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498861.499952:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076981b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916207488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789498861.499955:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498861.499971:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1789498861.499976:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076981b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39f24317-e976-4eca-a2df-96def568323f:3643:1876424916205824:0@lo:400:kworker.0 00000100:00100000:1.0:1789498861.499983:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498861.499998:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498861.500001:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789498861.500007:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916206080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789498861.500032:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076981b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916206336:0@lo:400:kworker.0 00000100:00100000:1.0:1789498861.500036:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498861.500049:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498861.500051:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076981b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916206592:0@lo:400:kworker.0 00000100:00100000:3.0:1789498861.500062:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076981b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876424916206848:0@lo:400:kworker.0 00000100:00100000:1.0:1789498861.500069:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498861.500080:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498861.500082:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076981b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876424916207104:0@lo:400:kworker.0 00000100:00100000:1.0:1789498861.500101:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498861.500103:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076981b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876424916207360:0@lo:400:kworker.0 00000100:00100000:3.0:1789498861.500121:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498861.500132:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916205952 00000100:00100000:1.0:1789498861.500141:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916205952 00000100:00100000:3.0:1789498861.500152:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916205696 00000100:00100000:3.0:1789498861.500155:0:24171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916205696 00000100:00100000:1.0:1789498861.500179:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916207488 00000100:00100000:1.0:1789498861.500181:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916207488 00000100:00100000:3.0:1789498861.500184:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916206080 00000100:00100000:3.0:1789498861.500186:0:24171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916206080 00000100:00100000:1.0:1789498861.500192:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916206592 00000100:00100000:1.0:1789498861.500194:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916206592 00000100:00100000:3.0:1789498861.500200:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789498861.500203:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789498861.500208:0:24171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876424916205696:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498861.500208:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076981b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916205952:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1789498861.500237:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1789498861.500256:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076981b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916205952:12345-0@lo:400:kworker.0 Request processed in 47us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498861.500263:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789498861.500272:0:24171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876424916205696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498861.500278:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789498861.500279:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789498861.500284:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076846f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1876424916207488:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789498861.500287:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789498861.500292:0:24171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076846f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916206080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789498861.500306:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000004:00000024:1.0:1789498861.500307:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789498861.500330:0:24171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076846f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916206080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498861.500330:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076846f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1876424916207488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 46us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498861.500337:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789498861.500337:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789498861.500348:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789498861.500353:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916206208 00000100:00100000:1.0:1789498861.500354:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076846f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916206592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498861.500356:0:24169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916206208 00000100:00100000:3.0:1789498861.500379:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916206720 00000100:00100000:1.0:1789498861.500379:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076846f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916206592:12345-0@lo:400:kworker.0 Request processed in 25us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498861.500381:0:24169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916206720 00000100:00100000:1.0:1789498861.500385:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789498861.500400:0:25457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916206464 00000100:00100000:1.0:1789498861.500402:0:25457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916206464 00000100:00100000:3.0:1789498861.500405:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916206336 00000100:00100000:3.0:1789498861.500407:0:24169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916206336 00000100:00100000:1.0:1789498861.500417:0:25457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916206976 00000100:00100000:3.0:1789498861.500418:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789498861.500419:0:25457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916206976 00000100:00100000:3.0:1789498861.500423:0:24169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0dd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876424916206208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498861.500429:0:25457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916207232 00000100:00100000:1.0:1789498861.500431:0:25457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916207232 00000100:00100000:1.0:1789498861.500439:0:25457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916206848 00000100:00100000:1.0:1789498861.500447:0:25457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916206848 00000100:00100000:3.0:1789498861.500452:0:24169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0dd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876424916206208:12345-0@lo:400:kworker.0 Request processed in 29us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498861.500457:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789498861.500460:0:25457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916207104 00000100:00100000:1.0:1789498861.500462:0:25457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916207104 00000100:00100000:1.0:1789498861.500483:0:25457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916207360 00000100:00100000:1.0:1789498861.500486:0:25457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916207360 00000100:00100000:1.0:1789498861.500497:0:25457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789498861.500502:0:25457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076981b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876424916206464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498861.500528:0:25457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076981b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876424916206464:12345-0@lo:400:kworker.0 Request processed in 26us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498861.500613:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789498861.500621:0:24169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916206720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498861.500648:0:24169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916206720:12345-0@lo:400:kworker.0 Request processed in 29us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498861.500654:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789498861.500664:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789498861.500670:0:24169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876424916206336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498861.500699:0:24169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876424916206336:12345-0@lo:400:kworker.0 Request processed in 29us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498861.500705:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789498861.500727:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789498861.500735:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076981b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876424916206976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498861.500774:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076981b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876424916206976:12345-0@lo:400:kworker.0 Request processed in 40us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498861.500779:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789498861.500792:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789498861.500797:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876424916207232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498861.500815:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876424916207232:12345-0@lo:400:kworker.0 Request processed in 19us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498861.500820:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789498861.500827:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789498861.500832:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07684c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876424916206848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498861.500849:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07684c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876424916206848:12345-0@lo:400:kworker.0 Request processed in 18us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498861.500854:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789498861.500861:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789498861.500865:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076846f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876424916207104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498861.500883:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076846f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876424916207104:12345-0@lo:400:kworker.0 Request processed in 18us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498861.500888:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789498861.500896:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789498861.500901:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07684c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876424916207360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498861.500924:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07684c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876424916207360:12345-0@lo:400:kworker.0 Request processed in 24us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498861.500930:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789498861.500948:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916205824 00000100:00100000:3.0:1789498861.500951:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916205824 00000100:00100000:3.0:1789498861.500984:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789498861.500986:0:25457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789498861.500990:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+24:3643:x1876424916205824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789498861.501031:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685115450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+24:3643:x1876424916205824:12345-0@lo:400:kworker.0 Request processed in 42us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498861.501037:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:3.0:1789498861.501073:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789498861.501078:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789498861.501080:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789498861.501082:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789498861.501112:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076981b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39f24317-e976-4eca-a2df-96def568323f:3643:1876424916205824:0@lo:400:kworker.0 00000100:00100000:3.0:1789498861.501124:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1789498861.501137:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076981b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916206336:0@lo:400:kworker.0 00000100:00100000:3.0:1789498861.501146:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076981b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876424916206848:0@lo:400:kworker.0 00010000:00080000:3.0:1789498861.501158:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa076981b0700 x1876424916207360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789498861.501168:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076981b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1876424916207360:0@lo:400:kworker.0 00000100:00100000:3.0:1789498861.501178:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076981b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916206208:0@lo:400:kworker.0 00000100:00100000:3.0:1789498861.501188:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076981b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916206720:0@lo:400:kworker.0 00000100:00100000:3.0:1789498861.501198:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076981b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876424916207232:0@lo:400:kworker.0 00000100:00100000:3.0:1789498861.501212:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916205696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498861.501229:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916206080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789498861.501240:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076981b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916206592:0@lo:400:kworker.0 00010000:00080000:1.0:1789498861.501250:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa076981b2680 x1876424916207104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789498861.501258:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076981b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1876424916207104:0@lo:400:kworker.0 00000100:00100000:1.0:1789498861.501267:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076981b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916205952:0@lo:400:kworker.0 00000100:00100000:1.0:1789498861.501275:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076981b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876424916206464:0@lo:400:kworker.0 00000100:00100000:1.0:1789498861.501283:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076981b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1876424916206976:0@lo:400:kworker.0 00000100:00100000:1.0:1789498861.501293:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076981b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916207488:0@lo:41:osp-pre-0-1.0 00000001:00100000:3.0:1789498861.505591:0:22638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 20fd504a-e0e6-4fa7-9b68-620798d3c4f1 00000001:00100000:3.0:1789498861.505610:0:22638:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7f01496a-f99d-4000-a86c-f777ddf70925 00000001:00100000:1.0:1789498861.507798:0:24163:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 20fd504a-e0e6-4fa7-9b68-620798d3c4f1 00000001:00100000:1.0:1789498861.507810:0:24163:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7f01496a-f99d-4000-a86c-f777ddf70925 00000001:00100000:0.0:1789498861.510094:0:23391:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 20fd504a-e0e6-4fa7-9b68-620798d3c4f1 00000001:00100000:0.0:1789498861.510104:0:23391:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7f01496a-f99d-4000-a86c-f777ddf70925 00000001:02000400:2.0:1789498861.981442:0:25556:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789498862.075825:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789498862.525724:0:23413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789498863.100673:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498864.048401:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498864.048449:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498864.048474:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498864.048494:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498864.048520:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498864.048568:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498864.048586:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498864.048602:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498864.048620:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498864.048645:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896173824 00000100:00100000:3.0:1789498864.048654:0:24169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896173824 00000100:00100000:3.0:1789498864.048705:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896174336 00000100:00100000:3.0:1789498864.048709:0:24169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896174336 00000100:00100000:3.0:1789498864.048722:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896173952 00000100:00100000:3.0:1789498864.048724:0:24169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896173952 00000100:00100000:3.0:1789498864.048737:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896174464 00000100:00100000:3.0:1789498864.048739:0:24169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896174464 00000100:00100000:1.0:1789498864.048902:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896173568 00000100:00100000:1.0:1789498864.048906:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896173568 00000100:00100000:1.0:1789498864.048930:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896174080 00000100:00100000:1.0:1789498864.048946:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896174080 00000100:00100000:1.0:1789498864.048963:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896173696 00000100:00100000:1.0:1789498864.048974:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896173696 00000100:00100000:1.0:1789498864.048988:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896174208 00000100:00100000:1.0:1789498864.048990:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896174208 00000100:00100000:1.0:1789498864.049005:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 58 00000100:00100000:1.0:1789498864.049014:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07684c17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f01496a-f99d-4000-a86c-f777ddf70925+6:2395:x1876424896173568:12345-192.168.204.17@tcp:400:kworker.0 00000100:00100000:1.0:1789498864.049091:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07684c17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f01496a-f99d-4000-a86c-f777ddf70925+6:2395:x1876424896173568:12345-192.168.204.17@tcp:400:kworker.0 Request processed in 78us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498864.049099:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 58 00000100:00100000:1.0:1789498864.049114:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 59 00000100:00100000:1.0:1789498864.049120:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07684c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+6:2395:x1876424896174080:12345-192.168.204.17@tcp:400:kworker.0 00000100:00100000:1.0:1789498864.049144:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07684c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+6:2395:x1876424896174080:12345-192.168.204.17@tcp:400:kworker.0 Request processed in 23us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498864.049149:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 59 00000100:00100000:1.0:1789498864.049171:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 60 00000100:00100000:1.0:1789498864.049178:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07684c14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f01496a-f99d-4000-a86c-f777ddf70925+5:2395:x1876424896173696:12345-192.168.204.17@tcp:400:kworker.0 00000100:00100000:1.0:1789498864.049199:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07684c14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f01496a-f99d-4000-a86c-f777ddf70925+5:2395:x1876424896173696:12345-192.168.204.17@tcp:400:kworker.0 Request processed in 23us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498864.049205:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 60 00000100:00100000:1.0:1789498864.049214:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 61 00000100:00100000:1.0:1789498864.049219:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076981b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+5:2395:x1876424896174208:12345-192.168.204.17@tcp:400:kworker.0 00000100:00100000:1.0:1789498864.049237:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076981b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+5:2395:x1876424896174208:12345-192.168.204.17@tcp:400:kworker.0 Request processed in 18us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498864.049242:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 61 00000100:00100000:1.0:1789498864.049395:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896173440 00000100:00100000:1.0:1789498864.049400:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896173440 00000100:00100000:1.0:1789498864.049426:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 150 00000100:00100000:1.0:1789498864.049433:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:116bdd0f-0dd7-4d85-9352-94b0af277561+13:2395:x1876424896173440:12345-192.168.204.17@tcp:400:kworker.0 00000100:00100000:1.0:1789498864.049471:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685117050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:116bdd0f-0dd7-4d85-9352-94b0af277561+13:2395:x1876424896173440:12345-192.168.204.17@tcp:400:kworker.0 Request processed in 38us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498864.049477:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 150 00000100:00100000:1.0:1789498864.049505:0:24475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 14 00000100:00100000:1.0:1789498864.049512:0:24475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07684c17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f01496a-f99d-4000-a86c-f777ddf70925+5:2395:x1876424896173824:12345-192.168.204.17@tcp:400:kworker.0 00000100:00100000:1.0:1789498864.049556:0:24475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07684c17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f01496a-f99d-4000-a86c-f777ddf70925+5:2395:x1876424896173824:12345-192.168.204.17@tcp:400:kworker.0 Request processed in 44us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498864.049563:0:24475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 14 00000100:00100000:1.0:1789498864.049577:0:24475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 15 00000100:00100000:1.0:1789498864.049584:0:24475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07684c15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+5:2395:x1876424896174336:12345-192.168.204.17@tcp:400:kworker.0 00000100:00100000:1.0:1789498864.049606:0:24475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07684c15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+5:2395:x1876424896174336:12345-192.168.204.17@tcp:400:kworker.0 Request processed in 23us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498864.049611:0:24475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 15 00000100:00100000:1.0:1789498864.049622:0:24475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 16 00000100:00100000:1.0:1789498864.049628:0:24475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07684c15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f01496a-f99d-4000-a86c-f777ddf70925+5:2395:x1876424896173952:12345-192.168.204.17@tcp:400:kworker.0 00000100:00100000:1.0:1789498864.049650:0:24475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07684c15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f01496a-f99d-4000-a86c-f777ddf70925+5:2395:x1876424896173952:12345-192.168.204.17@tcp:400:kworker.0 Request processed in 23us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498864.049656:0:24475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 16 00000100:00100000:1.0:1789498864.049667:0:24475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 17 00000100:00100000:1.0:1789498864.049673:0:24475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076981b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+6:2395:x1876424896174464:12345-192.168.204.17@tcp:400:kworker.0 00000100:00100000:1.0:1789498864.049704:0:24475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076981b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+6:2395:x1876424896174464:12345-192.168.204.17@tcp:400:kworker.0 Request processed in 31us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498864.049709:0:24475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 17 00000100:00080000:2.0:1789498864.051565:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789498864.051573:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789498864.051577:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789498864.051579:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789498864.123772:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789498864.575813:0:24984:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 20fd504a-e0e6-4fa7-9b68-620798d3c4f1 00000100:00100000:3.0:1789498865.089032:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498865.089054:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076981b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916207616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789498865.089136:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498865.089189:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916207616 00000100:00100000:3.0:1789498865.089198:0:24171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916207616 00000100:00100000:3.0:1789498865.089262:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789498865.089271:0:24171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076981b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916207616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498865.089309:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789498865.089379:0:24171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076981b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916207616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498865.089387:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1789498865.089410:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498865.089475:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076981b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916207616:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789498865.152056:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498865.597594:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076981b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916207744:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789498865.597678:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498865.597881:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916207744 00000100:00100000:2.0:1789498865.597890:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916207744 00000100:00100000:2.0:1789498865.597971:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789498865.597983:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076846f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876424916207744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789498865.598033:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789498865.609907:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076846f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876424916207744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 11917us (12220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498865.609921:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789498865.610152:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076981b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916207744:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789498866.108048:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789498866.108084:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076981b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916207872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789498866.108162:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498866.108312:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916207872 00000100:00100000:3.0:1789498866.108320:0:24171:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916207872 00000100:00080000:2.0:1789498866.108447:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498866.108559:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789498866.108570:0:24171:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076846f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916207872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789498866.108597:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789498866.108649:0:24171:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076846f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916207872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498866.108656:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789498866.108730:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076981b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916207872:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789498866.174631:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789498866.406802:0:25703:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec2919ac0 20000000:00000080:3.0:1789498866.406900:0:25703:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa076c0dc4400 uarg=0000000000000000 20000000:01000000:3.0:1789498866.406957:0:25703:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789498866.406963:0:25703:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789498866.406968:0:25703:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789498866.410130:0:25704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1789498866.410465:0:25703:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789498866.421378:0:25703:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789498866.421416:0:25703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa075874a1200/0x70d6b5fa1825e7b7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.421440:0:25703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa075857b1400/0x70d6b5fa1825e414 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e40d expref: 23 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.421448:0:25703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa076c1570c00/0x70d6b5fa1825e422 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e41b expref: 23 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.421454:0:25703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa076c1571200/0x70d6b5fa1825e461 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e45a expref: 23 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.421461:0:25703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa076bc6d9200/0x70d6b5fa1825e5e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e5db expref: 23 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.421471:0:25703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0768bda8000/0x70d6b5fa1825e747 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f283 expref: 12 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.421496:0:25703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa076c0daa800/0x70d6b5fa1825e786 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f2f3 expref: 12 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.421503:0:25703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa075874a1200/0x70d6b5fa1825e7b7 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.421841:0:25703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa076c0daa800/0x70d6b5fa1825e786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f2f3 expref: 12 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.421862:0:25703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa076c0daa800/0x70d6b5fa1825e786 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f2f3 expref: 12 pid: 22650 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498866.421878:0:25703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075877e5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25703:1876424916208000:192.168.204.17@tcp:104: 00010000:00010000:2.0:1789498866.421998:0:25703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0768bda8000/0x70d6b5fa1825e747 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f283 expref: 12 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.422006:0:25703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0768bda8000/0x70d6b5fa1825e747 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f283 expref: 12 pid: 22651 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498866.422015:0:25703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075877e5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25703:1876424916208128:192.168.204.17@tcp:104: 00010000:00010000:2.0:1789498866.422046:0:25703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa076bc6d9200/0x70d6b5fa1825e5e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70d6b5fa1825e5db expref: 23 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.422054:0:25703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa076bc6d9200/0x70d6b5fa1825e5e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70d6b5fa1825e5db expref: 23 pid: 22650 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498866.422063:0:25703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075877e6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25703:1876424916208256:0@lo:104: 00000100:00100000:2.0:1789498866.422102:0:25703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498866.422163:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916208256 00000100:00100000:2.0:1789498866.422171:0:22642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916208256 00000100:00100000:2.0:1789498866.422224:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789498866.422233:0:22642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075877e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39f24317-e976-4eca-a2df-96def568323f+3:25703:x1876424916208256:12345-0@lo:104: 00010000:00010000:2.0:1789498866.422246:0:22642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825e5db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x70d6b5fa1825e5e2 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.422294:0:22642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789498866.422300:0:22642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075877e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39f24317-e976-4eca-a2df-96def568323f+3:25703:x1876424916208256:12345-0@lo:104: Request processed in 69us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498866.422307:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1789498866.422348:0:22646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498866.422353:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825e5db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x70d6b5fa1825e5e2 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.422361:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a0000 already unused, calling callback (ffffffffc13e6c20) 10000000:00010000:2.0:1789498866.422364:0:22646:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825e5db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x70d6b5fa1825e5e2 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.422373:0:22646:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825e5db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x70d6b5fa1825e5e2 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789498866.422380:0:22646:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825e5db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x70d6b5fa1825e5e2 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498866.422386:0:22646:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789498866.422413:0:22646:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825e5db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e5e2 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.422419:0:22646:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789498866.422448:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825e5db lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e5e2 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.422455:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825e5db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e5e2 expref: -99 pid: 24983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.422469:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498866.422471:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498866.422473:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498866.422482:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789498866.422493:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075877e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39f24317-e976-4eca-a2df-96def568323f:3642:1876424916208384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789498866.422522:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789498866.422596:0:25703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa076c1571200/0x70d6b5fa1825e461 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70d6b5fa1825e45a expref: 23 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.422605:0:25703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa076c1571200/0x70d6b5fa1825e461 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70d6b5fa1825e45a expref: 23 pid: 22650 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498866.422614:0:25703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075877e4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25703:1876424916208512:0@lo:104: 00000100:00100000:2.0:1789498866.422637:0:25703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498866.422658:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916208512 00000100:00100000:2.0:1789498866.422662:0:22642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916208512 00000100:00100000:2.0:1789498866.422703:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789498866.422710:0:22642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075877e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39f24317-e976-4eca-a2df-96def568323f+3:25703:x1876424916208512:12345-0@lo:104: 00010000:00010000:2.0:1789498866.422719:0:22642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.117@tcp lock: ffffa075857b0800/0x70d6b5fa1825e45a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x70d6b5fa1825e461 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.422753:0:22642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789498866.422758:0:22642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075877e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39f24317-e976-4eca-a2df-96def568323f+3:25703:x1876424916208512:12345-0@lo:104: Request processed in 49us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498866.422775:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1789498866.422806:0:25703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa076c1570c00/0x70d6b5fa1825e422 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70d6b5fa1825e41b expref: 23 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.422815:0:25703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa076c1570c00/0x70d6b5fa1825e422 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70d6b5fa1825e41b expref: 23 pid: 22653 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498866.422823:0:25703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075877e4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25703:1876424916208640:0@lo:104: 00000100:00100000:2.0:1789498866.422845:0:25703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498866.422864:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916208640 00000100:00100000:2.0:1789498866.422868:0:22642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916208640 00000100:00100000:2.0:1789498866.422888:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789498866.422893:0:22642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075877e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39f24317-e976-4eca-a2df-96def568323f+3:25703:x1876424916208640:12345-0@lo:104: 00010000:00010000:2.0:1789498866.422902:0:22642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8200/0x70d6b5fa1825e41b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x70d6b5fa1825e422 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.422947:0:22642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789498866.422952:0:22642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075877e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39f24317-e976-4eca-a2df-96def568323f+3:25703:x1876424916208640:12345-0@lo:104: Request processed in 59us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498866.422957:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1789498866.422981:0:25703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa075857b1400/0x70d6b5fa1825e414 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x70d6b5fa1825e40d expref: 23 pid: 22651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.422989:0:25703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa075857b1400/0x70d6b5fa1825e414 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x70d6b5fa1825e40d expref: 23 pid: 22651 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498866.422997:0:25703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075877e4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25703:1876424916208768:0@lo:104: 00000100:00100000:2.0:1789498866.423017:0:25703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498866.423042:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916208768 00000100:00100000:2.0:1789498866.423046:0:22642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916208768 00000100:00100000:2.0:1789498866.423066:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789498866.423072:0:22642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075877e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39f24317-e976-4eca-a2df-96def568323f+3:25703:x1876424916208768:12345-0@lo:104: 00010000:00010000:2.0:1789498866.423080:0:22642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.117@tcp lock: ffffa075874a0e00/0x70d6b5fa1825e40d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x70d6b5fa1825e414 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.423109:0:22642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789498866.423114:0:22642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075877e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:39f24317-e976-4eca-a2df-96def568323f+3:25703:x1876424916208768:12345-0@lo:104: Request processed in 43us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498866.423120:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1789498866.423134:0:22646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789498866.423138:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.117@tcp lock: ffffa075857b0800/0x70d6b5fa1825e45a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x70d6b5fa1825e461 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.423145:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075857b0800 already unused, calling callback (ffffffffc13e6c20) 10000000:00010000:2.0:1789498866.423148:0:22646:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.117@tcp lock: ffffa075857b0800/0x70d6b5fa1825e45a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x70d6b5fa1825e461 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.423155:0:22646:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa075857b0800/0x70d6b5fa1825e45a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x70d6b5fa1825e461 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789498866.423161:0:22646:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa075857b0800/0x70d6b5fa1825e45a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x70d6b5fa1825e461 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498866.423166:0:22646:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789498866.423181:0:22646:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.117@tcp lock: ffffa075857b0800/0x70d6b5fa1825e45a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e461 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.423187:0:22646:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789498866.423203:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.117@tcp lock: ffffa075857b0800/0x70d6b5fa1825e45a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e461 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.423210:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa075857b0800/0x70d6b5fa1825e45a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e461 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.423221:0:22646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789498866.423224:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8200/0x70d6b5fa1825e41b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x70d6b5fa1825e422 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.423230:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076bc6d8200 already unused, calling callback (ffffffffc13e6c20) 10000000:00010000:2.0:1789498866.423233:0:22646:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8200/0x70d6b5fa1825e41b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x70d6b5fa1825e422 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.423239:0:22646:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8200/0x70d6b5fa1825e41b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x70d6b5fa1825e422 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789498866.423246:0:22646:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8200/0x70d6b5fa1825e41b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x70d6b5fa1825e422 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498866.423250:0:22646:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789498866.423264:0:22646:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8200/0x70d6b5fa1825e41b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e422 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.423269:0:22646:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789498866.423283:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8200/0x70d6b5fa1825e41b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e422 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.423289:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa076bc6d8200/0x70d6b5fa1825e41b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e422 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.423310:0:22646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789498866.423313:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.117@tcp lock: ffffa075874a0e00/0x70d6b5fa1825e40d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x70d6b5fa1825e414 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.423319:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a0e00 already unused, calling callback (ffffffffc13e6c20) 10000000:00010000:2.0:1789498866.423322:0:22646:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.117@tcp lock: ffffa075874a0e00/0x70d6b5fa1825e40d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x70d6b5fa1825e414 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.423329:0:22646:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.117@tcp lock: ffffa075874a0e00/0x70d6b5fa1825e40d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x70d6b5fa1825e414 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789498866.423336:0:22646:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.117@tcp lock: ffffa075874a0e00/0x70d6b5fa1825e40d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x70d6b5fa1825e414 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498866.423341:0:22646:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789498866.423355:0:22646:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.117@tcp lock: ffffa075874a0e00/0x70d6b5fa1825e40d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e414 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.423361:0:22646:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789498866.423367:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.117@tcp lock: ffffa075874a0e00/0x70d6b5fa1825e40d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e414 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.423373:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.117@tcp lock: ffffa075874a0e00/0x70d6b5fa1825e40d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x70d6b5fa1825e414 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.423386:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498866.423388:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789498866.423389:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789498866.423401:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075877e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39f24317-e976-4eca-a2df-96def568323f:3642:1876424916208896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789498866.423431:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498866.423457:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa075877e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39f24317-e976-4eca-a2df-96def568323f:3643:1876424916209024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789498866.423477:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498866.423493:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789498866.423498:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39f24317-e976-4eca-a2df-96def568323f:3643:1876424916209152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789498866.423516:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498866.423569:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916208384 00000100:00100000:2.0:1789498866.423573:0:22645:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916208384 00010000:00010000:2.0:1789498866.423609:0:22645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa076bc6d9200/0x70d6b5fa1825e5e2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70d6b5fa1825e5db expref: 24 pid: 22650 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498866.423623:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916208896 00000100:00100000:2.0:1789498866.423627:0:22645:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916208896 00010000:00010000:2.0:1789498866.423637:0:22645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa076c1571200/0x70d6b5fa1825e461 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70d6b5fa1825e45a expref: 25 pid: 22650 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498866.423647:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916209024 00000100:00100000:2.0:1789498866.423650:0:22645:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916209024 00010000:00010000:2.0:1789498866.423658:0:22645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa076c1570c00/0x70d6b5fa1825e422 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70d6b5fa1825e41b expref: 26 pid: 22653 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498866.423667:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916209152 00000100:00100000:2.0:1789498866.423669:0:22645:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916209152 00010000:00010000:2.0:1789498866.423678:0:22645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa075857b1400/0x70d6b5fa1825e414 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70d6b5fa1825e40d expref: 27 pid: 22651 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498866.423689:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789498866.423694:0:22645:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa075877e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39f24317-e976-4eca-a2df-96def568323f+27:3642:x1876424916208384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789498866.423705:0:22645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498866.423716:0:22645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa076bc6d9200/0x70d6b5fa1825e5e2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70d6b5fa1825e5db expref: 27 pid: 22650 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.423724:0:22645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa076bc6d9200/0x70d6b5fa1825e5e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70d6b5fa1825e5db expref: 27 pid: 22650 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.423737:0:22645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498866.423765:0:22645:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa075877e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39f24317-e976-4eca-a2df-96def568323f+27:3642:x1876424916208384:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498866.423772:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789498866.423784:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789498866.423789:0:22645:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39f24317-e976-4eca-a2df-96def568323f+26:3642:x1876424916208896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789498866.423796:0:22645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498866.423800:0:22645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa076c1571200/0x70d6b5fa1825e461 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70d6b5fa1825e45a expref: 26 pid: 22650 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.423808:0:22645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa076c1571200/0x70d6b5fa1825e461 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70d6b5fa1825e45a expref: 26 pid: 22650 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.423816:0:22645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498866.423836:0:22645:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39f24317-e976-4eca-a2df-96def568323f+26:3642:x1876424916208896:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498866.423841:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789498866.423852:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789498866.423857:0:22645:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588198700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39f24317-e976-4eca-a2df-96def568323f+25:3643:x1876424916209024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789498866.423863:0:22645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498866.423867:0:22645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa076c1570c00/0x70d6b5fa1825e422 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70d6b5fa1825e41b expref: 25 pid: 22653 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.423885:0:22645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa076c1570c00/0x70d6b5fa1825e422 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70d6b5fa1825e41b expref: 25 pid: 22653 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.423893:0:22645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498866.423936:0:22645:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588198700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39f24317-e976-4eca-a2df-96def568323f+25:3643:x1876424916209024:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498866.423942:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789498866.423955:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789498866.423960:0:22645:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588199500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39f24317-e976-4eca-a2df-96def568323f+24:3643:x1876424916209152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789498866.423967:0:22645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498866.423971:0:22645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa075857b1400/0x70d6b5fa1825e414 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x70d6b5fa1825e40d expref: 24 pid: 22651 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.423978:0:22645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa075857b1400/0x70d6b5fa1825e414 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x70d6b5fa1825e40d expref: 24 pid: 22651 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.423987:0:22645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498866.424009:0:22645:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588199500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:39f24317-e976-4eca-a2df-96def568323f+24:3643:x1876424916209152:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498866.424014:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789498866.424045:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075877e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39f24317-e976-4eca-a2df-96def568323f:3642:1876424916208896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789498866.424053:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075877e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:39f24317-e976-4eca-a2df-96def568323f:3642:1876424916208384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789498866.424078:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39f24317-e976-4eca-a2df-96def568323f:3643:1876424916209152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789498866.424084:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075877e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39f24317-e976-4eca-a2df-96def568323f:3643:1876424916209024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789498866.424105:0:25703:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076c1179a80 going to sleep for 11 seconds 00010000:00010000:2.0:1789498866.424125:0:25703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa076bc6d9200/0x70d6b5fa1825e5e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70d6b5fa1825e5db expref: 23 pid: 22650 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498866.424135:0:25703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075877e6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25703:1876424916208256:0@lo:104: 00010000:00010000:2.0:1789498866.424144:0:25703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa076c1571200/0x70d6b5fa1825e461 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70d6b5fa1825e45a expref: 22 pid: 22650 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498866.424151:0:25703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075877e4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25703:1876424916208512:0@lo:104: 00010000:00010000:2.0:1789498866.424158:0:25703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa076c1570c00/0x70d6b5fa1825e422 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70d6b5fa1825e41b expref: 21 pid: 22653 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498866.424169:0:25703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075877e4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25703:1876424916208640:0@lo:104: 00010000:00010000:2.0:1789498866.424177:0:25703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa075857b1400/0x70d6b5fa1825e414 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x70d6b5fa1825e40d expref: 20 pid: 22651 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498866.424184:0:25703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075877e4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25703:1876424916208768:0@lo:104: 00010000:00010000:3.0:1789498866.424573:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789498866.425413:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498866.429164:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498866.429200:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498866.429235:0:23814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896174592 00000100:00100000:3.0:1789498866.429245:0:23814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896174592 00010000:00010000:3.0:1789498866.429284:0:23814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa076c0daa800/0x70d6b5fa1825e786 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f2f3 expref: 13 pid: 22650 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498866.429313:0:23814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896174720 00000100:00100000:3.0:1789498866.429315:0:23814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896174720 00010000:00010000:3.0:1789498866.429328:0:23814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0768bda8000/0x70d6b5fa1825e747 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f283 expref: 14 pid: 22651 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498866.429345:0:23814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 13 00000100:00100000:3.0:1789498866.429367:0:23814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586465050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:116bdd0f-0dd7-4d85-9352-94b0af277561+14:2392:x1876424896174592:12345-192.168.204.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498866.429383:0:23814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498866.429389:0:23814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa076c0daa800/0x70d6b5fa1825e786 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f2f3 expref: 14 pid: 22650 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498866.429401:0:23814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa076c0daa800/0x70d6b5fa1825e786 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f2f3 expref: 14 pid: 22650 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498866.429420:0:23814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498866.429474:0:23814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586465050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:116bdd0f-0dd7-4d85-9352-94b0af277561+14:2392:x1876424896174592:12345-192.168.204.17@tcp:103:ldlm_bl.0 Request processed in 107us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498866.429481:0:23814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 13 00000100:00100000:3.0:1789498866.429525:0:23814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 14 00000100:00100000:3.0:1789498866.429553:0:23814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076981b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:116bdd0f-0dd7-4d85-9352-94b0af277561+13:2392:x1876424896174720:12345-192.168.204.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498866.429561:0:23814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498866.429565:0:23814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0768bda8000/0x70d6b5fa1825e747 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f283 expref: 13 pid: 22651 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498866.429574:0:23814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0768bda8000/0x70d6b5fa1825e747 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f283 expref: 13 pid: 22651 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498866.429596:0:23814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa075874a1200/0x70d6b5fa1825e7b7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498866.429605:0:23814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa075874a1200/0x70d6b5fa1825e7b7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498866.429621:0:23814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa075874a1200/0x70d6b5fa1825e7b7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498866.429634:0:23814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa075874a1200/0x70d6b5fa1825e7b7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498866.429641:0:23814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa075874a1200/0x70d6b5fa1825e7b7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498866.429648:0:23814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa075874a1200/0x70d6b5fa1825e7b7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498866.429654:0:23814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a1200 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:3.0:1789498866.429658:0:23814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa075874a1200/0x70d6b5fa1825e7b7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498866.429666:0:23814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa075874a1200/0x70d6b5fa1825e7b7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498866.429676:0:23814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa075874a1200/0x70d6b5fa1825e7b7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498866.429687:0:23814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498866.429709:0:23814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076981b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:116bdd0f-0dd7-4d85-9352-94b0af277561+13:2392:x1876424896174720:12345-192.168.204.17@tcp:103:ldlm_bl.0 Request processed in 177us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498866.429716:0:23814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 14 00010000:00010000:2.0:1789498866.433113:0:25703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa076c0daa800/0x70d6b5fa1825e786 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f2f3 expref: 12 pid: 22650 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498866.433134:0:25703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075877e5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25703:1876424916208000:192.168.204.17@tcp:104: 00010000:00010000:2.0:1789498866.433146:0:25703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0768bda8000/0x70d6b5fa1825e747 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f283 expref: 11 pid: 22651 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498866.433155:0:25703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa075877e5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25703:1876424916208128:192.168.204.17@tcp:104: 00010000:00010000:2.0:1789498866.433192:0:25703:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa075874a1200/0x70d6b5fa1825e7b7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.433203:0:25703:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa075874a1200/0x70d6b5fa1825e7b7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.433228:0:25703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa075874a1200/0x70d6b5fa1825e7b7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498866.433235:0:25703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa075874a1200/0x70d6b5fa1825e7b7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498866.620708:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076846f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916209280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498866.620783:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498866.620829:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789498866.620835:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076846f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916209408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789498866.620857:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498866.620886:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916209280 00000100:00100000:1.0:1789498866.620895:0:24170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916209280 00000100:00100000:1.0:1789498866.620957:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916209408 00000100:00100000:1.0:1789498866.620961:0:24170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916209408 00000100:00100000:1.0:1789498866.620982:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789498866.620991:0:24170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076846f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916209280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789498866.621025:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1789498866.621072:0:24170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076846f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916209280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498866.621080:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789498866.621097:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789498866.621104:0:24170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076846f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916209408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789498866.621124:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1789498866.621152:0:24170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076846f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916209408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498866.621158:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789498866.621206:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076846f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916209408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789498866.621218:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076846f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916209280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789498866.621440:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876424916209664:0@lo:400:kworker.0 00000100:00100000:0.0:1789498866.621474:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498866.621492:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc42d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876424916210176:0@lo:400:kworker.0 00000100:00100000:0.0:1789498866.621514:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498866.621550:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789498866.621556:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876424916209536:0@lo:400:kworker.0 00000100:00100000:0.0:1789498866.621580:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498866.621598:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc42ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876424916210048:0@lo:400:kworker.0 00000100:00100000:0.0:1789498866.621620:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498866.621634:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc42f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1876424916210560:0@lo:400:kworker.0 00000100:00100000:0.0:1789498866.621655:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498866.621680:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916209536 00000100:00100000:0.0:1789498866.621685:0:22663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916209536 00000100:00100000:0.0:1789498866.621716:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789498866.621721:0:22663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc42d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876424916209536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498866.621759:0:22663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc42d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876424916209536:12345-0@lo:400:kworker.0 Request processed in 37us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498866.621776:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789498866.621809:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876424916209536:0@lo:400:kworker.0 00000100:00100000:2.0:1789498866.623244:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876424916209920:0@lo:400:kworker.0 00000100:00100000:2.0:1789498866.623293:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498866.623330:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc42e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1876424916210432:0@lo:400:kworker.0 00000100:00100000:2.0:1789498866.623352:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498866.623382:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789498866.623388:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876424916209792:0@lo:400:kworker.0 00000100:00100000:2.0:1789498866.623406:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498866.623415:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc42ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876424916210304:0@lo:400:kworker.0 00000100:00100000:2.0:1789498866.623431:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789498866.623448:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789498866.623456:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789498866.623462:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916210688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789498866.623481:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498866.623506:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916209920 00000100:00100000:2.0:1789498866.623512:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916209920 00000100:00100000:2.0:1789498866.623565:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916210688 00000100:00100000:2.0:1789498866.623569:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916210688 00000100:00100000:2.0:1789498866.623581:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789498866.623589:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1876424916209920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498866.623633:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1876424916209920:12345-0@lo:400:kworker.0 Request processed in 45us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498866.623651:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789498866.623664:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789498866.623669:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916210688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789498866.623695:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789498866.623728:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916210688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498866.623734:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789498866.623749:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916210176 00000100:00100000:2.0:1789498866.623753:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916210176 00000100:00100000:2.0:1789498866.623789:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916210048 00000100:00100000:2.0:1789498866.623792:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916210048 00000100:00100000:1.0:1789498866.623792:0:24475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916209664 00000100:00100000:1.0:1789498866.623796:0:24475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916209664 00000100:00100000:2.0:1789498866.623800:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916210560 00000100:00100000:2.0:1789498866.623802:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916210560 00000100:00100000:1.0:1789498866.623824:0:24475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789498866.623831:0:24475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc42f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876424916209664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498866.623871:0:24475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc42f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876424916209664:12345-0@lo:400:kworker.0 Request processed in 41us (2397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498866.623878:0:24475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789498866.623895:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916210432 00000100:00100000:1.0:1789498866.623898:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916210432 00000100:00100000:1.0:1789498866.623915:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916209792 00000100:00100000:1.0:1789498866.623931:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916209792 00000100:00100000:1.0:1789498866.623942:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916210304 00000100:00100000:1.0:1789498866.623945:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916210304 00000100:00100000:1.0:1789498866.623958:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789498866.623963:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc42dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876424916210176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498866.623994:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc42dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876424916210176:12345-0@lo:400:kworker.0 Request processed in 30us (2479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498866.624000:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789498866.624011:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789498866.624017:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc42e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876424916210048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498866.624058:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc42e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876424916210048:12345-0@lo:400:kworker.0 Request processed in 41us (2437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498866.624065:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789498866.624076:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789498866.624083:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876424916210432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498866.624108:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876424916210432:12345-0@lo:400:kworker.0 Request processed in 27us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498866.624114:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789498866.624124:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789498866.624129:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876424916209792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498866.624154:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876424916209792:12345-0@lo:400:kworker.0 Request processed in 26us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498866.624160:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789498866.624169:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789498866.624175:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876424916210304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498866.624198:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876424916210304:12345-0@lo:400:kworker.0 Request processed in 24us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498866.624203:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789498866.624261:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc42ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876424916210048:0@lo:400:kworker.0 00000100:00100000:2.0:1789498866.624274:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789498866.624275:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876424916209664:0@lo:400:kworker.0 00000100:00100000:2.0:1789498866.624280:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc42f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876424916210560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789498866.624284:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc42d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1876424916210176:0@lo:400:kworker.0 00000100:00100000:2.0:1789498866.624312:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc42f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876424916210560:12345-0@lo:400:kworker.0 Request processed in 32us (2656us total) trans 0 rc 0/0 00010000:00080000:1.0:1789498866.624324:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa076bc42f800 x1876424916210560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498866.624330:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789498866.624349:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc42f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1876424916210560:0@lo:400:kworker.0 00000100:00100000:2.0:1789498866.624374:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916210688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789498866.624402:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876424916209792:0@lo:400:kworker.0 00010000:00080000:2.0:1789498866.624412:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa076bc42ca80 x1876424916210304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789498866.624420:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc42ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1876424916210304:0@lo:400:kworker.0 00000100:00100000:2.0:1789498866.624428:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876424916209920:0@lo:400:kworker.0 00000100:00080000:0.0:1789498866.624430:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789498866.624434:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789498866.624447:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc42e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1876424916210432:0@lo:400:kworker.0 00010000:00010000:2.0:1789498867.195875:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498867.968568:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498867.968758:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896174848 00000100:00100000:3.0:1789498867.968771:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896174848 00000100:00100000:3.0:1789498867.968836:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 151 00000100:00100000:3.0:1789498867.968847:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:116bdd0f-0dd7-4d85-9352-94b0af277561+11:18049:x1876424896174848:12345-192.168.204.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789498867.968867:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498867.968914:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa076c0daaa00/0x70d6b5fa1825e7be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f32b expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498867.968945:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa076c0daaa00/0x70d6b5fa1825e7be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f32b expref: 12 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498867.968956:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa076c0daaa00/0x70d6b5fa1825e7be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f32b expref: 12 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498867.968966:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa076c0daaa00, rc 0) 00000100:00100000:3.0:1789498867.969046:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:116bdd0f-0dd7-4d85-9352-94b0af277561+12:18049:x1876424896174848:12345-192.168.204.17@tcp:101:ll_cfg_requeue.0 Request processed in 200us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498867.969054:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 151 00000100:00100000:3.0:1789498868.015291:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498868.015479:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896174976 00000100:00100000:2.0:1789498868.015490:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896174976 00000100:00100000:2.0:1789498868.015603:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 152 00000100:00100000:2.0:1789498868.015615:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07685114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:116bdd0f-0dd7-4d85-9352-94b0af277561+12:18049:x1876424896174976:12345-192.168.204.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789498868.015793:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07685114850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:116bdd0f-0dd7-4d85-9352-94b0af277561+12:18049:x1876424896174976:12345-192.168.204.17@tcp:501:ll_cfg_requeue.0 Request processed in 181us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498868.015801:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 152 00000100:00100000:2.0:1789498868.032792:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498868.033008:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896175104 00000100:00100000:1.0:1789498868.033019:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896175104 00000100:00100000:1.0:1789498868.033084:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 153 00000100:00100000:1.0:1789498868.033098:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07682ae9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:116bdd0f-0dd7-4d85-9352-94b0af277561+12:18049:x1876424896175104:12345-192.168.204.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789498868.033283:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07682ae9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:116bdd0f-0dd7-4d85-9352-94b0af277561+12:18049:x1876424896175104:12345-192.168.204.17@tcp:503:ll_cfg_requeue.0 Request processed in 188us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498868.033299:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 153 00000100:00100000:0.0:1789498868.051852:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498868.052146:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896175232 00000100:00100000:3.0:1789498868.052159:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896175232 00000100:00100000:3.0:1789498868.052223:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 154 00000100:00100000:3.0:1789498868.052234:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07682ae8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:116bdd0f-0dd7-4d85-9352-94b0af277561+12:18049:x1876424896175232:12345-192.168.204.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789498868.052253:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498868.052272:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa076c0daa400/0x70d6b5fa1825e7c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f332 expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.052313:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa076c0daa400/0x70d6b5fa1825e7c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f332 expref: 13 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.052326:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa076c0daa400/0x70d6b5fa1825e7c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f332 expref: 13 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.052336:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa076c0daa400, rc 0) 00000100:00100000:3.0:1789498868.052419:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07682ae8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:116bdd0f-0dd7-4d85-9352-94b0af277561+13:18049:x1876424896175232:12345-192.168.204.17@tcp:101:ll_cfg_requeue.0 Request processed in 187us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498868.052427:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 154 00000100:00100000:3.0:1789498868.059456:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498868.059807:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896175360 00000100:00100000:2.0:1789498868.059823:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896175360 00000100:00100000:2.0:1789498868.059887:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 155 00000100:00100000:2.0:1789498868.059908:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07682ae9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:116bdd0f-0dd7-4d85-9352-94b0af277561+13:18049:x1876424896175360:12345-192.168.204.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789498868.060087:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07682ae9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:116bdd0f-0dd7-4d85-9352-94b0af277561+13:18049:x1876424896175360:12345-192.168.204.17@tcp:501:ll_cfg_requeue.0 Request processed in 179us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498868.060095:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 155 00000100:00100000:2.0:1789498868.066063:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498868.066174:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896175488 00000100:00100000:1.0:1789498868.066185:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896175488 00000100:00100000:1.0:1789498868.066243:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 156 00000100:00100000:1.0:1789498868.066254:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07682ae8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:116bdd0f-0dd7-4d85-9352-94b0af277561+13:18049:x1876424896175488:12345-192.168.204.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789498868.066424:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07682ae8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:116bdd0f-0dd7-4d85-9352-94b0af277561+13:18049:x1876424896175488:12345-192.168.204.17@tcp:503:ll_cfg_requeue.0 Request processed in 171us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498868.066434:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 156 00010000:00010000:3.0:1789498868.219792:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789498868.278010:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498868.278196:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896175616 00000100:00100000:1.0:1789498868.278206:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896175616 00000100:00100000:1.0:1789498868.278294:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 23 00000100:00100000:1.0:1789498868.278306:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc42ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f01496a-f99d-4000-a86c-f777ddf70925+6:18686:x1876424896175616:12345-192.168.204.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789498868.278328:0:22660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498868.278351:0:22660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e600/0x70d6b5fa1825e7cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f339 expref: -99 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.278420:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e800/0x70d6b5fa1825e7d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.278449:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e800/0x70d6b5fa1825e7d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.278464:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e800/0x70d6b5fa1825e7d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.278480:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fc00/0x70d6b5fa1825e7da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.278488:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fc00/0x70d6b5fa1825e7da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.278495:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fc00/0x70d6b5fa1825e7da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.278608:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564ea00/0x70d6b5fa1825e7e1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.278618:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564ea00/0x70d6b5fa1825e7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.278627:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564ea00/0x70d6b5fa1825e7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498868.278661:0:22660:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789498868.278665:0:22660:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789498868.278705:0:22660:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564ea00/0x70d6b5fa1825e7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.278718:0:22660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e800/0x70d6b5fa1825e7d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.278736:0:22660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e800/0x70d6b5fa1825e7d3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.278744:0:22660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e800/0x70d6b5fa1825e7d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.278751:0:22660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0758564e800 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:1.0:1789498868.278756:0:22660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e800/0x70d6b5fa1825e7d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.278764:0:22660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e800/0x70d6b5fa1825e7d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.278776:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa076be804000) 00010000:00010000:1.0:1789498868.278779:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498868.278784:0:22660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e800/0x70d6b5fa1825e7d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.278790:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e800/0x70d6b5fa1825e7d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.278805:0:22660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fc00/0x70d6b5fa1825e7da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.278810:0:22660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fc00/0x70d6b5fa1825e7da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.278816:0:22660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fc00/0x70d6b5fa1825e7da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.278821:0:22660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0758564fc00 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:1.0:1789498868.278829:0:22660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fc00/0x70d6b5fa1825e7da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.278835:0:22660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fc00/0x70d6b5fa1825e7da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.278843:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffffa076be804e00) 00010000:00010000:1.0:1789498868.278846:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498868.278848:0:22660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fc00/0x70d6b5fa1825e7da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.278854:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fc00/0x70d6b5fa1825e7da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.279001:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e600/0x70d6b5fa1825e7cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f339 expref: 8 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.279017:0:22660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564ea00/0x70d6b5fa1825e7e1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f339 expref: 7 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.279025:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa076be804b00) 00010000:00010000:1.0:1789498868.279027:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789498868.279030:0:22660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0758564ea00, rc 0) 00000100:00100000:1.0:1789498868.279096:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc42ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f01496a-f99d-4000-a86c-f777ddf70925+7:18686:x1876424896175616:12345-192.168.204.17@tcp:101:lhsmtool_posix.0 Request processed in 793us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498868.279103:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 23 00000100:00080000:0.0:1789498868.279663:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789498868.284926:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498868.285865:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896175744 00000100:00100000:1.0:1789498868.285894:0:22670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896175744 00000100:00100000:1.0:1789498868.285962:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 5 00000100:00100000:1.0:1789498868.285973:0:22670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076981b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7f01496a-f99d-4000-a86c-f777ddf70925+7:18686:x1876424896175744:12345-192.168.204.17@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789498868.286091:0:22670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076981b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7f01496a-f99d-4000-a86c-f777ddf70925+7:18686:x1876424896175744:12345-192.168.204.17@tcp:900:lhsmtool_posix.0 Request processed in 120us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498868.286099:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 5 00000100:00100000:3.0:1789498868.288226:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498868.288429:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896176000 00000100:00100000:2.0:1789498868.288444:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896176000 00000100:00100000:2.0:1789498868.288601:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 24 00000100:00100000:2.0:1789498868.288614:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076981b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f01496a-f99d-4000-a86c-f777ddf70925+7:18686:x1876424896176000:12345-192.168.204.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789498868.288647:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498868.288693:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e7e8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f340 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.288804:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0400/0x70d6b5fa1825e7ef lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.288820:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0400/0x70d6b5fa1825e7ef lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.288832:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0400/0x70d6b5fa1825e7ef lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.289208:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0a00/0x70d6b5fa1825e7f6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.289216:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0a00/0x70d6b5fa1825e7f6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.289224:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0a00/0x70d6b5fa1825e7f6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.289437:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0600/0x70d6b5fa1825e7fd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.289447:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0600/0x70d6b5fa1825e7fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.289455:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0600/0x70d6b5fa1825e7fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498868.289467:0:22659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1789498868.289926:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0400/0x70d6b5fa1825e7ef lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.289944:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0400/0x70d6b5fa1825e7ef lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.289950:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0400/0x70d6b5fa1825e7ef lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.289956:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a0400 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:2.0:1789498868.289961:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0400/0x70d6b5fa1825e7ef lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.289969:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0400/0x70d6b5fa1825e7ef lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.289983:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa076be804b00) 00010000:00010000:2.0:1789498868.289985:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498868.289991:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0400/0x70d6b5fa1825e7ef lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.289997:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0400/0x70d6b5fa1825e7ef lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.290012:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0a00/0x70d6b5fa1825e7f6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.290029:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0a00/0x70d6b5fa1825e7f6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.290035:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0a00/0x70d6b5fa1825e7f6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.290039:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a0a00 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:2.0:1789498868.290048:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0a00/0x70d6b5fa1825e7f6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.290054:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0a00/0x70d6b5fa1825e7f6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.290061:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffffa07587434900) 00010000:00010000:2.0:1789498868.290064:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498868.290067:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0a00/0x70d6b5fa1825e7f6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.290072:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0a00/0x70d6b5fa1825e7f6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.292172:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e7e8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f340 expref: 10 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.292199:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0600/0x70d6b5fa1825e7fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f340 expref: 9 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.292209:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa07587434600) 00010000:00010000:2.0:1789498868.292211:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498868.292215:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa075874a0600, rc 0) 00000100:00100000:2.0:1789498868.292305:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076981b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f01496a-f99d-4000-a86c-f777ddf70925+9:18686:x1876424896176000:12345-192.168.204.17@tcp:101:lhsmtool_posix.0 Request processed in 3693us (4096us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1789498868.292315:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 24 00000100:00100000:3.0:1789498868.302062:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498868.302198:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896176128 00000100:00100000:1.0:1789498868.302211:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896176128 00000100:00100000:1.0:1789498868.302276:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 25 00000100:00100000:1.0:1789498868.302294:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076981b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f01496a-f99d-4000-a86c-f777ddf70925+9:18686:x1876424896176128:12345-192.168.204.17@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789498868.302417:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076981b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f01496a-f99d-4000-a86c-f777ddf70925+9:18686:x1876424896176128:12345-192.168.204.17@tcp:59:lhsmtool_posix.0 Request processed in 132us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498868.302426:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 25 00000100:00100000:1.0:1789498868.309958:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498868.312334:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896176256 00000100:00100000:2.0:1789498868.312352:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896176256 00000100:00100000:3.0:1789498868.313399:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 26 00000100:00100000:3.0:1789498868.313420:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076846f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f01496a-f99d-4000-a86c-f777ddf70925+5:18686:x1876424896176256:12345-192.168.204.17@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1789498868.316338:0:22658:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2820us 00000100:00080000:0.0:1789498868.318959:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789498868.335131:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076846f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f01496a-f99d-4000-a86c-f777ddf70925+5:18686:x1876424896176256:12345-192.168.204.17@tcp:59:lhsmtool_posix.0 Request processed in 21707us (25169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498868.335149:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 26 00000100:00100000:3.0:1789498868.389993:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498868.390098:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896176384 00000100:00100000:1.0:1789498868.390113:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896176384 00000100:00100000:1.0:1789498868.390188:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 27 00000100:00100000:1.0:1789498868.390200:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076981b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f01496a-f99d-4000-a86c-f777ddf70925+9:18692:x1876424896176384:12345-192.168.204.17@tcp:101:lfs.0 00010000:00010000:1.0:1789498868.390228:0:22660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498868.390258:0:22660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e800/0x70d6b5fa1825e80b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f347 expref: -99 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.390342:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fa00/0x70d6b5fa1825e812 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.390358:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fa00/0x70d6b5fa1825e812 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.390391:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fa00/0x70d6b5fa1825e812 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.390468:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fc00/0x70d6b5fa1825e819 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.390476:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fc00/0x70d6b5fa1825e819 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.390484:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fc00/0x70d6b5fa1825e819 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.390551:0:22660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fa00/0x70d6b5fa1825e812 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.390560:0:22660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fa00/0x70d6b5fa1825e812 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.390568:0:22660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fa00/0x70d6b5fa1825e812 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.390574:0:22660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0758564fa00 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:1.0:1789498868.390579:0:22660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fa00/0x70d6b5fa1825e812 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.390586:0:22660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fa00/0x70d6b5fa1825e812 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.390598:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa076be804000) 00010000:00010000:1.0:1789498868.390601:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498868.390606:0:22660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fa00/0x70d6b5fa1825e812 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.390620:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fa00/0x70d6b5fa1825e812 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.390636:0:22660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fc00/0x70d6b5fa1825e819 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.390643:0:22660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fc00/0x70d6b5fa1825e819 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.390648:0:22660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fc00/0x70d6b5fa1825e819 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.390653:0:22660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0758564fc00 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:1.0:1789498868.390656:0:22660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fc00/0x70d6b5fa1825e819 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.390661:0:22660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fc00/0x70d6b5fa1825e819 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.390668:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffffa076be804e00) 00010000:00010000:1.0:1789498868.390671:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498868.390674:0:22660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fc00/0x70d6b5fa1825e819 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.390679:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fc00/0x70d6b5fa1825e819 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.390710:0:22660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e800/0x70d6b5fa1825e80b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f347 expref: 10 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.390731:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa076be804000) 00010000:00010000:1.0:1789498868.390733:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498868.390736:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e800/0x70d6b5fa1825e80b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f347 expref: 10 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.390745:0:22660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0758564e800, rc 0) 00000100:00100000:1.0:1789498868.390813:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076981b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f01496a-f99d-4000-a86c-f777ddf70925+9:18692:x1876424896176384:12345-192.168.204.17@tcp:101:lfs.0 Request processed in 615us (832us total) trans 0 rc 301/301 00000100:00100000:1.0:1789498868.390820:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 27 00000100:00100000:1.0:1789498868.395148:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:0.0:1789498868.395302:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896176512 00000100:00100000:0.0:1789498868.395317:0:22667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896176512 00000100:00100000:0.0:1789498868.395395:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 0 00000100:00100000:0.0:1789498868.395410:0:22667:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076846f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7f01496a-f99d-4000-a86c-f777ddf70925+9:18692:x1876424896176512:12345-192.168.204.17@tcp:700:lfs.0 00000100:00100000:0.0:1789498868.395583:0:22667:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076846f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7f01496a-f99d-4000-a86c-f777ddf70925+9:18692:x1876424896176512:12345-192.168.204.17@tcp:700:lfs.0 Request processed in 178us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498868.395591:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 0 00000100:00100000:3.0:1789498868.397617:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498868.397714:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896176768 00000100:00100000:2.0:1789498868.397726:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896176768 00000100:00100000:2.0:1789498868.397821:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 28 00000100:00100000:2.0:1789498868.397831:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076981b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f01496a-f99d-4000-a86c-f777ddf70925+9:18692:x1876424896176768:12345-192.168.204.17@tcp:36:lfs.0 00010000:00010000:2.0:1789498868.397919:0:22659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498868.397959:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e400/0x70d6b5fa1825e771 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f2b4 expref: 9 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.397984:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa076be804000) 00010000:00010000:2.0:1789498868.397992:0:22659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789498868.398072:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e820 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.398091:0:22659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0768bda9000/0x70d6b5fa1825e7b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f324 expref: 5 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.398101:0:22659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e820 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.398141:0:22659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0768bda9000/0x70d6b5fa1825e7b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f324 expref: 5 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.398158:0:22659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0768bda9000/0x70d6b5fa1825e7b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f324 expref: 5 pid: 22658 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498868.398174:0:22659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22659:1876424916210816:192.168.204.17@tcp:104: 00000100:00100000:2.0:1789498868.398282:0:22659:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076c1179e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789498868.400150:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498868.400412:0:22659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22659:1876424916210816:192.168.204.17@tcp:104: 00010000:00010000:2.0:1789498868.400448:0:22659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e820 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498868.400791:0:23814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896176896 00000100:00100000:0.0:1789498868.400799:0:23814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896176896 00010000:00010000:0.0:1789498868.400859:0:23814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0768bda9000/0x70d6b5fa1825e7b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f324 expref: 6 pid: 22658 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789498868.401108:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498868.401165:0:23814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 15 00000100:00100000:0.0:1789498868.401176:0:23814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076981b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+6:2393:x1876424896176896:12345-192.168.204.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498868.401191:0:23814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498868.401198:0:23814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0768bda9000/0x70d6b5fa1825e7b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f324 expref: 6 pid: 22658 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498868.401225:0:23814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0768bda9000/0x70d6b5fa1825e7b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f324 expref: 6 pid: 22658 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498868.401255:0:23814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0768bda9000/0x70d6b5fa1825e7b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f324 expref: 6 pid: 22658 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498868.401275:0:23814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa076be804000) 00010000:00010000:0.0:1789498868.401282:0:23814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e820 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498868.401294:0:23814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e820 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498868.401303:0:23814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e820 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498868.401345:0:23814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498868.401426:0:23814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076981b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+5:2393:x1876424896176896:12345-192.168.204.17@tcp:103:ldlm_bl.0 Request processed in 250us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498868.401438:0:23814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 15 00010000:00010000:2.0:1789498868.401524:0:22659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e820 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.401565:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e820 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.401590:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0a00/0x70d6b5fa1825e827 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.401600:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0a00/0x70d6b5fa1825e827 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.401608:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0a00/0x70d6b5fa1825e827 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.414260:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0dabc00/0x70d6b5fa1825e82e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.414286:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0dabc00/0x70d6b5fa1825e82e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.414298:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0dabc00/0x70d6b5fa1825e82e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789498868.414317:0:22659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048ee776a reply state 000000003280178c transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0dabc00/0x70d6b5fa1825e82e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.414329:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0dabc00/0x70d6b5fa1825e82e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.414348:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa07686795300) 00010000:00010000:3.0:1789498868.414352:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789498868.414357:0:22659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789498868.414363:0:22659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789498868.414373:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e820 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.414380:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e820 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.414387:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e820 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.414392:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a1e00 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:3.0:1789498868.414410:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e820 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.414419:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e820 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.414430:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa076be804000) 00010000:00010000:3.0:1789498868.414432:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498868.414436:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e820 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.414443:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e820 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789498868.414471:0:22659:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048ee776a reply state 000000003280178c transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0a00/0x70d6b5fa1825e827 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.414523:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0a00/0x70d6b5fa1825e827 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.415144:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffffa07587434900) 00010000:00010000:3.0:1789498868.415151:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789498868.415156:0:22659:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789498868.415295:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076981b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f01496a-f99d-4000-a86c-f777ddf70925+10:18692:x1876424896176768:12345-192.168.204.17@tcp:36:lfs.0 Request processed in 17459us (17681us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1789498868.415315:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 28 10000000:01000000:2.0:1789498868.475911:0:22655:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789498868.475920:0:22655:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0758755b800 from 13 10000000:01000000:2.0:1789498868.475927:0:22655:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789498868.475981:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075874a0400/0x70d6b5fa1825e835 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.475993:0:22655:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa075874a0400/0x70d6b5fa1825e835 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.476006:0:22655:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa075874a0400/0x70d6b5fa1825e835 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498868.476037:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916210944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789498868.476121:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498868.476190:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076c1179180 going to sleep for 11 seconds 00000100:00100000:0.0:1789498868.476596:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916210944 00000100:00100000:0.0:1789498868.476606:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916210944 00000100:00100000:0.0:1789498868.476688:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789498868.476698:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07682aeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+20:22655:x1876424916210944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789498868.476714:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498868.476728:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0768bda9000/0x70d6b5fa1825e83c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e835 expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498868.476768:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0768bda9000/0x70d6b5fa1825e83c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e835 expref: 21 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498868.476780:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0768bda9000/0x70d6b5fa1825e83c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e835 expref: 21 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498868.476791:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0768bda9000, rc 0) 00000100:00100000:0.0:1789498868.476847:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07682aeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+21:22655:x1876424916210944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498868.476853:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789498868.477157:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916210944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789498868.477173:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa075874a0400/0x70d6b5fa1825e835 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e83c expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498868.477183:0:22655:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa075874a0400/0x70d6b5fa1825e835 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e83c expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498868.477247:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc42d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916211072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789498868.477278:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498868.477302:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07587787e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789498868.477433:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916211072 00000100:00100000:2.0:1789498868.477438:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916211072 00000100:00100000:2.0:1789498868.477476:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789498868.477484:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+21:22655:x1876424916211072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789498868.477641:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+21:22655:x1876424916211072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498868.477648:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789498868.478212:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc42d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916211072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789498868.478262:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc42d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916211200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789498868.478303:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498868.478334:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa07587787e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789498868.478387:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916211200 00000100:00100000:2.0:1789498868.478392:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916211200 00000100:00100000:2.0:1789498868.478424:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789498868.478432:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+21:22655:x1876424916211200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789498868.478702:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:39f24317-e976-4eca-a2df-96def568323f+21:22655:x1876424916211200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 269us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498868.478709:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789498868.485209:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc42d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916211200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789498868.486645:0:25718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789498868.487005:0:22655:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789498868.487030:0:22655:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789498868.487043:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075874a0400/0x70d6b5fa1825e835 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e83c expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.487055:0:22655:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa075874a0400/0x70d6b5fa1825e835 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e83c expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789498868.487065:0:22655:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789498868.487068:0:22655:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa07581547800 from 13 10000000:01000000:2.0:1789498868.487070:0:22655:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789498868.487108:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825e843 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.487131:0:22655:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825e843 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.487143:0:22655:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825e843 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498868.487174:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588199180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916211328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789498868.487243:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498868.487302:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076c1179d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789498868.487440:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916211328 00000100:00100000:0.0:1789498868.487448:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916211328 00000100:00100000:0.0:1789498868.487588:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789498868.487600:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+21:22655:x1876424916211328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789498868.487615:0:22650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498868.487628:0:22650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0768bda9a00/0x70d6b5fa1825e84a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e843 expref: -99 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498868.487654:0:22650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0768bda9a00/0x70d6b5fa1825e84a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e843 expref: 22 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498868.487666:0:22650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0768bda9a00/0x70d6b5fa1825e84a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e843 expref: 22 pid: 22650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498868.487675:0:22650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0768bda9a00, rc 0) 00000100:00100000:0.0:1789498868.487781:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+22:22655:x1876424916211328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498868.487793:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789498868.487907:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588199180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916211328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789498868.487923:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825e843 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e84a expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.487936:0:22655:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825e843 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e84a expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498868.488061:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076981b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916211456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498868.488117:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498868.500334:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916211456 00000100:00100000:1.0:1789498868.500357:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916211456 00000100:00100000:1.0:1789498868.500457:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789498868.500475:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+22:22655:x1876424916211456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789498868.500821:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+22:22655:x1876424916211456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 352us (12704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498868.500830:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789498868.501386:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076bc75cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789498868.501430:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076981b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916211456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789498868.501521:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588198e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916211584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789498868.501661:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498868.502002:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076c1179000 going to sleep for 11 seconds 00000100:00100000:1.0:1789498868.503897:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916211584 00000100:00100000:1.0:1789498868.503910:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916211584 00000100:00100000:1.0:1789498868.503974:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789498868.503982:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+22:22655:x1876424916211584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789498868.504169:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+22:22655:x1876424916211584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 187us (2509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498868.504178:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789498868.504355:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588198e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916211584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789498868.509359:0:25719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789498868.515665:0:22655:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789498868.515834:0:22655:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789498868.515847:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825e843 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e84a expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.515860:0:22655:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa075874a0000/0x70d6b5fa1825e843 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e84a expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498868.516011:0:22655:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789498868.516014:0:22655:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa076bc350800 from 13 10000000:01000000:3.0:1789498868.516017:0:22655:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789498868.516055:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c0daa600/0x70d6b5fa1825e851 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.516063:0:22655:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa076c0daa600/0x70d6b5fa1825e851 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.516074:0:22655:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa076c0daa600/0x70d6b5fa1825e851 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498868.516098:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076981b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916211712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789498868.516168:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498868.516217:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076bc75c180 going to sleep for 11 seconds 00000100:00100000:1.0:1789498868.516396:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916211712 00000100:00100000:1.0:1789498868.516425:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916211712 00000100:00100000:1.0:1789498868.516664:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789498868.516677:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+22:22655:x1876424916211712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789498868.516701:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498868.516717:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0758564fc00/0x70d6b5fa1825e858 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e851 expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.516742:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0758564fc00/0x70d6b5fa1825e858 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e851 expref: 23 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.516753:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0758564fc00/0x70d6b5fa1825e858 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e851 expref: 23 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.516761:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0758564fc00, rc 0) 00000100:00100000:1.0:1789498868.516806:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+23:22655:x1876424916211712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498868.517013:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076981b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916211712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789498868.517030:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa076c0daa600/0x70d6b5fa1825e851 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e858 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.517041:0:22655:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa076c0daa600/0x70d6b5fa1825e851 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e858 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498868.517100:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076981b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916211840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498868.517129:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498868.517149:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076bc75c180 going to sleep for 11 seconds 00000100:00100000:0.0:1789498868.517341:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:0.0:1789498868.517375:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916211840 00000100:00100000:0.0:1789498868.517380:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916211840 00000100:00100000:3.0:1789498868.517904:0:25457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896177024 00000100:00100000:3.0:1789498868.517913:0:25457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896177024 00000100:00100000:3.0:1789498868.517987:0:25457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 29 00000100:00100000:3.0:1789498868.518000:0:25457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc42d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f01496a-f99d-4000-a86c-f777ddf70925+10:18700:x1876424896177024:12345-192.168.204.17@tcp:101:lctl.0 00010000:00010000:3.0:1789498868.518022:0:25457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498868.518048:0:25457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0dab600/0x70d6b5fa1825e85f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f34e expref: -99 pid: 25457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.518133:0:25457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daa200/0x70d6b5fa1825e866 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.518150:0:25457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daa200/0x70d6b5fa1825e866 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.518161:0:25457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daa200/0x70d6b5fa1825e866 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498868.518212:0:25457:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789498868.518216:0:25457:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789498868.518257:0:25457:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daa200/0x70d6b5fa1825e866 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.518281:0:25457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0dab600/0x70d6b5fa1825e85f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f34e expref: 12 pid: 25457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.518299:0:25457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daa200/0x70d6b5fa1825e866 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f34e expref: 11 pid: 25457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.518308:0:25457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa07686795200) 00010000:00010000:3.0:1789498868.518311:0:25457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789498868.518315:0:25457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa076c0daa200, rc 0) 00000100:00100000:3.0:1789498868.518366:0:25457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc42d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f01496a-f99d-4000-a86c-f777ddf70925+11:18700:x1876424896177024:12345-192.168.204.17@tcp:101:lctl.0 Request processed in 370us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498868.518380:0:25457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 29 00000100:00100000:1.0:1789498868.530132:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789498868.530497:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789498868.530516:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+23:22655:x1876424916211840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789498868.530849:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+23:22655:x1876424916211840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 341us (13718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498868.530857:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789498868.530936:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076981b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916211840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498868.530999:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076981b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916211968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789498868.531047:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498868.531085:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076bc75c180 going to sleep for 11 seconds 00000100:00100000:0.0:1789498868.531189:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916211968 00000100:00100000:0.0:1789498868.531197:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916211968 00000100:00100000:0.0:1789498868.531360:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789498868.531367:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+23:22655:x1876424916211968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789498868.531466:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+23:22655:x1876424916211968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498868.531473:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789498868.531555:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076981b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916211968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789498868.532919:0:25720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789498868.533549:0:22655:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789498868.533576:0:22655:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789498868.533589:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c0daa600/0x70d6b5fa1825e851 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e858 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.533602:0:22655:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa076c0daa600/0x70d6b5fa1825e851 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e858 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789498868.533613:0:22655:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789498868.533616:0:22655:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0758605a000 from 13 10000000:01000000:3.0:1789498868.533619:0:22655:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789498868.533655:0:22655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c0dab400/0x70d6b5fa1825e86d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.533664:0:22655:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.117@tcp lock: ffffa076c0dab400/0x70d6b5fa1825e86d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.533676:0:22655:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.117@tcp lock: ffffa076c0dab400/0x70d6b5fa1825e86d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498868.533699:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076981b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916212096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789498868.533795:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498868.533841:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076bc75c180 going to sleep for 11 seconds 00000100:00100000:1.0:1789498868.534239:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916212096 00000100:00100000:1.0:1789498868.534249:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916212096 00000100:00100000:1.0:1789498868.534323:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789498868.534341:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+23:22655:x1876424916212096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789498868.534364:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498868.534391:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0758564fa00/0x70d6b5fa1825e874 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x70d6b5fa1825e86d expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.534434:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0758564fa00/0x70d6b5fa1825e874 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x70d6b5fa1825e86d expref: 24 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.534452:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0758564fa00/0x70d6b5fa1825e874 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x70d6b5fa1825e86d expref: 24 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.535061:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0758564fa00, rc 0) 00000100:00100000:1.0:1789498868.535123:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+24:22655:x1876424916212096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 785us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498868.535129:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789498868.535276:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076981b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916212096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789498868.535313:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.117@tcp lock: ffffa076c0dab400/0x70d6b5fa1825e86d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e874 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.535332:0:22655:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.117@tcp lock: ffffa076c0dab400/0x70d6b5fa1825e86d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x70d6b5fa1825e874 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498868.535459:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076981b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916212224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789498868.535566:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498868.535593:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076bc75c180 going to sleep for 11 seconds 00000100:00100000:0.0:1789498868.535807:0:22650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916212224 00000100:00100000:0.0:1789498868.535812:0:22650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916212224 00000100:00100000:0.0:1789498868.535852:0:22650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789498868.535874:0:22650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+24:22655:x1876424916212224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789498868.536045:0:22650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:39f24317-e976-4eca-a2df-96def568323f+24:22655:x1876424916212224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 184us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498868.536055:0:22650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789498868.537943:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076981b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916212224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789498868.538085:0:22655:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076846f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916212352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789498868.538173:0:22655:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498868.538262:0:22655:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a9c28600 going to sleep for 11 seconds 00000100:00100000:2.0:1789498868.541668:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916212352 00000100:00100000:2.0:1789498868.541683:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916212352 00000100:00100000:2.0:1789498868.541824:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789498868.541836:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+24:22655:x1876424916212352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789498868.542024:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+24:22655:x1876424916212352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (3850us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498868.542033:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789498868.542058:0:22655:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076846f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:39f24317-e976-4eca-a2df-96def568323f:22655:1876424916212352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789498868.543063:0:25721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789498868.543188:0:22655:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789498868.543216:0:22655:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789498868.543227:0:22655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.117@tcp lock: ffffa076c0dab400/0x70d6b5fa1825e86d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e874 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.543239:0:22655:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.117@tcp lock: ffffa076c0dab400/0x70d6b5fa1825e86d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x70d6b5fa1825e874 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498868.556062:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498868.556155:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896177152 00000100:00100000:3.0:1789498868.556165:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896177152 00000100:00100000:3.0:1789498868.556246:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 30 00000100:00100000:3.0:1789498868.556267:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076846f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+5:18701:x1876424896177152:12345-192.168.204.17@tcp:101:lfs.0 00010000:00010000:3.0:1789498868.556298:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498868.556331:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daa000/0x70d6b5fa1825e87b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f355 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.556425:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0dab600/0x70d6b5fa1825e882 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.556447:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0dab600/0x70d6b5fa1825e882 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.556466:0:22658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0dab600/0x70d6b5fa1825e882 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789498868.557134:0:22658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789498868.557139:0:22658:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789498868.557162:0:22658:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0dab600/0x70d6b5fa1825e882 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.557193:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daa000/0x70d6b5fa1825e87b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f355 expref: 7 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.557213:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0dab600/0x70d6b5fa1825e882 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f355 expref: 6 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498868.557222:0:22658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa07686795200) 00010000:00010000:3.0:1789498868.557225:0:22658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789498868.557229:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa076c0dab600, rc 0) 00000100:00100000:3.0:1789498868.557373:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076846f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+6:18701:x1876424896177152:12345-192.168.204.17@tcp:101:lfs.0 Request processed in 1112us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498868.557384:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 30 00000100:00100000:3.0:1789498868.564667:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498868.565115:0:25457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896177280 00000100:00100000:2.0:1789498868.565130:0:25457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896177280 00000100:00100000:2.0:1789498868.565239:0:25457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 31 00000100:00100000:2.0:1789498868.565266:0:25457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076981b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+6:18701:x1876424896177280:12345-192.168.204.17@tcp:101:lfs.0 00010000:00010000:2.0:1789498868.565288:0:25457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498868.565310:0:25457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825e889 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f35c expref: -99 pid: 25457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.565374:0:25457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1200/0x70d6b5fa1825e890 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.565391:0:25457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1200/0x70d6b5fa1825e890 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.565404:0:25457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1200/0x70d6b5fa1825e890 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.565415:0:25457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e897 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.565423:0:25457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e897 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.565429:0:25457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e897 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.565566:0:25457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0200/0x70d6b5fa1825e89e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.565576:0:25457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0200/0x70d6b5fa1825e89e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.565584:0:25457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0200/0x70d6b5fa1825e89e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498868.565662:0:25457:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789498868.565666:0:25457:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789498868.565702:0:25457:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0200/0x70d6b5fa1825e89e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.565715:0:25457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1200/0x70d6b5fa1825e890 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.565722:0:25457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1200/0x70d6b5fa1825e890 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.565729:0:25457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1200/0x70d6b5fa1825e890 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.565735:0:25457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a1200 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:2.0:1789498868.565740:0:25457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1200/0x70d6b5fa1825e890 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.565748:0:25457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1200/0x70d6b5fa1825e890 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.565761:0:25457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa07686795200) 00010000:00010000:2.0:1789498868.565764:0:25457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498868.565771:0:25457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1200/0x70d6b5fa1825e890 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.565777:0:25457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1200/0x70d6b5fa1825e890 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.565791:0:25457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e897 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.565808:0:25457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e897 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.565814:0:25457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e897 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.565819:0:25457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a0c00 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:2.0:1789498868.565822:0:25457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e897 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.565828:0:25457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e897 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.565837:0:25457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffffa07587434900) 00010000:00010000:2.0:1789498868.565839:0:25457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498868.565842:0:25457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e897 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.565848:0:25457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e897 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.565900:0:25457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825e889 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f35c expref: 8 pid: 25457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.565915:0:25457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0200/0x70d6b5fa1825e89e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f35c expref: 7 pid: 25457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.565922:0:25457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa07686795300) 00010000:00010000:2.0:1789498868.565924:0:25457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789498868.565933:0:25457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa075874a0200, rc 0) 00000100:00100000:2.0:1789498868.565997:0:25457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076981b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+7:18701:x1876424896177280:12345-192.168.204.17@tcp:101:lfs.0 Request processed in 734us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498868.566004:0:25457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 31 00000100:00100000:0.0:1789498868.572141:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498868.572228:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896177408 00000100:00100000:1.0:1789498868.572239:0:22670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896177408 00000100:00100000:1.0:1789498868.572308:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 6 00000100:00100000:1.0:1789498868.572320:0:22670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc42df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+5:18701:x1876424896177408:12345-192.168.204.17@tcp:900:lfs.0 00000100:00100000:1.0:1789498868.572406:0:22670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc42df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+5:18701:x1876424896177408:12345-192.168.204.17@tcp:900:lfs.0 Request processed in 89us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498868.572414:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 6 00000100:00080000:2.0:1789498868.572497:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789498868.575818:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498868.576385:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896177664 00000100:00100000:2.0:1789498868.576401:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896177664 00000100:00100000:2.0:1789498868.576502:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 32 00000100:00100000:2.0:1789498868.576518:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076981b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+7:18701:x1876424896177664:12345-192.168.204.17@tcp:101:lfs.0 00010000:00010000:2.0:1789498868.576608:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498868.576642:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0800/0x70d6b5fa1825e8a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f363 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498868.576817:0:22659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789498868.576974:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0800/0x70d6b5fa1825e8a5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f363 expref: 9 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.576990:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa07686795200) 00010000:00010000:2.0:1789498868.576994:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789498868.577001:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0800/0x70d6b5fa1825e8a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f363 expref: 9 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.577018:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa075874a0800, rc 0) 00000100:00100000:2.0:1789498868.577096:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076981b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+8:18701:x1876424896177664:12345-192.168.204.17@tcp:101:lfs.0 Request processed in 582us (1287us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1789498868.577106:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 32 00000100:00100000:3.0:1789498868.582433:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498868.582729:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896177920 00000100:00100000:1.0:1789498868.582752:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896177920 00000100:00100000:1.0:1789498868.582817:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 33 00000100:00100000:1.0:1789498868.582828:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076981b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+8:18701:x1876424896177920:12345-192.168.204.17@tcp:36:lfs.0 00010000:00010000:1.0:1789498868.582902:0:22660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498868.582930:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0200/0x70d6b5fa1825e89e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f35c expref: 8 pid: 25457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.582950:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa07686795300) 00010000:00010000:1.0:1789498868.582956:0:22660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789498868.582977:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e600/0x70d6b5fa1825e8b3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.582991:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e600/0x70d6b5fa1825e8b3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.583000:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e600/0x70d6b5fa1825e8b3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789498868.583227:0:22660:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b458157 reply state 0000000067ebc3b4 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e600/0x70d6b5fa1825e8b3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.583238:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e600/0x70d6b5fa1825e8b3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.583245:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa07686795300) 00010000:00010000:1.0:1789498868.583247:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1789498868.583250:0:22660:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789498868.583259:0:22660:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789498868.583343:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076981b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+9:18701:x1876424896177920:12345-192.168.204.17@tcp:36:lfs.0 Request processed in 516us (920us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1789498868.583351:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 33 00000100:00100000:0.0:1789498868.587068:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498868.587331:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896178176 00000100:00100000:3.0:1789498868.587343:0:22662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896178176 00000100:00100000:3.0:1789498868.587403:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 2 00000100:00100000:3.0:1789498868.587413:0:22662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc42c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+9:18701:x1876424896178176:12345-192.168.204.17@tcp:35:lfs.0 00000100:00100000:3.0:1789498868.587695:0:22662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc42c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+10:18701:x1876424896178176:12345-192.168.204.17@tcp:35:lfs.0 Request processed in 282us (637us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1789498868.587719:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 2 00000100:00100000:3.0:1789498868.595134:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498868.595343:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896178432 00000100:00100000:1.0:1789498868.595354:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896178432 00000100:00100000:1.0:1789498868.595421:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 34 00000100:00100000:1.0:1789498868.595432:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9de4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+10:18701:x1876424896178432:12345-192.168.204.17@tcp:101:lfs.0 00010000:00010000:1.0:1789498868.595460:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498868.595484:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f200/0x70d6b5fa1825e8ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f36a expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.595609:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825e8c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.598328:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825e8c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.598351:0:22658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825e8c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.598379:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e8c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.598388:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.598395:0:22658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498868.598550:0:22658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789498868.598660:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825e8c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.598669:0:22658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825e8c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.598701:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825e8c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.598707:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0758564f800 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:1.0:1789498868.598711:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825e8c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.598719:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825e8c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.598731:0:22658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa07686795200) 00010000:00010000:1.0:1789498868.598734:0:22658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498868.598739:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825e8c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.598744:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825e8c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.598757:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.598763:0:22658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e8c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.598768:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e8c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.598772:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0758564f000 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:1.0:1789498868.598774:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e8c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.598789:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e8c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.598797:0:22658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffffa07587434900) 00010000:00010000:1.0:1789498868.598799:0:22658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498868.598802:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e8c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.598808:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e8c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.598850:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f200/0x70d6b5fa1825e8ba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f36a expref: 12 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.598861:0:22658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa07686795200) 00010000:00010000:1.0:1789498868.598863:0:22658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789498868.598867:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f200/0x70d6b5fa1825e8ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f36a expref: 12 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.598876:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0758564f200, rc 0) 00000100:00100000:1.0:1789498868.598972:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9de4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+11:18701:x1876424896178432:12345-192.168.204.17@tcp:101:lfs.0 Request processed in 3541us (3860us total) trans 12884901894 rc 301/301 00000100:00100000:1.0:1789498868.598981:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 34 00000040:00080000:1.0:1789498868.604809:0:22692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789498868.607894:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498868.608055:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896178560 00000100:00100000:1.0:1789498868.608068:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896178560 00000100:00100000:1.0:1789498868.608132:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 35 00000100:00100000:1.0:1789498868.608144:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc42c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+11:18701:x1876424896178560:12345-192.168.204.17@tcp:101:lfs.0 00010000:00010000:1.0:1789498868.608401:0:22660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498868.608425:0:22660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f200/0x70d6b5fa1825e8d6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f371 expref: -99 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.609654:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e8dd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.609991:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e8dd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.610010:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e8dd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789498868.615083:0:22660:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789498868.615095:0:22660:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789498868.615130:0:22660:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e8dd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498868.615208:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f200/0x70d6b5fa1825e8d6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f371 expref: 13 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498868.615230:0:22660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e8dd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f371 expref: 12 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498868.615257:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa07686795300) 00010000:00010000:0.0:1789498868.615260:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789498868.615265:0:22660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0758564f000, rc 0) 00000100:00100000:0.0:1789498868.615389:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc42c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+12:18701:x1876424896178560:12345-192.168.204.17@tcp:101:lfs.0 Request processed in 7246us (7519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498868.615397:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 35 00000100:00100000:0.0:1789498868.626655:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498868.626841:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896178688 00000100:00100000:3.0:1789498868.626852:0:22662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896178688 00000100:00100000:3.0:1789498868.626921:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 3 00000100:00100000:3.0:1789498868.626932:0:22662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc42fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+12:18701:x1876424896178688:12345-192.168.204.17@tcp:37:lfs.0 00000100:00100000:0.0:1789498868.634721:0:22662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc42fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+12:18701:x1876424896178688:12345-192.168.204.17@tcp:37:lfs.0 Request processed in 7779us (8194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498868.634739:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 3 00000100:00100000:3.0:1789498868.638841:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498868.638959:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896178944 00000100:00100000:1.0:1789498868.638969:0:22661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896178944 00000100:00100000:1.0:1789498868.639037:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 4 00000100:00100000:1.0:1789498868.639051:0:22661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc574850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+12:18701:x1876424896178944:12345-192.168.204.17@tcp:35:lfs.0 00000100:00100000:1.0:1789498868.639340:0:22661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc574850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+13:18701:x1876424896178944:12345-192.168.204.17@tcp:35:lfs.0 Request processed in 293us (510us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1789498868.639347:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 4 00000040:00080000:1.0:1789498868.668249:0:23413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789498868.702684:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498868.702931:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896179072 00000100:00100000:1.0:1789498868.702943:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896179072 00000100:00100000:1.0:1789498868.703010:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 36 00000100:00100000:1.0:1789498868.703022:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076a9de7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f01496a-f99d-4000-a86c-f777ddf70925+11:18707:x1876424896179072:12345-192.168.204.17@tcp:101:bash.0 00010000:00010000:1.0:1789498868.703044:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498868.703066:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825e8e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f378 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.703168:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e200/0x70d6b5fa1825e8eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.703183:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e200/0x70d6b5fa1825e8eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.703194:0:22658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e200/0x70d6b5fa1825e8eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.703205:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f600/0x70d6b5fa1825e8f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.703212:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f600/0x70d6b5fa1825e8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.703219:0:22658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f600/0x70d6b5fa1825e8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.703309:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fe00/0x70d6b5fa1825e8f9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.703318:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fe00/0x70d6b5fa1825e8f9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.703326:0:22658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fe00/0x70d6b5fa1825e8f9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498868.703368:0:22658:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789498868.703372:0:22658:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789498868.703412:0:22658:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fe00/0x70d6b5fa1825e8f9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.703436:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e200/0x70d6b5fa1825e8eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.703442:0:22658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e200/0x70d6b5fa1825e8eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.703449:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e200/0x70d6b5fa1825e8eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.703455:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0758564e200 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:1.0:1789498868.703460:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e200/0x70d6b5fa1825e8eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.703467:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e200/0x70d6b5fa1825e8eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.703491:0:22658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa07686795200) 00010000:00010000:1.0:1789498868.703495:0:22658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498868.703500:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e200/0x70d6b5fa1825e8eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.703507:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e200/0x70d6b5fa1825e8eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.703520:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f600/0x70d6b5fa1825e8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.703526:0:22658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f600/0x70d6b5fa1825e8f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.703803:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f600/0x70d6b5fa1825e8f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.703817:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0758564f600 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:1.0:1789498868.703820:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f600/0x70d6b5fa1825e8f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.703827:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f600/0x70d6b5fa1825e8f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.703836:0:22658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffffa07587434900) 00010000:00010000:1.0:1789498868.703839:0:22658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789498868.703842:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f600/0x70d6b5fa1825e8f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.703847:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f600/0x70d6b5fa1825e8f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.703885:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825e8e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f378 expref: 13 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.703909:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564fe00/0x70d6b5fa1825e8f9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f378 expref: 12 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.703916:0:22658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa07686795300) 00010000:00010000:1.0:1789498868.703919:0:22658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789498868.703922:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0758564fe00, rc 0) 00000100:00100000:1.0:1789498868.703997:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076a9de7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f01496a-f99d-4000-a86c-f777ddf70925+12:18707:x1876424896179072:12345-192.168.204.17@tcp:101:bash.0 Request processed in 977us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498868.704005:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 36 00000100:00100000:2.0:1789498868.706503:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498868.706748:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896179200 00000100:00100000:1.0:1789498868.706781:0:22670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896179200 00000100:00100000:1.0:1789498868.706903:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 7 00000100:00100000:1.0:1789498868.706916:0:22670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7f01496a-f99d-4000-a86c-f777ddf70925+5:18707:x1876424896179200:12345-192.168.204.17@tcp:900:bash.0 00000100:00100000:1.0:1789498868.707018:0:22670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7f01496a-f99d-4000-a86c-f777ddf70925+5:18707:x1876424896179200:12345-192.168.204.17@tcp:900:bash.0 Request processed in 105us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498868.707036:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 7 00000100:00100000:3.0:1789498868.709642:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498868.709687:0:25457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896179456 00000100:00100000:2.0:1789498868.709713:0:25457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896179456 00000100:00100000:2.0:1789498868.709779:0:25457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 37 00000100:00100000:2.0:1789498868.709789:0:25457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f01496a-f99d-4000-a86c-f777ddf70925+12:18707:x1876424896179456:12345-192.168.204.17@tcp:101:bash.0 00010000:00010000:2.0:1789498868.709811:0:25457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498868.709833:0:25457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825e900 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f37f expref: -99 pid: 25457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.713243:0:25457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e907 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.713272:0:25457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e8dd lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f371 expref: 12 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.713282:0:25457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e907 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.713321:0:25457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e8dd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f371 expref: 12 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.713341:0:25457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e8dd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f371 expref: 12 pid: 22660 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498868.713357:0:25457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758819bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25457:1876424916212480:192.168.204.17@tcp:104: 00000100:00100000:2.0:1789498868.713469:0:25457:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076c1179900 going to sleep for 11 seconds 00000100:00100000:3.0:1789498868.718280:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:0.0:1789498868.718386:0:22643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896179584 00000100:00100000:0.0:1789498868.718399:0:22643:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896179584 00010000:00010000:0.0:1789498868.718447:0:22643:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e8dd lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f371 expref: 13 pid: 22660 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498868.718505:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 16 00000100:00100000:0.0:1789498868.718517:0:22643:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586724000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+13:2393:x1876424896179584:12345-192.168.204.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498868.718571:0:22643:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498868.718580:0:22643:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e8dd lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f371 expref: 13 pid: 22660 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498868.718598:0:22643:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e8dd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f371 expref: 13 pid: 22660 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498868.718635:0:22643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa07686795300) 00010000:00010000:0.0:1789498868.718655:0:22643:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e907 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498868.718666:0:22643:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e907 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498868.718682:0:22643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e907 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498868.718704:0:22643:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498868.718751:0:22643:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586724000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+13:2393:x1876424896179584:12345-192.168.204.17@tcp:103:ldlm_bl.0 Request processed in 236us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498868.718758:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 16 00010000:00010000:2.0:1789498868.719044:0:25457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e8dd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f371 expref: 12 pid: 22660 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498868.719060:0:25457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758819bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25457:1876424916212480:192.168.204.17@tcp:104: 00010000:00010000:2.0:1789498868.719088:0:25457:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e907 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.719097:0:25457:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e907 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.719103:0:25457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e907 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.719181:0:25457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1200/0x70d6b5fa1825e90e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.719191:0:25457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1200/0x70d6b5fa1825e90e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.719199:0:25457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1200/0x70d6b5fa1825e90e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.719853:0:25457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825e915 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.719867:0:25457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825e915 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.719887:0:25457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825e915 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498868.719900:0:25457:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789498868.719932:0:25457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e907 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.719940:0:25457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e907 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.719959:0:25457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e907 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.719965:0:25457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a0c00 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:2.0:1789498868.719970:0:25457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e907 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.719978:0:25457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e907 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.719987:0:25457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa07686795300) 00010000:00010000:2.0:1789498868.719990:0:25457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498868.719994:0:25457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e907 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.720000:0:25457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e907 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789498868.720012:0:25457:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a1db4dd1 reply state 00000000b111b6ce transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1200/0x70d6b5fa1825e90e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.720022:0:25457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1200/0x70d6b5fa1825e90e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.720028:0:25457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffffa07587434300) 00010000:00010000:2.0:1789498868.720031:0:25457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789498868.720034:0:25457:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789498868.720068:0:25457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825e900 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f37f expref: 15 pid: 25457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.720082:0:25457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825e915 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f37f expref: 14 pid: 25457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.720096:0:25457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa07587434000) 00010000:00010000:2.0:1789498868.720098:0:25457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789498868.720101:0:25457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa075874a1000, rc 0) 00000100:00100000:2.0:1789498868.720143:0:25457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f01496a-f99d-4000-a86c-f777ddf70925+15:18707:x1876424896179456:12345-192.168.204.17@tcp:101:bash.0 Request processed in 10355us (10523us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1789498868.720150:0:25457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 37 00000100:00100000:3.0:1789498868.731451:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498868.731575:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896179712 00000100:00100000:2.0:1789498868.731587:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896179712 00000100:00100000:2.0:1789498868.731651:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 38 00000100:00100000:2.0:1789498868.731662:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f01496a-f99d-4000-a86c-f777ddf70925+15:18707:x1876424896179712:12345-192.168.204.17@tcp:101:bash.0 00010000:00010000:2.0:1789498868.731687:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498868.731709:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825e923 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f386 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.731781:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e92a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.731796:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e92a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.731811:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e92a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498868.731863:0:22659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789498868.731868:0:22659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789498868.731902:0:22659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e92a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.731932:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e92a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.731958:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825e923 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f386 expref: 17 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.731976:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e92a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f386 expref: 16 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.731985:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa07587434000) 00010000:00010000:2.0:1789498868.731988:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789498868.731992:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa075874a0c00, rc 0) 00000100:00100000:2.0:1789498868.732055:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f01496a-f99d-4000-a86c-f777ddf70925+16:18707:x1876424896179712:12345-192.168.204.17@tcp:101:bash.0 Request processed in 394us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498868.732063:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 38 00000100:00100000:3.0:1789498868.739906:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498868.740060:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896179968 00000100:00100000:1.0:1789498868.740071:0:22661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896179968 00000100:00100000:1.0:1789498868.740150:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 5 00000100:00100000:1.0:1789498868.740162:0:22661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07587660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f01496a-f99d-4000-a86c-f777ddf70925+16:18707:x1876424896179968:12345-192.168.204.17@tcp:35:bash.0 00000100:00100000:1.0:1789498868.740523:0:22661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07587660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f01496a-f99d-4000-a86c-f777ddf70925+17:18707:x1876424896179968:12345-192.168.204.17@tcp:35:bash.0 Request processed in 363us (629us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1789498868.740578:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 5 00000100:00100000:3.0:1789498868.845710:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:0.0:1789498868.845994:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896180224 00000100:00100000:0.0:1789498868.846014:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896180224 00000100:00100000:0.0:1789498868.846077:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 39 00000100:00100000:0.0:1789498868.846086:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f01496a-f99d-4000-a86c-f777ddf70925+17:18717:x1876424896180224:12345-192.168.204.17@tcp:101:lfs.0 00010000:00010000:0.0:1789498868.846112:0:22660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789498868.846135:0:22660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0768bda9600/0x70d6b5fa1825e931 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f38d expref: -99 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789498868.846249:0:22660:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789498868.846381:0:22660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0768bda9600/0x70d6b5fa1825e931 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f38d expref: 19 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498868.846395:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa07686795200) 00010000:00010000:0.0:1789498868.846398:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789498868.846404:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0768bda9600/0x70d6b5fa1825e931 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f38d expref: 19 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498868.846440:0:22660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0768bda9600, rc 0) 00000100:00100000:0.0:1789498868.846924:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f01496a-f99d-4000-a86c-f777ddf70925+18:18717:x1876424896180224:12345-192.168.204.17@tcp:101:lfs.0 Request processed in 831us (1219us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1789498868.846933:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 39 00000100:00100000:2.0:1789498868.855074:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498868.855160:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896180480 00000100:00100000:1.0:1789498868.855171:0:22661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896180480 00000100:00100000:1.0:1789498868.855231:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 6 00000100:00100000:1.0:1789498868.855242:0:22661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f01496a-f99d-4000-a86c-f777ddf70925+18:18717:x1876424896180480:12345-192.168.204.17@tcp:35:lfs.0 00000100:00100000:1.0:1789498868.855477:0:22661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f01496a-f99d-4000-a86c-f777ddf70925+19:18717:x1876424896180480:12345-192.168.204.17@tcp:35:lfs.0 Request processed in 236us (411us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1789498868.855490:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 6 00000100:00100000:3.0:1789498868.918886:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498868.919179:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896180736 00000100:00100000:2.0:1789498868.919191:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896180736 00000100:00100000:2.0:1789498868.919287:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 40 00000100:00100000:2.0:1789498868.919301:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f01496a-f99d-4000-a86c-f777ddf70925+19:18720:x1876424896180736:12345-192.168.204.17@tcp:101:lfs.0 00010000:00010000:2.0:1789498868.919339:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498868.919364:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825e93f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f394 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.919564:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0800/0x70d6b5fa1825e946 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.919602:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0800/0x70d6b5fa1825e946 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.919614:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0800/0x70d6b5fa1825e946 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498868.919627:0:22659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789498868.919770:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825e93f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f394 expref: 22 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.919792:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0800/0x70d6b5fa1825e946 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f394 expref: 21 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498868.919801:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa07587434000) 00010000:00010000:2.0:1789498868.919805:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789498868.919809:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa075874a0800, rc 0) 00000100:00100000:2.0:1789498868.919895:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f01496a-f99d-4000-a86c-f777ddf70925+21:18720:x1876424896180736:12345-192.168.204.17@tcp:101:lfs.0 Request processed in 597us (1033us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1789498868.919903:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 40 00000100:00100000:0.0:1789498868.927068:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498868.927171:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896180864 00000100:00100000:1.0:1789498868.927183:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896180864 00000100:00100000:1.0:1789498868.927249:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 41 00000100:00100000:1.0:1789498868.927260:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc42ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f01496a-f99d-4000-a86c-f777ddf70925+21:18720:x1876424896180864:12345-192.168.204.17@tcp:54:lfs.0 00010000:00010000:1.0:1789498868.927351:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825e954 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.927384:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825e954 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.927410:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825e954 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.927455:0:22660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825e954 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.927463:0:22660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825e954 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.927470:0:22660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825e954 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.927801:0:22660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0758564f800 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:1.0:1789498868.927807:0:22660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825e954 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.927816:0:22660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825e954 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.927832:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa07587434000) 00010000:00010000:1.0:1789498868.927835:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789498868.927841:0:22660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825e954 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.927848:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825e954 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498868.927944:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc42ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f01496a-f99d-4000-a86c-f777ddf70925+21:18720:x1876424896180864:12345-192.168.204.17@tcp:54:lfs.0 Request processed in 684us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498868.927959:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 41 00000100:00100000:3.0:1789498868.931102:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498868.931199:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896181120 00000100:00100000:1.0:1789498868.931212:0:22661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896181120 00000100:00100000:1.0:1789498868.931267:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 7 00000100:00100000:1.0:1789498868.931277:0:22661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f01496a-f99d-4000-a86c-f777ddf70925+21:18720:x1876424896181120:12345-192.168.204.17@tcp:35:lfs.0 00000100:00100000:1.0:1789498868.931605:0:22661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f01496a-f99d-4000-a86c-f777ddf70925+22:18720:x1876424896181120:12345-192.168.204.17@tcp:35:lfs.0 Request processed in 328us (514us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1789498868.931613:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 7 00000100:00100000:0.0:1789498868.935178:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498868.939955:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896181248 00000100:00100000:1.0:1789498868.939972:0:22644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896181248 00000100:00100000:1.0:1789498868.940069:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 0 00000100:00100000:1.0:1789498868.940080:0:22644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc42c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f01496a-f99d-4000-a86c-f777ddf70925+22:2392:x1876424896181248:12345-192.168.204.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789498868.940099:0:22644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498868.940128:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0800/0x70d6b5fa1825e946 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f394 expref: 22 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498868.940149:0:22644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa07587434000) 00010000:00010000:1.0:1789498868.940155:0:22644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498868.940212:0:22644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc42c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f01496a-f99d-4000-a86c-f777ddf70925+21:2392:x1876424896181248:12345-192.168.204.17@tcp:103:ldlm_bl.0 Request processed in 134us (5046us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498868.940220:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 0 00000100:00100000:3.0:1789498869.176201:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498869.176256:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498869.176303:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498869.176334:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498869.176359:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498869.176426:0:22651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896181376 00000100:00100000:2.0:1789498869.176437:0:22651:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896181376 00000100:00100000:2.0:1789498869.176499:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 169 00000100:00100000:2.0:1789498869.176509:0:22651:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:116bdd0f-0dd7-4d85-9352-94b0af277561+13:2392:x1876424896181376:12345-192.168.204.17@tcp:400:kworker.0 00000100:00100000:2.0:1789498869.176667:0:22651:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:116bdd0f-0dd7-4d85-9352-94b0af277561+13:2392:x1876424896181376:12345-192.168.204.17@tcp:400:kworker.0 Request processed in 158us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498869.176676:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 169 00000100:00100000:1.0:1789498869.181733:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896181504 00000100:00100000:1.0:1789498869.181748:0:24169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896181504 00000100:00100000:1.0:1789498869.181835:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896181760 00000100:00100000:1.0:1789498869.181839:0:24169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896181760 00000100:00100000:1.0:1789498869.181858:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896181632 00000100:00100000:1.0:1789498869.181886:0:24169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896181632 00000100:00100000:1.0:1789498869.181906:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896181888 00000100:00100000:1.0:1789498869.181909:0:24169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896181888 00000100:00100000:1.0:1789498869.181931:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 19 00000100:00100000:1.0:1789498869.181941:0:24169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f01496a-f99d-4000-a86c-f777ddf70925+5:2392:x1876424896181504:12345-192.168.204.17@tcp:400:kworker.0 00000100:00100000:1.0:1789498869.182102:0:24169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f01496a-f99d-4000-a86c-f777ddf70925+5:2392:x1876424896181504:12345-192.168.204.17@tcp:400:kworker.0 Request processed in 162us (5911us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498869.182111:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 19 00000100:00100000:1.0:1789498869.182128:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 20 00000100:00100000:1.0:1789498869.182134:0:24169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0f3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+5:2392:x1876424896181760:12345-192.168.204.17@tcp:400:kworker.0 00000100:00100000:1.0:1789498869.182158:0:24169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0f3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+5:2392:x1876424896181760:12345-192.168.204.17@tcp:400:kworker.0 Request processed in 25us (5901us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498869.182163:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 20 00000100:00100000:1.0:1789498869.182173:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 21 00000100:00100000:1.0:1789498869.182179:0:24169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0f3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f01496a-f99d-4000-a86c-f777ddf70925+5:2392:x1876424896181632:12345-192.168.204.17@tcp:400:kworker.0 00000100:00100000:1.0:1789498869.182198:0:24169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0f3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f01496a-f99d-4000-a86c-f777ddf70925+5:2392:x1876424896181632:12345-192.168.204.17@tcp:400:kworker.0 Request processed in 20us (5864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498869.182204:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 21 00000100:00100000:1.0:1789498869.182212:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 22 00000100:00100000:1.0:1789498869.182217:0:24169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+5:2392:x1876424896181888:12345-192.168.204.17@tcp:400:kworker.0 00000100:00100000:1.0:1789498869.182250:0:24169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20fd504a-e0e6-4fa7-9b68-620798d3c4f1+5:2392:x1876424896181888:12345-192.168.204.17@tcp:400:kworker.0 Request processed in 20us (5878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498869.182256:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 22 00000100:00080000:3.0:1789498869.182426:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789498869.182432:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498869.238678:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498869.239358:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896182144 00000100:00100000:2.0:1789498869.239383:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896182144 00000100:00100000:2.0:1789498869.239451:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 42 00000100:00100000:2.0:1789498869.239461:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f01496a-f99d-4000-a86c-f777ddf70925+21:18751:x1876424896182144:12345-192.168.204.17@tcp:101:cat.0 00010000:00010000:2.0:1789498869.239486:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498869.239506:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0200/0x70d6b5fa1825e95b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f39b expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.239989:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e962 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.240004:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e962 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.240016:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e962 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498869.240029:0:22659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789498869.240170:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0200/0x70d6b5fa1825e95b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f39b expref: 24 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.240190:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e962 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f39b expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.240199:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa07587434000) 00010000:00010000:2.0:1789498869.240202:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789498869.240205:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa075874a1e00, rc 0) 00000100:00100000:2.0:1789498869.241103:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f01496a-f99d-4000-a86c-f777ddf70925+23:18751:x1876424896182144:12345-192.168.204.17@tcp:101:cat.0 Request processed in 1638us (2432us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1789498869.241115:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 42 00010000:00010000:0.0:1789498869.243938:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498869.245706:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:0.0:1789498869.245887:0:22643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896182272 00000100:00100000:0.0:1789498869.245899:0:22643:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896182272 00000100:00100000:0.0:1789498869.245975:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 1 00000100:00100000:0.0:1789498869.245985:0:22643:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f01496a-f99d-4000-a86c-f777ddf70925+23:2393:x1876424896182272:12345-192.168.204.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498869.246004:0:22643:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498869.246034:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e962 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f39b expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.246057:0:22643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa07587434000) 00010000:00010000:0.0:1789498869.246062:0:22643:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498869.246128:0:22643:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f01496a-f99d-4000-a86c-f777ddf70925+22:2393:x1876424896182272:12345-192.168.204.17@tcp:103:ldlm_bl.0 Request processed in 144us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498869.246136:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 1 00000100:00100000:3.0:1789498869.247025:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498869.247164:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896182528 00000100:00100000:1.0:1789498869.247184:0:22661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896182528 00000100:00100000:1.0:1789498869.247229:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 8 00000100:00100000:1.0:1789498869.247247:0:22661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f01496a-f99d-4000-a86c-f777ddf70925+22:18751:x1876424896182528:12345-192.168.204.17@tcp:35:cat.0 00000100:00100000:1.0:1789498869.248173:0:22661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f01496a-f99d-4000-a86c-f777ddf70925+23:18751:x1876424896182528:12345-192.168.204.17@tcp:35:cat.0 Request processed in 932us (1148us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1789498869.248184:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 8 00000100:00100000:3.0:1789498869.321908:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498869.322111:0:25457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896182784 00000100:00100000:2.0:1789498869.322122:0:25457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896182784 00000100:00100000:2.0:1789498869.322184:0:25457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 43 00000100:00100000:2.0:1789498869.322194:0:25457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f01496a-f99d-4000-a86c-f777ddf70925+23:18757:x1876424896182784:12345-192.168.204.17@tcp:101:dd.0 00010000:00010000:2.0:1789498869.322219:0:25457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498869.322242:0:25457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0200/0x70d6b5fa1825e970 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f3a2 expref: -99 pid: 25457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.322494:0:25457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e977 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.322510:0:25457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825e915 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f37f expref: 24 pid: 25457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.322519:0:25457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e92a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f386 expref: 24 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.322705:0:25457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e977 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.322739:0:25457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e92a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f386 expref: 24 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.322755:0:25457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e92a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f386 expref: 24 pid: 22659 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498869.322768:0:25457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588198a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25457:1876424916212608:192.168.204.17@tcp:104: 00010000:00010000:2.0:1789498869.322875:0:25457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825e915 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f37f expref: 24 pid: 25457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.322893:0:25457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825e915 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f37f expref: 24 pid: 25457 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498869.322904:0:25457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588199c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25457:1876424916212736:192.168.204.17@tcp:104: 00000100:00100000:2.0:1789498869.322931:0:25457:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076c1179000 going to sleep for 11 seconds 00000100:00100000:0.0:1789498869.333028:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:0.0:1789498869.333064:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498869.333207:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896182912 00000100:00100000:1.0:1789498869.333217:0:22644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896182912 00010000:00010000:1.0:1789498869.333280:0:22644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e92a lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f386 expref: 25 pid: 22659 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498869.333317:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896183040 00000100:00100000:1.0:1789498869.333321:0:22644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896183040 00010000:00010000:1.0:1789498869.333334:0:22644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825e915 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f37f expref: 26 pid: 25457 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498869.333358:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 17 00000100:00100000:1.0:1789498869.333368:0:22644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc42c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f01496a-f99d-4000-a86c-f777ddf70925+26:2393:x1876424896182912:12345-192.168.204.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789498869.333404:0:22644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498869.333413:0:22644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e92a lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f386 expref: 26 pid: 22659 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.333428:0:22644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e92a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f386 expref: 26 pid: 22659 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.333450:0:22644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa07587434000) 00010000:00010000:1.0:1789498869.333456:0:22644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e977 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.333470:0:22644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e977 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.333477:0:22644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498869.333563:0:22644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc42c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f01496a-f99d-4000-a86c-f777ddf70925+26:2393:x1876424896182912:12345-192.168.204.17@tcp:103:ldlm_bl.0 Request processed in 160us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498869.333572:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 17 00000100:00100000:1.0:1789498869.333590:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 18 00000100:00100000:1.0:1789498869.333597:0:22644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07586466050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f01496a-f99d-4000-a86c-f777ddf70925+25:2393:x1876424896183040:12345-192.168.204.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789498869.333604:0:22644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498869.333609:0:22644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825e915 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f37f expref: 25 pid: 25457 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.334065:0:22644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825e915 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f37f expref: 25 pid: 25457 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.334080:0:22644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa07587434000) 00010000:00010000:1.0:1789498869.334084:0:22644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e977 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.334092:0:22644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e977 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.334099:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e977 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.334119:0:22644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498869.334142:0:22644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07586466050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f01496a-f99d-4000-a86c-f777ddf70925+25:2393:x1876424896183040:12345-192.168.204.17@tcp:103:ldlm_bl.0 Request processed in 546us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498869.334155:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 18 00010000:00010000:2.0:1789498869.337078:0:25457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e92a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f386 expref: 24 pid: 22659 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498869.337104:0:25457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588198a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25457:1876424916212608:192.168.204.17@tcp:104: 00010000:00010000:2.0:1789498869.337119:0:25457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825e915 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f37f expref: 23 pid: 25457 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498869.337129:0:25457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588199c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25457:1876424916212736:192.168.204.17@tcp:104: 00010000:00010000:2.0:1789498869.337154:0:25457:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e977 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.337164:0:25457:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e977 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.337170:0:25457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e977 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498869.337192:0:25457:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789498869.337422:0:25457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0200/0x70d6b5fa1825e970 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3a2 expref: 24 pid: 25457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.337451:0:25457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1e00/0x70d6b5fa1825e977 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3a2 expref: 23 pid: 25457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.337461:0:25457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa07587434000) 00010000:00010000:2.0:1789498869.337464:0:25457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789498869.337468:0:25457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa075874a1e00, rc 0) 00000100:00100000:2.0:1789498869.339161:0:25457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f01496a-f99d-4000-a86c-f777ddf70925+23:18757:x1876424896182784:12345-192.168.204.17@tcp:101:dd.0 Request processed in 15430us (15727us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1789498869.339177:0:25457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 43 00000100:00100000:0.0:1789498869.339930:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498869.340784:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896183168 00000100:00100000:1.0:1789498869.340795:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896183168 00000100:00100000:1.0:1789498869.340851:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 44 00000100:00100000:1.0:1789498869.340861:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc42fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f01496a-f99d-4000-a86c-f777ddf70925+23:18757:x1876424896183168:12345-192.168.204.17@tcp:101:dd.0 00010000:00010000:1.0:1789498869.340893:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498869.340915:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825e985 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f3a9 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.340947:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f600/0x70d6b5fa1825e98c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.340961:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f600/0x70d6b5fa1825e98c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.340973:0:22658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f600/0x70d6b5fa1825e98c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.341116:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825e985 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3a9 expref: 25 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.341137:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f600/0x70d6b5fa1825e98c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3a9 expref: 24 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.341146:0:22658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa07587434000) 00010000:00010000:1.0:1789498869.341149:0:22658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789498869.341153:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0758564f600, rc 0) 00000100:00100000:1.0:1789498869.341278:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc42fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f01496a-f99d-4000-a86c-f777ddf70925+24:18757:x1876424896183168:12345-192.168.204.17@tcp:101:dd.0 Request processed in 418us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498869.341294:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 44 00000100:00100000:3.0:1789498869.350653:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498869.350740:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896183424 00000100:00100000:1.0:1789498869.350751:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896183424 00000100:00100000:1.0:1789498869.350811:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 45 00000100:00100000:1.0:1789498869.350821:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f01496a-f99d-4000-a86c-f777ddf70925+24:18757:x1876424896183424:12345-192.168.204.17@tcp:36:dd.0 00010000:00010000:1.0:1789498869.351089:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e200/0x70d6b5fa1825e993 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.351108:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e200/0x70d6b5fa1825e993 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.351121:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e200/0x70d6b5fa1825e993 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789498869.351174:0:22660:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:1.0:1789498869.351198:0:22660:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8f04d6f reply state 00000000dd5a8691 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e200/0x70d6b5fa1825e993 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.351212:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e200/0x70d6b5fa1825e993 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.351220:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa07587434000) 00010000:00010000:1.0:1789498869.351224:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789498869.351227:0:22660:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789498869.354484:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f01496a-f99d-4000-a86c-f777ddf70925+27:18757:x1876424896183424:12345-192.168.204.17@tcp:36:dd.0 Request processed in 3650us (3826us total) trans 12884901906 rc 0/0 00000100:00100000:1.0:1789498869.354496:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 45 00000020:00080000:1.0:1789498869.354505:0:22660:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789498869.359403:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498869.359520:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896183552 00000100:00100000:1.0:1789498869.359588:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896183552 00000100:00100000:1.0:1789498869.359645:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 46 00000100:00100000:1.0:1789498869.359655:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f01496a-f99d-4000-a86c-f777ddf70925+27:18757:x1876424896183552:12345-192.168.204.17@tcp:101:dd.0 00010000:00010000:1.0:1789498869.359680:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498869.359701:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564ee00/0x70d6b5fa1825e99a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f3b0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.359760:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564ee00/0x70d6b5fa1825e99a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3b0 expref: 28 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.359775:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564ee00/0x70d6b5fa1825e99a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3b0 expref: 28 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.359793:0:22658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa07587434000) 00010000:00010000:1.0:1789498869.359796:0:22658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789498869.359799:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0758564ee00, rc 0) 00000100:00100000:1.0:1789498869.359849:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f01496a-f99d-4000-a86c-f777ddf70925+28:18757:x1876424896183552:12345-192.168.204.17@tcp:101:dd.0 Request processed in 195us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498869.359856:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 46 00000100:00100000:0.0:1789498869.375720:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498869.375824:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896183808 00000100:00100000:1.0:1789498869.375836:0:22644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896183808 00000100:00100000:1.0:1789498869.375921:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 2 00000100:00100000:1.0:1789498869.375931:0:22644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc42e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f01496a-f99d-4000-a86c-f777ddf70925+28:18757:x1876424896183808:12345-192.168.204.17@tcp:103:dd.0 00010000:00010000:1.0:1789498869.375947:0:22644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498869.375970:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564ee00/0x70d6b5fa1825e99a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3b0 expref: 28 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.376004:0:22644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa07587434000) 00010000:00010000:1.0:1789498869.376009:0:22644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498869.376063:0:22644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc42e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f01496a-f99d-4000-a86c-f777ddf70925+27:18757:x1876424896183808:12345-192.168.204.17@tcp:103:dd.0 Request processed in 133us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498869.376069:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 2 00000100:00100000:0.0:1789498869.379417:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498869.379572:0:25457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896183936 00000100:00100000:2.0:1789498869.379583:0:25457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896183936 00000100:00100000:2.0:1789498869.379639:0:25457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 47 00000100:00100000:2.0:1789498869.379650:0:25457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc42ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f01496a-f99d-4000-a86c-f777ddf70925+27:18757:x1876424896183936:12345-192.168.204.17@tcp:58:dd.0 00010000:00010000:2.0:1789498869.379761:0:25457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0200/0x70d6b5fa1825e9a1 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.379779:0:25457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0200/0x70d6b5fa1825e9a1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.379790:0:25457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0200/0x70d6b5fa1825e9a1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789498869.381101:0:25457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789498869.381133:0:25457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1789498869.381974:0:25457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1789498869.382089:0:25457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc42ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f01496a-f99d-4000-a86c-f777ddf70925+27:18757:x1876424896183936:12345-192.168.204.17@tcp:58:dd.0 Request processed in 2436us (2678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498869.382109:0:25457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 47 00000100:00100000:3.0:1789498869.384428:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498869.384697:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896184064 00000100:00100000:1.0:1789498869.384708:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896184064 00000100:00100000:1.0:1789498869.384829:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 48 00000100:00100000:1.0:1789498869.384842:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f01496a-f99d-4000-a86c-f777ddf70925+27:18757:x1876424896184064:12345-192.168.204.17@tcp:101:dd.0 00010000:00010000:1.0:1789498869.384872:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498869.384892:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564ee00/0x70d6b5fa1825e9a8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f3b7 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.384950:0:22658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0200/0x70d6b5fa1825e9a1 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.384961:0:22658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564ee00/0x70d6b5fa1825e9a8 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3b7 expref: 28 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.384979:0:22658:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0200/0x70d6b5fa1825e9a1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.384991:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564ee00/0x70d6b5fa1825e9a8 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3b7 expref: 28 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.385003:0:22658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa07587434000) 00010000:00010000:1.0:1789498869.385014:0:22658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789498869.385018:0:22658:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564ee00/0x70d6b5fa1825e9a8 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3b7 expref: 28 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.385025:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0758564ee00, rc 0) 00000100:00100000:1.0:1789498869.385085:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f01496a-f99d-4000-a86c-f777ddf70925+28:18757:x1876424896184064:12345-192.168.204.17@tcp:101:dd.0 Request processed in 246us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498869.385092:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 48 00000040:00080000:1.0:1789498869.629387:0:22692:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789498869.629399:0:22692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498869.629430:0:22692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1789498869.629442:0:22692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1789498869.629608:0:22692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076846f6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22692:1876424916212864:192.168.204.17@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789498869.629798:0:22692:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076a9c28300 going to sleep for 11 seconds 00000100:00100000:1.0:1789498869.645078:0:22692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076846f6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22692:1876424916212864:192.168.204.17@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789498869.648573:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498869.649054:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896184192 00000100:00100000:1.0:1789498869.649065:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896184192 00000100:00100000:1.0:1789498869.649135:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 49 00000100:00100000:1.0:1789498869.649147:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc42f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f01496a-f99d-4000-a86c-f777ddf70925+28:18758:x1876424896184192:12345-192.168.204.17@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789498869.649196:0:22660:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789498869.649509:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc42f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f01496a-f99d-4000-a86c-f777ddf70925+28:18758:x1876424896184192:12345-192.168.204.17@tcp:53:lhsmtool_posix.0 Request processed in 364us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498869.649518:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 49 00000100:00100000:3.0:1789498869.654407:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498869.658305:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896184320 00000100:00100000:2.0:1789498869.658321:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896184320 00000100:00100000:2.0:1789498869.658406:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 50 00000100:00100000:2.0:1789498869.658418:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f01496a-f99d-4000-a86c-f777ddf70925+28:18758:x1876424896184320:12345-192.168.204.17@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789498869.658522:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825e9af lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.658598:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825e9af lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.658611:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825e9af lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.658676:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e9b6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.658684:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e9b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.658691:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e9b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.658714:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825e9bd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.658724:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825e9bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.658730:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825e9bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498869.658811:0:22659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789498869.658815:0:22659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789498869.658827:0:22659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825e9bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.658838:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825e9af lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.658843:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825e9af lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.658849:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825e9af lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.658854:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a1000 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:2.0:1789498869.658870:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825e9af lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.658877:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825e9af lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.658889:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa07587434600) 00010000:00010000:2.0:1789498869.658892:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498869.658897:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825e9af lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.658902:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825e9af lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.658918:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e9b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.658933:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e9b6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.658938:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e9b6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.658942:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a0c00 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:2.0:1789498869.658945:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e9b6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.658950:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e9b6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.658956:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffffa07587434100) 00010000:00010000:2.0:1789498869.658958:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498869.658973:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e9b6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.658979:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825e9b6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.658996:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825e9bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.659003:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825e9bd lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.659008:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825e9bd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.659013:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a0e00 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:2.0:1789498869.659032:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825e9bd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.659039:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825e9bd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.659047:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa07587434000) 00010000:00010000:2.0:1789498869.659050:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498869.659052:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825e9bd lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.659058:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825e9bd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498869.659134:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f01496a-f99d-4000-a86c-f777ddf70925+28:18758:x1876424896184320:12345-192.168.204.17@tcp:34:lhsmtool_posix.0 Request processed in 718us (4736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498869.659142:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 50 00000100:00100000:0.0:1789498869.663307:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498869.669402:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896184576 00000100:00100000:1.0:1789498869.669419:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896184576 00000100:00100000:1.0:1789498869.669610:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 51 00000100:00100000:1.0:1789498869.669622:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc42d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f01496a-f99d-4000-a86c-f777ddf70925+28:18758:x1876424896184576:12345-192.168.204.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789498869.669658:0:22660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498869.669680:0:22660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825e9c4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f3be expref: -99 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.669791:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e9cb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.669808:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e9cb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.669821:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e9cb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789498869.669833:0:22660:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789498869.669932:0:22660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e9cb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.669940:0:22660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e9cb lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.669947:0:22660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e9cb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.669953:0:22660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0758564f000 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:1.0:1789498869.669958:0:22660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e9cb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.669964:0:22660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e9cb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.669974:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa07587434000) 00010000:00010000:1.0:1789498869.669983:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789498869.669989:0:22660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e9cb lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.669996:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f000/0x70d6b5fa1825e9cb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.670568:0:22660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825e9c4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3be expref: 30 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.670581:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa07587434600) 00010000:00010000:1.0:1789498869.670583:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789498869.670587:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825e9c4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3be expref: 30 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.670600:0:22660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0758564f800, rc 0) 00000100:00100000:1.0:1789498869.670686:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc42d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f01496a-f99d-4000-a86c-f777ddf70925+29:18758:x1876424896184576:12345-192.168.204.17@tcp:101:lhsmtool_posix.0 Request processed in 1066us (7389us total) trans 12884901907 rc 301/301 00000100:00100000:1.0:1789498869.670694:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 51 00000100:00100000:0.0:1789498869.674374:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498869.674446:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896184704 00000100:00100000:2.0:1789498869.674456:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896184704 00000100:00100000:2.0:1789498869.674527:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 52 00000100:00100000:2.0:1789498869.674580:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc42ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f01496a-f99d-4000-a86c-f777ddf70925+29:18758:x1876424896184704:12345-192.168.204.17@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789498869.674614:0:22659:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789498869.674724:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc42ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f01496a-f99d-4000-a86c-f777ddf70925+29:18758:x1876424896184704:12345-192.168.204.17@tcp:53:lhsmtool_posix.0 Request processed in 147us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498869.674731:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 52 00000100:00100000:0.0:1789498869.685401:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498869.685662:0:25457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896184960 00000100:00100000:3.0:1789498869.685674:0:25457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896184960 00000100:00100000:3.0:1789498869.685742:0:25457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 53 00000100:00100000:3.0:1789498869.685754:0:25457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc42c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f01496a-f99d-4000-a86c-f777ddf70925+29:18758:x1876424896184960:12345-192.168.204.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789498869.685779:0:25457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498869.685805:0:25457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daba00/0x70d6b5fa1825e9d9 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f3c5 expref: -99 pid: 25457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789498869.686212:0:25457:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =59 00000004:00080000:3.0:1789498869.686219:0:25457:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+59 in llog 00000004:00080000:3.0:1789498869.686242:0:25457:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:3.0:1789498869.686396:0:25457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daa000/0x70d6b5fa1825e9e0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.686411:0:25457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daa000/0x70d6b5fa1825e9e0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.686422:0:25457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daa000/0x70d6b5fa1825e9e0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.686472:0:25457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daba00/0x70d6b5fa1825e9d9 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3c5 expref: 32 pid: 25457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.686490:0:25457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daa000/0x70d6b5fa1825e9e0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3c5 expref: 31 pid: 25457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.686517:0:25457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa07686795b00) 00010000:00010000:3.0:1789498869.686520:0:25457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789498869.686524:0:25457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa076c0daa000, rc 0) 00000100:00100000:3.0:1789498869.687237:0:25457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc42c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f01496a-f99d-4000-a86c-f777ddf70925+31:18758:x1876424896184960:12345-192.168.204.17@tcp:101:lhsmtool_posix.0 Request processed in 1481us (1842us total) trans 12884901908 rc 0/0 00000100:00100000:3.0:1789498869.687245:0:25457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 53 00000100:00100000:0.0:1789498869.706644:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498869.706704:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896185216 00000100:00100000:3.0:1789498869.706716:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896185216 00000100:00100000:3.0:1789498869.706777:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 54 00000100:00100000:3.0:1789498869.706789:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc42c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f01496a-f99d-4000-a86c-f777ddf70925+31:18758:x1876424896185216:12345-192.168.204.17@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789498869.706855:0:22658:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498869.706897:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daa000/0x70d6b5fa1825e9e0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3c5 expref: 31 pid: 25457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.706918:0:22658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa07686795b00) 00010000:00010000:3.0:1789498869.706930:0:22658:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789498869.706955:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daba00/0x70d6b5fa1825e9ee lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.706970:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daba00/0x70d6b5fa1825e9ee lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.706979:0:22658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daba00/0x70d6b5fa1825e9ee lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.707005:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daa800/0x70d6b5fa1825e9f5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x3b95320a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.707033:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daa800/0x70d6b5fa1825e9f5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3b95320a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.707041:0:22658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daa800/0x70d6b5fa1825e9f5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3b95320a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.707097:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daba00/0x70d6b5fa1825e9ee lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.707104:0:22658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daba00/0x70d6b5fa1825e9ee lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.707112:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daba00/0x70d6b5fa1825e9ee lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.707118:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c0daba00 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:3.0:1789498869.707123:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daba00/0x70d6b5fa1825e9ee lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.707131:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daba00/0x70d6b5fa1825e9ee lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.707140:0:22658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa07686795300) 00010000:00010000:3.0:1789498869.707143:0:22658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498869.707147:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daba00/0x70d6b5fa1825e9ee lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.707153:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daba00/0x70d6b5fa1825e9ee lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.707162:0:22658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daa800/0x70d6b5fa1825e9f5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3b95320a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.707176:0:22658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daa800/0x70d6b5fa1825e9f5 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3b95320a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.707182:0:22658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daa800/0x70d6b5fa1825e9f5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3b95320a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.707187:0:22658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c0daa800 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:3.0:1789498869.707190:0:22658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daa800/0x70d6b5fa1825e9f5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3b95320a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.707197:0:22658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daa800/0x70d6b5fa1825e9f5 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3b95320a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.707205:0:22658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x3b95320a (ffffa07686795f00) 00010000:00010000:3.0:1789498869.707208:0:22658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498869.707211:0:22658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daa800/0x70d6b5fa1825e9f5 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x3b95320a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.707216:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daa800/0x70d6b5fa1825e9f5 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x3b95320a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498869.707333:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc42c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f01496a-f99d-4000-a86c-f777ddf70925+30:18758:x1876424896185216:12345-192.168.204.17@tcp:36:lhsmtool_posix.0 Request processed in 546us (699us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789498869.707340:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 54 00000100:00100000:0.0:1789498869.709587:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498869.709666:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896185344 00000100:00100000:2.0:1789498869.709676:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896185344 00000100:00100000:2.0:1789498869.709734:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 55 00000100:00100000:2.0:1789498869.709745:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f01496a-f99d-4000-a86c-f777ddf70925+30:18758:x1876424896185344:12345-192.168.204.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789498869.709784:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498869.709806:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825e9fc lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f3cc expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.709839:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825ea03 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.709852:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825ea03 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.709874:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825ea03 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.710003:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825e9fc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3cc expref: 32 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.710020:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0c00/0x70d6b5fa1825ea03 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3cc expref: 31 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.710029:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa07587434100) 00010000:00010000:2.0:1789498869.710032:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789498869.710035:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa075874a0c00, rc 0) 00000100:00100000:2.0:1789498869.710098:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f01496a-f99d-4000-a86c-f777ddf70925+31:18758:x1876424896185344:12345-192.168.204.17@tcp:101:lhsmtool_posix.0 Request processed in 355us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498869.710105:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 55 00000100:00100000:0.0:1789498869.712221:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498869.712560:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896185600 00000100:00100000:1.0:1789498869.712571:0:22660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896185600 00000100:00100000:1.0:1789498869.712636:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 56 00000100:00100000:1.0:1789498869.712648:0:22660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f01496a-f99d-4000-a86c-f777ddf70925+31:18758:x1876424896185600:12345-192.168.204.17@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789498869.712777:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825ea0a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.712801:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825ea0a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.712816:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825ea0a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789498869.713086:0:22660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:1.0:1789498869.713096:0:22660:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 703988562932ns, next at 704988560913ns, rc = 0 00000004:00010000:1.0:1789498869.713154:0:22660:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042cf8ef0 reply state 00000000b84ac35f transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825ea0a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.713168:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825ea0a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.713174:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa07587434100) 00010000:00010000:1.0:1789498869.713177:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789498869.713181:0:22660:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789498869.713289:0:22660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f01496a-f99d-4000-a86c-f777ddf70925+33:18758:x1876424896185600:12345-192.168.204.17@tcp:36:lhsmtool_posix.0 Request processed in 642us (1077us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1789498869.713296:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 56 00000100:00100000:0.0:1789498869.720648:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498869.720749:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896185728 00000100:00100000:2.0:1789498869.720760:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896185728 00000100:00100000:2.0:1789498869.720828:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 57 00000100:00100000:2.0:1789498869.720840:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f01496a-f99d-4000-a86c-f777ddf70925+33:18758:x1876424896185728:12345-192.168.204.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789498869.720897:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498869.720917:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825ea11 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f3d3 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.720997:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825ea11 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3d3 expref: 34 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.721015:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825ea11 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3d3 expref: 34 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.721042:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa07587434100) 00010000:00010000:2.0:1789498869.721046:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789498869.721051:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa075874a0e00, rc 0) 00000100:00100000:2.0:1789498869.721124:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f01496a-f99d-4000-a86c-f777ddf70925+34:18758:x1876424896185728:12345-192.168.204.17@tcp:101:lhsmtool_posix.0 Request processed in 287us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498869.721132:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 57 00000100:00100000:0.0:1789498869.725569:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498869.727235:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896185856 00000100:00100000:1.0:1789498869.727251:0:24169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896185856 00000100:00100000:1.0:1789498869.727337:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 27 00000100:00100000:1.0:1789498869.727349:0:24169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758819f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f01496a-f99d-4000-a86c-f777ddf70925+5:2393:x1876424896185856:12345-192.168.204.17@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789498869.727693:0:24169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758819f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f01496a-f99d-4000-a86c-f777ddf70925+6:2393:x1876424896185856:12345-192.168.204.17@tcp:2:lhsmtool_posix.0 Request processed in 345us (2170us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1789498869.727700:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 27 00000100:00100000:0.0:1789498869.733823:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498869.734587:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896186112 00000100:00100000:3.0:1789498869.734597:0:22662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896186112 00000100:00100000:3.0:1789498869.734663:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 9 00000100:00100000:3.0:1789498869.734675:0:22662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758742b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f01496a-f99d-4000-a86c-f777ddf70925+34:18758:x1876424896186112:12345-192.168.204.17@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789498869.734969:0:22662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758742b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f01496a-f99d-4000-a86c-f777ddf70925+35:18758:x1876424896186112:12345-192.168.204.17@tcp:35:lhsmtool_posix.0 Request processed in 296us (1158us total) trans 12884901910 rc 0/0 00000100:00100000:3.0:1789498869.735002:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 9 00000100:00100000:0.0:1789498869.738641:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498869.738811:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896186368 00000100:00100000:3.0:1789498869.738822:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896186368 00000100:00100000:3.0:1789498869.738896:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 58 00000100:00100000:3.0:1789498869.738907:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07587429180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f01496a-f99d-4000-a86c-f777ddf70925+35:18758:x1876424896186368:12345-192.168.204.17@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789498869.739043:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07587429180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f01496a-f99d-4000-a86c-f777ddf70925+35:18758:x1876424896186368:12345-192.168.204.17@tcp:57:lhsmtool_posix.0 Request processed in 137us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498869.739051:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 58 00000100:00100000:0.0:1789498869.742377:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498869.742779:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896186496 00000100:00100000:2.0:1789498869.742790:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896186496 00000100:00100000:2.0:1789498869.742867:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 59 00000100:00100000:2.0:1789498869.742878:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07587429880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f01496a-f99d-4000-a86c-f777ddf70925+35:18758:x1876424896186496:12345-192.168.204.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789498869.742901:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498869.742923:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825ea18 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f3da expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.743004:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0800/0x70d6b5fa1825ea1f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.743032:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0800/0x70d6b5fa1825ea1f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.743046:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0800/0x70d6b5fa1825ea1f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789498869.743096:0:22659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789498869.743114:0:22659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0800/0x70d6b5fa1825ea1f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.743139:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825ea18 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3da expref: 37 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.743156:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0800/0x70d6b5fa1825ea1f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3da expref: 36 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.743163:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa07587434100) 00010000:00010000:2.0:1789498869.743166:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789498869.743169:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa075874a0800, rc 0) 00000100:00100000:2.0:1789498869.743381:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07587429880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f01496a-f99d-4000-a86c-f777ddf70925+36:18758:x1876424896186496:12345-192.168.204.17@tcp:101:lhsmtool_posix.0 Request processed in 504us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498869.743388:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 59 00000100:00100000:0.0:1789498869.747957:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498869.748049:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896186624 00000100:00100000:1.0:1789498869.748059:0:24168:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896186624 00000100:00100000:1.0:1789498869.748121:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 28 00000100:00100000:1.0:1789498869.748132:0:24168:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758742b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f01496a-f99d-4000-a86c-f777ddf70925+6:2392:x1876424896186624:12345-192.168.204.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789498869.748152:0:24168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789498869.748189:0:24168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000586c7ae4/0x70d6b5fa1825ea26 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f3e1 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789498869.748444:0:24168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa995f4, blocks: 0x0 00010000:00010000:1.0:1789498869.748473:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=704s v=(0 0) 00010000:00010000:1.0:1789498869.748480:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789498869.748492:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000586c7ae4/0x70d6b5fa1825ea26 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3e1 expref: 7 pid: 24168 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.748515:0:24168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000586c7ae4/0x70d6b5fa1825ea26 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3e1 expref: 7 pid: 24168 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.748721:0:24168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0758564f000, rc 0) 00000100:00100000:1.0:1789498869.748786:0:24168:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758742b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f01496a-f99d-4000-a86c-f777ddf70925+7:2392:x1876424896186624:12345-192.168.204.17@tcp:101:lhsmtool_posix.0 Request processed in 655us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498869.748794:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 28 00000100:00100000:0.0:1789498869.763868:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498869.764083:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896186880 00000100:00100000:3.0:1789498869.764094:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896186880 00000100:00100000:3.0:1789498869.764163:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 60 00000100:00100000:3.0:1789498869.764174:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758742ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f01496a-f99d-4000-a86c-f777ddf70925+36:18758:x1876424896186880:12345-192.168.204.17@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789498869.764316:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758742ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f01496a-f99d-4000-a86c-f777ddf70925+36:18758:x1876424896186880:12345-192.168.204.17@tcp:57:lhsmtool_posix.0 Request processed in 143us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498869.764325:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 60 00000100:00100000:0.0:1789498869.776171:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498869.776380:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896187008 00000100:00100000:2.0:1789498869.776391:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896187008 00000100:00100000:2.0:1789498869.776455:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 61 00000100:00100000:2.0:1789498869.776464:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07587429c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f01496a-f99d-4000-a86c-f777ddf70925+36:18758:x1876424896187008:12345-192.168.204.17@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789498869.778474:0:22638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:1.0:1789498869.778493:0:22638:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1789498869.778555:0:22638:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:3.0:1789498869.778666:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0a00/0x70d6b5fa1825e827 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778680:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0a00/0x70d6b5fa1825e827 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778688:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0a00/0x70d6b5fa1825e827 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778694:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a0a00 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:3.0:1789498869.778698:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0a00/0x70d6b5fa1825e827 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778715:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0a00/0x70d6b5fa1825e827 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778732:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffffa07587434900) 00010000:00010000:3.0:1789498869.778735:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498869.778740:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0a00/0x70d6b5fa1825e827 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778745:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0a00/0x70d6b5fa1825e827 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778766:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0dabc00/0x70d6b5fa1825e82e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778773:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0dabc00/0x70d6b5fa1825e82e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778779:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0dabc00/0x70d6b5fa1825e82e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778784:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa076c0dabc00 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:3.0:1789498869.778787:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0dabc00/0x70d6b5fa1825e82e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778792:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0dabc00/0x70d6b5fa1825e82e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778800:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa07686795300) 00010000:00010000:3.0:1789498869.778802:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498869.778804:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0dabc00/0x70d6b5fa1825e82e lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778817:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0dabc00/0x70d6b5fa1825e82e lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778834:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1200/0x70d6b5fa1825e90e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778840:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1200/0x70d6b5fa1825e90e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778846:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1200/0x70d6b5fa1825e90e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778851:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a1200 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:3.0:1789498869.778865:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1200/0x70d6b5fa1825e90e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778871:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1200/0x70d6b5fa1825e90e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778879:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffffa07587434300) 00010000:00010000:3.0:1789498869.778882:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498869.778884:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1200/0x70d6b5fa1825e90e lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778890:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1200/0x70d6b5fa1825e90e lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778904:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e200/0x70d6b5fa1825e993 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778910:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e200/0x70d6b5fa1825e993 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778924:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e200/0x70d6b5fa1825e993 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778929:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0758564e200 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:3.0:1789498869.778932:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e200/0x70d6b5fa1825e993 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778937:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e200/0x70d6b5fa1825e993 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778944:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa07587434000) 00010000:00010000:3.0:1789498869.778947:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789498869.778949:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e200/0x70d6b5fa1825e993 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778954:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e200/0x70d6b5fa1825e993 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778966:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825ea0a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778972:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825ea0a lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778977:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825ea0a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.778982:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0758564f800 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:3.0:1789498869.778984:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825ea0a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.779014:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825ea0a lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.779023:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa07587434100) 00010000:00010000:3.0:1789498869.779026:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789498869.779029:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825ea0a lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.779034:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f800/0x70d6b5fa1825ea0a lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498869.779907:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07587429c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f01496a-f99d-4000-a86c-f777ddf70925+15:18758:x1876424896187008:12345-192.168.204.17@tcp:44:lhsmtool_posix.0 Request processed in 3436us (3741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498869.779929:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 61 00000100:00100000:3.0:1789498869.780006:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789498869.780024:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876424916212992:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789498869.780081:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789498869.780303:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e600/0x70d6b5fa1825e8b3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.780314:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e600/0x70d6b5fa1825e8b3 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.780322:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e600/0x70d6b5fa1825e8b3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.780327:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0758564e600 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:0.0:1789498869.780331:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e600/0x70d6b5fa1825e8b3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.780339:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e600/0x70d6b5fa1825e8b3 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.780364:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa07686795300) 00010000:00010000:0.0:1789498869.780367:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1789498869.780371:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e600/0x70d6b5fa1825e8b3 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.780377:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564e600/0x70d6b5fa1825e8b3 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498869.782269:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916212992 00000100:00100000:2.0:1789498869.782289:0:24167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916212992 00000100:00100000:2.0:1789498869.782390:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789498869.782402:0:24167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876424916212992:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789498869.782615:0:24167:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789498869.782618:0:24167:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789498869.782621:0:24167:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789498869.782623:0:24167:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1789498868 -> 1789498868 00002000:00010000:2.0:1789498869.782626:0:24167:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789498869.782703:0:24167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1876424916212992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 302us (2620us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1789498869.782711:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1789498869.782771:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa07588199c00/2, rc 0, transno 12884901892 00000100:00100000:2.0:1789498869.782777:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588199c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876424916212992:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1789498869.783232:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789498869.792189:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498869.792312:0:24475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896187136 00000100:00100000:2.0:1789498869.792324:0:24475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896187136 00000100:00100000:2.0:1789498869.792391:0:24475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 30 00000100:00100000:2.0:1789498869.792403:0:24475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758742aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f01496a-f99d-4000-a86c-f777ddf70925+7:2393:x1876424896187136:12345-192.168.204.17@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789498869.792528:0:24475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758742aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f01496a-f99d-4000-a86c-f777ddf70925+7:2393:x1876424896187136:12345-192.168.204.17@tcp:16:lhsmtool_posix.0 Request processed in 127us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498869.792573:0:24475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 30 00000100:00100000:0.0:1789498869.796838:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498869.796932:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896187392 00000100:00100000:3.0:1789498869.796943:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896187392 00000100:00100000:3.0:1789498869.797003:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 62 00000100:00100000:3.0:1789498869.797014:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758742b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f01496a-f99d-4000-a86c-f777ddf70925+15:18758:x1876424896187392:12345-192.168.204.17@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789498869.797073:0:22658:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498869.797103:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0800/0x70d6b5fa1825ea1f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3da expref: 15 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.797122:0:22658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa07587434100) 00010000:00010000:3.0:1789498869.797127:0:22658:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789498869.797157:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0dabc00/0x70d6b5fa1825ea2d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.797189:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0dabc00/0x70d6b5fa1825ea2d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.797200:0:22658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0dabc00/0x70d6b5fa1825ea2d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789498869.797362:0:22658:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e46c4219 reply state 00000000188f530b transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0dabc00/0x70d6b5fa1825ea2d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.797374:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0dabc00/0x70d6b5fa1825ea2d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.797382:0:22658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa07587434100) 00010000:00010000:3.0:1789498869.797384:0:22658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789498869.797387:0:22658:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789498869.797496:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758742b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f01496a-f99d-4000-a86c-f777ddf70925+16:18758:x1876424896187392:12345-192.168.204.17@tcp:36:lhsmtool_posix.0 Request processed in 483us (668us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1789498869.797504:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 62 00000100:00100000:0.0:1789498869.805770:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498869.806659:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896187520 00000100:00100000:2.0:1789498869.806672:0:24167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896187520 00000100:00100000:2.0:1789498869.806735:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 31 00000100:00100000:2.0:1789498869.806747:0:24167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa0758742bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f01496a-f99d-4000-a86c-f777ddf70925+7:18758:x1876424896187520:12345-192.168.204.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789498869.806781:0:24167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789498869.806802:0:24167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c73e8ca/0x70d6b5fa1825ea34 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f3e8 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.806840:0:24167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000586c7ae4/0x70d6b5fa1825ea26 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3e1 expref: 8 pid: 24168 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.806850:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498869.806864:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498869.806870:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c73e8ca/0x70d6b5fa1825ea34 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3e8 expref: 8 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.806908:0:24167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000586c7ae4/0x70d6b5fa1825ea26 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3e1 expref: 8 pid: 24168 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.806924:0:24167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000586c7ae4/0x70d6b5fa1825ea26 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3e1 expref: 8 pid: 24168 timeout: 804 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498869.806939:0:24167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588198a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24167:1876424916213120:192.168.204.17@tcp:104: 00000100:00100000:2.0:1789498869.807034:0:24167:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076c11793c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498869.811293:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:3.0:1789498869.811374:0:23814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896187648 00000100:00100000:3.0:1789498869.811385:0:23814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896187648 00010000:00010000:3.0:1789498869.811427:0:23814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000586c7ae4/0x70d6b5fa1825ea26 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3e1 expref: 9 pid: 24168 timeout: 804 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498869.811471:0:23814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 19 00000100:00100000:3.0:1789498869.811482:0:23814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07587428700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f01496a-f99d-4000-a86c-f777ddf70925+9:2392:x1876424896187648:12345-192.168.204.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789498869.811497:0:23814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789498869.811520:0:23814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000586c7ae4/0x70d6b5fa1825ea26 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3e1 expref: 9 pid: 24168 timeout: 804 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.811592:0:23814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000586c7ae4/0x70d6b5fa1825ea26 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3e1 expref: 9 pid: 24168 timeout: 804 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.811618:0:23814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498869.811623:0:23814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789498869.811630:0:23814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c73e8ca/0x70d6b5fa1825ea34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3e8 expref: 9 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.811641:0:23814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c73e8ca/0x70d6b5fa1825ea34 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3e8 expref: 9 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.811682:0:23814:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005c73e8ca/0x70d6b5fa1825ea34 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3e8 expref: 9 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498869.811698:0:23814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc573800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:23814:1876424916213248:192.168.204.17@tcp:105: 00000100:00100000:3.0:1789498869.811780:0:23814:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076bc75c780 going to sleep for 11 seconds 00010000:00010000:2.0:1789498869.813086:0:24167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000586c7ae4/0x70d6b5fa1825ea26 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3e1 expref: 9 pid: 24168 timeout: 804 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498869.813108:0:24167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588198a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24167:1876424916213120:192.168.204.17@tcp:104: 00010000:00010000:2.0:1789498869.813138:0:24167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005c73e8ca/0x70d6b5fa1825ea34 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3e8 expref: 8 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.813171:0:24167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa075874a1000, rc 0) 00000100:00100000:2.0:1789498869.813252:0:24167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa0758742bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f01496a-f99d-4000-a86c-f777ddf70925+8:18758:x1876424896187520:12345-192.168.204.17@tcp:101:lhsmtool_posix.0 Request processed in 6506us (7494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498869.813270:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 31 00000100:00100000:3.0:1789498869.813938:0:23814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc573800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:23814:1876424916213248:192.168.204.17@tcp:105: 00010000:00010000:3.0:1789498869.813953:0:23814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789498869.813996:0:23814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07587428700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f01496a-f99d-4000-a86c-f777ddf70925+7:2392:x1876424896187648:12345-192.168.204.17@tcp:103:ldlm_bl.0 Request processed in 2517us (2716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498869.814005:0:23814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 19 00000100:00100000:0.0:1789498869.820946:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498869.821031:0:24475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896187776 00000100:00100000:2.0:1789498869.821042:0:24475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896187776 00000100:00100000:2.0:1789498869.821105:0:24475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 32 00000100:00100000:2.0:1789498869.821117:0:24475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07587428a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f01496a-f99d-4000-a86c-f777ddf70925+7:2392:x1876424896187776:12345-192.168.204.17@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789498869.821302:0:24475:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789498869.821306:0:24475:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1789498868 00002000:00010000:2.0:1789498869.821309:0:24475:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1789498867 00002000:00010000:2.0:1789498869.821311:0:24475:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1789498868 -> 1789498868 00002000:00010000:2.0:1789498869.821314:0:24475:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789498869.821380:0:24475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07587428a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f01496a-f99d-4000-a86c-f777ddf70925+8:2392:x1876424896187776:12345-192.168.204.17@tcp:2:lhsmtool_posix.0 Request processed in 264us (443us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1789498869.821388:0:24475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 32 00000100:00100000:1.0:1789498869.826846:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:0.0:1789498869.828212:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896187904 00000100:00100000:0.0:1789498869.828236:0:24169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896187904 00000100:00100000:0.0:1789498869.828302:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 33 00000100:00100000:0.0:1789498869.828313:0:24169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076846f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f01496a-f99d-4000-a86c-f777ddf70925+8:2395:x1876424896187904:12345-192.168.204.17@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789498869.828360:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f53c278a/0x70d6b5fa1825ea3b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.828382:0:24169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c73e8ca/0x70d6b5fa1825ea34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3e8 expref: 8 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.828391:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498869.828396:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789498869.828401:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f53c278a/0x70d6b5fa1825ea3b lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.828455:0:24169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c73e8ca/0x70d6b5fa1825ea34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3e8 expref: 8 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.828471:0:24169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c73e8ca/0x70d6b5fa1825ea34 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3e8 expref: 8 pid: 24167 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498869.828486:0:24169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758742a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24169:1876424916213376:192.168.204.17@tcp:104: 00000100:00100000:0.0:1789498869.828612:0:24169:0:(client.c:2716:ptlrpc_set_wait()) set ffffa0758753d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498869.835513:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498869.838827:0:24169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758742a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24169:1876424916213376:192.168.204.17@tcp:104: 00010000:00010000:1.0:1789498869.838877:0:24169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f53c278a/0x70d6b5fa1825ea3b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498869.842666:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896188032 00000100:00100000:2.0:1789498869.842683:0:22644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896188032 00010000:00010000:2.0:1789498869.842740:0:22644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c73e8ca/0x70d6b5fa1825ea34 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3e8 expref: 9 pid: 24167 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498869.842797:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 20 00000100:00100000:2.0:1789498869.842810:0:22644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07587428e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f01496a-f99d-4000-a86c-f777ddf70925+9:2393:x1876424896188032:12345-192.168.204.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789498869.842827:0:22644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789498869.842880:0:22644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c73e8ca/0x70d6b5fa1825ea34 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3e8 expref: 9 pid: 24167 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.842896:0:22644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c73e8ca/0x70d6b5fa1825ea34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3e8 expref: 9 pid: 24167 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.842922:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c73e8ca/0x70d6b5fa1825ea34 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3e8 expref: 9 pid: 24167 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.842942:0:22644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789498869.842946:0:22644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789498869.842951:0:22644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f53c278a/0x70d6b5fa1825ea3b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.842961:0:22644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f53c278a/0x70d6b5fa1825ea3b lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.842988:0:22644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789498869.843082:0:22644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07587428e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f01496a-f99d-4000-a86c-f777ddf70925+8:2393:x1876424896188032:12345-192.168.204.17@tcp:103:ldlm_bl.0 Request processed in 274us (7586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498869.843091:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 20 00010000:00010000:0.0:1789498869.843769:0:24169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f53c278a/0x70d6b5fa1825ea3b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.843784:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f53c278a/0x70d6b5fa1825ea3b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.843815:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f53c278a/0x70d6b5fa1825ea3b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.843824:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f53c278a/0x70d6b5fa1825ea3b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.843833:0:24169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f53c278a/0x70d6b5fa1825ea3b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.843871:0:24169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0768bda8400 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:0.0:1789498869.843875:0:24169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f53c278a/0x70d6b5fa1825ea3b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.843885:0:24169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f53c278a/0x70d6b5fa1825ea3b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.843903:0:24169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f53c278a/0x70d6b5fa1825ea3b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.843911:0:24169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f53c278a/0x70d6b5fa1825ea3b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498869.843979:0:24169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076846f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f01496a-f99d-4000-a86c-f777ddf70925+7:2395:x1876424896187904:12345-192.168.204.17@tcp:1:lhsmtool_posix.0 Request processed in 15667us (17144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498869.843987:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 33 00000100:00100000:3.0:1789498869.852868:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498869.854037:0:25457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896188288 00000100:00100000:2.0:1789498869.854055:0:25457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896188288 00000100:00100000:2.0:1789498869.854160:0:25457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 63 00000100:00100000:2.0:1789498869.854175:0:25457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f01496a-f99d-4000-a86c-f777ddf70925+16:18758:x1876424896188288:12345-192.168.204.17@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789498869.854326:0:25457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0800/0x70d6b5fa1825ea42 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.854379:0:25457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f600/0x70d6b5fa1825e98c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3a9 expref: 16 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.854390:0:25457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0800/0x70d6b5fa1825ea42 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.854442:0:25457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f600/0x70d6b5fa1825e98c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3a9 expref: 16 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.854466:0:25457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f600/0x70d6b5fa1825e98c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3a9 expref: 16 pid: 22658 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498869.854484:0:25457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588198a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25457:1876424916213504:192.168.204.17@tcp:104: 00000100:00100000:2.0:1789498869.854631:0:25457:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076c11793c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789498869.862652:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:0.0:1789498869.862744:0:22643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896188416 00000100:00100000:0.0:1789498869.862755:0:22643:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896188416 00010000:00010000:0.0:1789498869.862804:0:22643:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f600/0x70d6b5fa1825e98c lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3a9 expref: 17 pid: 22658 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498869.862864:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 21 00000100:00100000:0.0:1789498869.862877:0:22643:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc572680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f01496a-f99d-4000-a86c-f777ddf70925+17:2392:x1876424896188416:12345-192.168.204.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789498869.862895:0:22643:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789498869.862920:0:22643:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f600/0x70d6b5fa1825e98c lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3a9 expref: 17 pid: 22658 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.862937:0:22643:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f600/0x70d6b5fa1825e98c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3a9 expref: 17 pid: 22658 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.862963:0:22643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa07587434000) 00010000:00010000:0.0:1789498869.862971:0:22643:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564ee00/0x70d6b5fa1825e9a8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3b7 expref: 17 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.862981:0:22643:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0800/0x70d6b5fa1825ea42 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.862989:0:22643:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0800/0x70d6b5fa1825ea42 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.862997:0:22643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0800/0x70d6b5fa1825ea42 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.863017:0:22643:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789498869.863092:0:22643:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc572680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f01496a-f99d-4000-a86c-f777ddf70925+17:2392:x1876424896188416:12345-192.168.204.17@tcp:103:ldlm_bl.0 Request processed in 219us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498869.863108:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 21 00010000:00010000:2.0:1789498869.863472:0:25457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564f600/0x70d6b5fa1825e98c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3a9 expref: 16 pid: 22658 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498869.863490:0:25457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588198a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25457:1876424916213504:192.168.204.17@tcp:104: 00010000:00010000:2.0:1789498869.863512:0:25457:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0800/0x70d6b5fa1825ea42 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.863522:0:25457:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0800/0x70d6b5fa1825ea42 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.863526:0:25457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0800/0x70d6b5fa1825ea42 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.863800:0:25457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825ea49 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.863821:0:25457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825ea11 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3d3 expref: 16 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.863829:0:25457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825ea49 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.863872:0:25457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825ea11 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3d3 expref: 16 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.863887:0:25457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825ea11 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3d3 expref: 16 pid: 22659 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498869.863901:0:25457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588198a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25457:1876424916213632:192.168.204.17@tcp:104: 00000100:00100000:2.0:1789498869.863973:0:25457:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076c1179000 going to sleep for 11 seconds 00000100:00100000:3.0:1789498869.871026:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498869.871157:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896188544 00000100:00100000:1.0:1789498869.871169:0:22644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896188544 00010000:00010000:1.0:1789498869.871220:0:22644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825ea11 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3d3 expref: 17 pid: 22659 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789498869.871289:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 22 00000100:00100000:1.0:1789498869.871301:0:22644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc572300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f01496a-f99d-4000-a86c-f777ddf70925+17:2393:x1876424896188544:12345-192.168.204.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789498869.871324:0:22644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789498869.871333:0:22644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825ea11 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3d3 expref: 17 pid: 22659 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.871349:0:22644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825ea11 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3d3 expref: 17 pid: 22659 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.871375:0:22644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa07587434100) 00010000:00010000:1.0:1789498869.871380:0:22644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825ea49 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.871391:0:22644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825ea49 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.871399:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825ea49 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.871421:0:22644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789498869.871490:0:22644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc572300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f01496a-f99d-4000-a86c-f777ddf70925+17:2393:x1876424896188544:12345-192.168.204.17@tcp:103:ldlm_bl.0 Request processed in 190us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498869.871498:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 22 00010000:00010000:2.0:1789498869.872047:0:25457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825ea11 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3d3 expref: 16 pid: 22659 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498869.872068:0:25457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588198a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25457:1876424916213632:192.168.204.17@tcp:104: 00010000:00010000:2.0:1789498869.872097:0:25457:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825ea49 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.872107:0:25457:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825ea49 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.872113:0:25457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825ea49 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789498869.872253:0:25457:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:2.0:1789498869.872409:0:25457:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:2.0:1789498869.872452:0:25457:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:2.0:1789498869.872722:0:25457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07588198a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:25457:1876424916213760:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789498869.872784:0:25457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789498869.872824:0:25457:0:(client.c:2716:ptlrpc_set_wait()) set ffffa0758567b180 going to sleep for 11 seconds 00000100:00100000:1.0:1789498869.873231:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916213760 00000100:00100000:1.0:1789498869.873238:0:22664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916213760 00000100:00100000:1.0:1789498869.873295:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789498869.873307:0:22664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:25457:x1876424916213760:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789498869.873423:0:22664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:25457:x1876424916213760:12345-0@lo:1000:mdt00_003.0 Request processed in 118us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498869.873431:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789498869.873621:0:25457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07588198a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:25457:1876424916213760:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1789498869.873812:0:25457:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:3.0:1789498869.873882:0:25457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc570380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:25457:1876424916213888:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789498869.873914:0:25457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498869.873945:0:25457:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076bc75c000 going to sleep for 11 seconds 00000100:00100000:0.0:1789498869.874128:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916213888 00000100:00100000:0.0:1789498869.874134:0:22663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916213888 00000100:00100000:0.0:1789498869.874172:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789498869.874180:0:22663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:25457:x1876424916213888:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789498869.874316:0:22663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:25457:x1876424916213888:12345-0@lo:1000:mdt00_003.0 Request processed in 137us (401us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1789498869.874333:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789498869.874964:0:25457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc570380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:25457:1876424916213888:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1789498869.875025:0:25457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825ea49 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.875036:0:25457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825ea49 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.875044:0:25457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825ea49 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.875050:0:25457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a1000 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:3.0:1789498869.875054:0:25457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825ea49 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.875061:0:25457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825ea49 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.875075:0:25457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa07587434100) 00010000:00010000:3.0:1789498869.875078:0:25457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789498869.875082:0:25457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825ea49 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.875088:0:25457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a1000/0x70d6b5fa1825ea49 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.875118:0:25457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0200/0x70d6b5fa1825e9a1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.875132:0:25457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0200/0x70d6b5fa1825e9a1 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.875138:0:25457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0200/0x70d6b5fa1825e9a1 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.875143:0:25457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a0200 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:3.0:1789498869.875146:0:25457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0200/0x70d6b5fa1825e9a1 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.875152:0:25457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0200/0x70d6b5fa1825e9a1 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.875161:0:25457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa07587434000) 00010000:00010000:3.0:1789498869.875163:0:25457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789498869.875170:0:25457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564ee00/0x70d6b5fa1825e9a8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3b7 expref: 19 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.875182:0:25457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564ee00/0x70d6b5fa1825e9a8 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3b7 expref: 19 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.875191:0:25457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564ee00/0x70d6b5fa1825e9a8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3b7 expref: 19 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.875252:0:25457:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0758564ee00/0x70d6b5fa1825e9a8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3b7 expref: 19 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789498869.875388:0:25457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc571500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25457:1876424916214016:192.168.204.17@tcp:105: 00000100:00100000:3.0:1789498869.876167:0:25457:0:(client.c:2716:ptlrpc_set_wait()) set ffffa076bc75ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789498869.881075:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498869.881188:0:25457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc571500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25457:1876424916214016:192.168.204.17@tcp:105: 00010000:00010000:2.0:1789498869.881214:0:25457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0200/0x70d6b5fa1825e9a1 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.881224:0:25457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0200/0x70d6b5fa1825e9a1 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.881269:0:25457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825ea50 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.881284:0:25457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825ea50 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.881296:0:25457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825ea50 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.881308:0:25457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825ea50 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.881316:0:25457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825ea50 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.881323:0:25457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825ea50 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.881330:0:25457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a0e00 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:2.0:1789498869.881335:0:25457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825ea50 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.881359:0:25457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825ea50 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.881374:0:25457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa07587434000) 00010000:00010000:2.0:1789498869.881377:0:25457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789498869.881381:0:25457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825ea50 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.881386:0:25457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0e00/0x70d6b5fa1825ea50 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.881398:0:25457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0800/0x70d6b5fa1825ea42 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.881403:0:25457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0800/0x70d6b5fa1825ea42 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.881409:0:25457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0800/0x70d6b5fa1825ea42 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.881413:0:25457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a0800 already unused, calling callback (ffffffffc19ec4f0) 00010000:00010000:2.0:1789498869.881416:0:25457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0800/0x70d6b5fa1825ea42 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.881422:0:25457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0800/0x70d6b5fa1825ea42 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.881429:0:25457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa07587434000) 00010000:00010000:2.0:1789498869.881430:0:25457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789498869.881433:0:25457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0800/0x70d6b5fa1825ea42 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.881448:0:25457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa075874a0800/0x70d6b5fa1825ea42 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25457 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789498869.882034:0:25457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f01496a-f99d-4000-a86c-f777ddf70925+19:18758:x1876424896188288:12345-192.168.204.17@tcp:57:lhsmtool_posix.0 Request processed in 27860us (29189us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1789498869.882046:0:25457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 63 00000020:00080000:2.0:1789498869.882052:0:25457:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789498869.882223:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896188672 00000100:00100000:3.0:1789498869.882233:0:22662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896188672 00000100:00100000:3.0:1789498869.882299:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 10 00000100:00100000:3.0:1789498869.882312:0:22662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc575450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f01496a-f99d-4000-a86c-f777ddf70925+19:18757:x1876424896188672:12345-192.168.204.17@tcp:49:dd.0 00000100:00100000:3.0:1789498869.882429:0:22662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc575450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f01496a-f99d-4000-a86c-f777ddf70925+19:18757:x1876424896188672:12345-192.168.204.17@tcp:49:dd.0 Request processed in 121us (1365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498869.882436:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 10 00000040:00080000:1.0:1789498869.883495:0:22692:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789498869.883503:0:22692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789498869.883669:0:22692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1789498869.883680:0:22692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1789498869.889042:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498869.889126:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:0.0:1789498869.889196:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896189056 00000100:00100000:0.0:1789498869.889206:0:22662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896189056 00000100:00100000:0.0:1789498869.889270:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 11 00000100:00100000:0.0:1789498869.889281:0:22662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076846f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f01496a-f99d-4000-a86c-f777ddf70925+19:18758:x1876424896189056:12345-192.168.204.17@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789498869.889615:0:22662:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789498869.889651:0:22662:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:0.0:1789498869.889686:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0768bda8200/0x70d6b5fa1825ea57 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.889703:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0768bda8200/0x70d6b5fa1825ea57 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.889715:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0768bda8200/0x70d6b5fa1825ea57 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.889724:0:22662:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0768bda8200/0x70d6b5fa1825ea57 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.889730:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0768bda8200/0x70d6b5fa1825ea57 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.889736:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0768bda8200/0x70d6b5fa1825ea57 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.889763:0:22662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789498869.889862:0:22662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076846f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f01496a-f99d-4000-a86c-f777ddf70925+21:18758:x1876424896189056:12345-192.168.204.17@tcp:35:lhsmtool_posix.0 Request processed in 572us (725us total) trans 12884901918 rc 0/0 00000100:00100000:0.0:1789498869.889888:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 11 00000020:00080000:0.0:1789498869.889894:0:22662:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789498869.890430:0:22646:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789498869.890439:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0768bda8200/0x70d6b5fa1825ea57 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.890449:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0768bda8200 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:1.0:1789498869.890453:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0768bda8200/0x70d6b5fa1825ea57 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.890463:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0768bda8200/0x70d6b5fa1825ea57 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.890478:0:22646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa07587434100) 00010000:00010000:1.0:1789498869.890482:0:22646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789498869.890487:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0768bda8200/0x70d6b5fa1825ea57 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.890493:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0768bda8200/0x70d6b5fa1825ea57 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789498869.890506:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498869.890508:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789498869.890518:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789498869.892190:0:22658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896188800 00000100:00100000:3.0:1789498869.892203:0:22658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896188800 00000100:00100000:3.0:1789498869.892301:0:22658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 64 00000100:00100000:3.0:1789498869.892311:0:22658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076846f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f01496a-f99d-4000-a86c-f777ddf70925+21:18757:x1876424896188800:12345-192.168.204.17@tcp:101:dd.0 00010000:00010000:3.0:1789498869.892328:0:22658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789498869.892344:0:22658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daa800/0x70d6b5fa1825ea5e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ad89bca53a0f3ef expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.892372:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daba00/0x70d6b5fa1825ea65 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.892384:0:22658:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daba00/0x70d6b5fa1825ea65 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.892395:0:22658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daba00/0x70d6b5fa1825ea65 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22658 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.892504:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daa800/0x70d6b5fa1825ea5e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3ef expref: 23 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.892574:0:22658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa076c0daba00/0x70d6b5fa1825ea65 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.17@tcp remote: 0x5ad89bca53a0f3ef expref: 22 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789498869.892583:0:22658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa07587434000) 00010000:00010000:3.0:1789498869.892586:0:22658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789498869.892589:0:22658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa076c0daba00, rc 0) 00000100:00100000:3.0:1789498869.892650:0:22658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076846f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f01496a-f99d-4000-a86c-f777ddf70925+22:18757:x1876424896188800:12345-192.168.204.17@tcp:101:dd.0 Request processed in 342us (3619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498869.892657:0:22658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 64 00000100:00100000:1.0:1789498869.917463:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:1.0:1789498869.917508:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.17@tcp (source: 12345-192.168.204.17@tcp) 00000100:00100000:2.0:1789498869.917636:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896189312 00000100:00100000:2.0:1789498869.917647:0:24173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896189312 00000100:00100000:2.0:1789498869.917709:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424896189184 00000100:00100000:2.0:1789498869.917712:0:24173:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424896189184 00000100:00100000:2.0:1789498869.917731:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 0 00000100:00100000:2.0:1789498869.917739:0:24173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076846f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7f01496a-f99d-4000-a86c-f777ddf70925+8:2395:x1876424896189312:12345-192.168.204.17@tcp:4:dd.0 00002000:00010000:2.0:1789498869.917786:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6aa995f4, atime: 0x6aa995f3, ctime: 0x6aa995f4, blocks: 0x0 00010000:00010000:2.0:1789498869.917795:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057fa4067/0x70d6b5fa1825ea6c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.917812:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=704s v=(0 0) 00010000:00010000:2.0:1789498869.917817:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789498869.917824:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057fa4067/0x70d6b5fa1825ea6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789498869.917840:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057fa4067/0x70d6b5fa1825ea6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789498869.993239:0:24163:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:3.0:1789498869.993264:0:24163:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:0.0:1789498869.993756:0:24173:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:0.0:1789498869.993762:0:24173:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:0.0:1789498869.993782:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057fa4067/0x70d6b5fa1825ea6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.993795:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057fa4067/0x70d6b5fa1825ea6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.993803:0:24173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057fa4067/0x70d6b5fa1825ea6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.993809:0:24173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075874a0e00 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:0.0:1789498869.993814:0:24173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057fa4067/0x70d6b5fa1825ea6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.993823:0:24173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057fa4067/0x70d6b5fa1825ea6c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.993845:0:24173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057fa4067/0x70d6b5fa1825ea6c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.993864:0:24173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057fa4067/0x70d6b5fa1825ea6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498869.993996:0:24173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076846f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7f01496a-f99d-4000-a86c-f777ddf70925+6:2395:x1876424896189312:12345-192.168.204.17@tcp:4:dd.0 Request processed in 76244us (76531us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1789498869.994032:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 0 00000100:00100000:0.0:1789498869.994064:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.17@tcp, seq: 1 00000100:00100000:0.0:1789498869.994076:0:24173:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076846f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7f01496a-f99d-4000-a86c-f777ddf70925+5:2395:x1876424896189184:12345-192.168.204.17@tcp:4:dd.0 00002000:00010000:0.0:1789498869.994116:0:24173:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 7654321, mtime: 0x6aa995f4, atime: 0x6aa995f3, ctime: 0x6aa995f4, blocks: 0x1a68 00010000:00010000:0.0:1789498869.994123:0:24173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093d2e394/0x70d6b5fa1825ea73 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.994135:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=704s v=(0 0) 00010000:00010000:0.0:1789498869.994139:0:24173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789498869.994146:0:24173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093d2e394/0x70d6b5fa1825ea73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498869.994158:0:24173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093d2e394/0x70d6b5fa1825ea73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789498870.066884:0:24163:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:0.0:1789498870.067306:0:24173:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:0.0:1789498870.067329:0:24173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093d2e394/0x70d6b5fa1825ea73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498870.067343:0:24173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093d2e394/0x70d6b5fa1825ea73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498870.067353:0:24173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093d2e394/0x70d6b5fa1825ea73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498870.067359:0:24173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0768bda9800 already unused, calling callback (ffffffffc0db58b0) 00010000:00010000:0.0:1789498870.067375:0:24173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093d2e394/0x70d6b5fa1825ea73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498870.067385:0:24173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093d2e394/0x70d6b5fa1825ea73 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498870.067407:0:24173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093d2e394/0x70d6b5fa1825ea73 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789498870.067414:0:24173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093d2e394/0x70d6b5fa1825ea73 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789498870.067621:0:24173:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076846f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7f01496a-f99d-4000-a86c-f777ddf70925+5:2395:x1876424896189184:12345-192.168.204.17@tcp:4:dd.0 Request processed in 73542us (150105us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1789498870.067631:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.17@tcp, seq: 1 00000100:00100000:1.0:1789498870.205258:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789498870.205284:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916214144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789498870.205362:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498870.205526:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916214144 00000100:00100000:3.0:1789498870.205560:0:24170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916214144 00000100:00100000:3.0:1789498870.205617:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789498870.205626:0:24170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076846f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916214144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789498870.205651:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:3.0:1789498870.205708:0:24170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076846f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916214144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498870.205715:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789498870.205792:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:2.0:1789498870.205814:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa07588199c00, transno 12884901892 00000004:00080000:2.0:1789498870.205833:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:2.0:1789498870.205874:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916214144:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789498870.269550:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498870.717238:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789498870.717266:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876424916214272:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789498870.717338:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498870.717525:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916214272 00000100:00100000:3.0:1789498870.717554:0:22663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916214272 00000100:00100000:3.0:1789498870.717611:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789498870.717621:0:22663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076846f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876424916214272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789498870.717655:0:22663:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789498870.717716:0:22663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076846f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876424916214272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498870.717739:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789498870.717831:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1876424916214272:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789498871.227956:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789498871.227994:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916214400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789498871.228067:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498871.228114:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916214400 00000100:00100000:3.0:1789498871.228121:0:24170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916214400 00000100:00100000:3.0:1789498871.228176:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789498871.228185:0:24170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916214400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789498871.228209:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:3.0:1789498871.228269:0:24170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916214400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498871.228276:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1789498871.228297:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789498871.228338:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916214400:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789498871.293427:0:24478:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789498871.739766:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07586724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916214528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498871.739853:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498871.739919:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916214528 00000100:00100000:1.0:1789498871.739927:0:24170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916214528 00000100:00100000:1.0:1789498871.739981:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789498871.739991:0:24170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916214528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789498871.740027:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1789498871.740070:0:24170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876424916214528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498871.740078:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1789498871.740097:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789498871.740132:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07586724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1876424916214528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789498871.740427:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bc570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876424916214656:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789498871.740457:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789498871.740526:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916214656 00000100:00100000:3.0:1789498871.740560:0:24170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916214656 00000100:00100000:3.0:1789498871.740592:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789498871.740600:0:24170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076c0f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876424916214656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789498871.740611:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1789498871.740642:0:24170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076c0f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876424916214656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789498871.740649:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1789498871.740707:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789498871.740731:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bc570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1876424916214656:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789498871.747518:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758742a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39f24317-e976-4eca-a2df-96def568323f:3643:1876424916214784:0@lo:400:kworker.0 00000100:00100000:0.0:1789498871.747618:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498871.747660:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587429500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916215296:0@lo:400:kworker.0 00000100:00100000:0.0:1789498871.747682:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498871.747699:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bee1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876424916215808:0@lo:400:kworker.0 00000100:00100000:0.0:1789498871.747719:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498871.747741:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789498871.747747:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587428380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916214912:0@lo:400:kworker.0 00000100:00100000:0.0:1789498871.747767:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498871.747803:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758742b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916215424:0@lo:400:kworker.0 00000100:00100000:0.0:1789498871.747843:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498871.747867:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bee1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876424916215936:0@lo:400:kworker.0 00000100:00100000:0.0:1789498871.747892:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498871.747922:0:23400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916215296 00000100:00100000:0.0:1789498871.747930:0:23400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916215296 00000100:00100000:0.0:1789498871.747971:0:23400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916214912 00000100:00100000:0.0:1789498871.747974:0:23400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916214912 00000100:00100000:0.0:1789498871.747991:0:23400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789498871.747999:0:23400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bee1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916215296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498871.748058:0:23400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bee1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916215296:12345-0@lo:400:kworker.0 Request processed in 59us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498871.748065:0:23400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789498871.748080:0:23400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789498871.748086:0:23400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bee1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876424916214912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498871.748113:0:23400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bee1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876424916214912:12345-0@lo:400:kworker.0 Request processed in 27us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498871.748119:0:23400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789498871.748137:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916215808 00000100:00100000:0.0:1789498871.748140:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916215808 00000100:00100000:0.0:1789498871.748171:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916215936 00000100:00100000:0.0:1789498871.748174:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916215936 00000100:00100000:0.0:1789498871.748191:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789498871.748197:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bee1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876424916215808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498871.748224:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bee1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876424916215808:12345-0@lo:400:kworker.0 Request processed in 28us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498871.748230:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789498871.748249:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789498871.748254:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bee1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876424916215936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498871.748279:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bee1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876424916215936:12345-0@lo:400:kworker.0 Request processed in 25us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498871.748286:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789498871.748305:0:24475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916215424 00000100:00100000:0.0:1789498871.748308:0:24475:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916215424 00000100:00100000:0.0:1789498871.748329:0:24475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789498871.748335:0:24475:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bee1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916215424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498871.748361:0:24475:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bee1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876424916215424:12345-0@lo:400:kworker.0 Request processed in 27us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498871.748368:0:24475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789498871.748406:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587428380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1876424916214912:0@lo:400:kworker.0 00000100:00100000:0.0:1789498871.748416:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758742b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916215424:0@lo:400:kworker.0 00000100:00100000:0.0:1789498871.748424:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bee1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1876424916215936:0@lo:400:kworker.0 00000100:00100000:0.0:1789498871.748434:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587429500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1876424916215296:0@lo:400:kworker.0 00010000:00080000:0.0:1789498871.748446:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa076bee1e680 x1876424916215808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498871.748457:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bee1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1876424916215808:0@lo:400:kworker.0 00000100:00080000:0.0:1789498871.748490:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789498871.748495:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789498871.748504:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587428000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876424916215168:0@lo:400:kworker.0 00000100:00100000:0.0:1789498871.748528:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498871.748567:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bee1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876424916215680:0@lo:400:kworker.0 00000100:00100000:0.0:1789498871.748595:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498871.748613:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789498871.748618:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa07587429f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876424916215040:0@lo:400:kworker.0 00000100:00100000:0.0:1789498871.748638:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498871.748654:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa0758742a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876424916215552:0@lo:400:kworker.0 00000100:00100000:0.0:1789498871.748672:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498871.748685:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076bee1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876424916216064:0@lo:400:kworker.0 00000100:00100000:0.0:1789498871.748702:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789498871.748721:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916215168 00000100:00100000:0.0:1789498871.748724:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916215168 00000100:00100000:0.0:1789498871.748739:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916215680 00000100:00100000:0.0:1789498871.748742:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916215680 00000100:00100000:0.0:1789498871.748757:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916215552 00000100:00100000:0.0:1789498871.748759:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916215552 00000100:00100000:0.0:1789498871.748768:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916216064 00000100:00100000:0.0:1789498871.748771:0:22659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916216064 00000100:00100000:0.0:1789498871.748784:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789498871.748790:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bee1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876424916215168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498871.748838:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bee1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876424916215168:12345-0@lo:400:kworker.0 Request processed in 46us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498871.748844:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789498871.748857:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789498871.748863:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bee1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876424916215680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498871.748890:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bee1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876424916215680:12345-0@lo:400:kworker.0 Request processed in 27us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498871.748897:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789498871.748908:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789498871.748920:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bee1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876424916215552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498871.748948:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bee1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876424916215552:12345-0@lo:400:kworker.0 Request processed in 28us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498871.748953:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789498871.748965:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789498871.748971:0:22659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bee1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876424916216064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498871.748996:0:22659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bee1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876424916216064:12345-0@lo:400:kworker.0 Request processed in 26us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498871.749002:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789498871.749021:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916215040 00000100:00100000:0.0:1789498871.749024:0:24167:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916215040 00000100:00100000:0.0:1789498871.749048:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789498871.749055:0:24167:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bee1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876424916215040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789498871.749083:0:24167:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bee1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876424916215040:12345-0@lo:400:kworker.0 Request processed in 28us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789498871.749089:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1789498871.749108:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789498871.749111:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789498871.749113:0:22654:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789498871.749129:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587429f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1876424916215040:0@lo:400:kworker.0 00000100:00100000:0.0:1789498871.749138:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758742a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876424916215552:0@lo:400:kworker.0 00010000:00080000:0.0:1789498871.749147:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa076bee1c700 x1876424916216064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789498887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789498871.749156:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bee1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1876424916216064:0@lo:400:kworker.0 00000100:00100000:0.0:1789498871.749164:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa07587428000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876424916215168:0@lo:400:kworker.0 00000100:00100000:0.0:1789498871.749181:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076bee1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1876424916215680:0@lo:400:kworker.0 00000100:00100000:2.0:1789498871.750127:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916214784 00000100:00100000:2.0:1789498871.750135:0:22653:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916214784 00000100:00100000:2.0:1789498871.750183:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789498871.750191:0:22653:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa07588c16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+24:3643:x1876424916214784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789498871.750252:0:22653:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa07588c16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:39f24317-e976-4eca-a2df-96def568323f+24:3643:x1876424916214784:12345-0@lo:400:kworker.0 Request processed in 62us (2634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789498871.750260:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789498871.750300:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa0758742a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:39f24317-e976-4eca-a2df-96def568323f:3643:1876424916214784:0@lo:400:kworker.0 00000100:00100000:3.0:1789498871.753619:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789498871.753643:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffffa076c0f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916216192:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789498871.753708:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789498871.753784:0:23400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876424916216192 00000100:00100000:1.0:1789498871.753802:0:23400:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876424916216192 00000100:00100000:1.0:1789498871.753864:0:23400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789498871.753875:0:23400:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffffa076bc570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916216192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789498871.753913:0:23400:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1789498871.753962:0:23400:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffffa076bc570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876424916216192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789498871.753971:0:23400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789498871.754017:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffffa076c0f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1876424916216192:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1789498871.935023:0:22692:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1789498871.935033:0:22692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789498871.935075:0:22692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1789498871.935086:0:22692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000001:02000400:3.0:1789498871.980763:0:25758:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1789498872.318358:0:22646:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789498872.764490:0:23413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789498873.344349:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14440 lines, 14440 kept, 0 dropped, 0 bad.