00010000:00010000:2.0F:1787787444.971784:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0F:1787787445.994036:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787446.127190:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503779712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787787446.127267:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787446.127327:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503780224:0@lo:400:kworker.0 00000100:00100000:2.0:1787787446.127367:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787446.127393:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503780736:0@lo:400:kworker.0 00000100:00100000:2.0:1787787446.127418:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787446.127436:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503781248:0@lo:400:kworker.0 00000100:00100000:2.0:1787787446.127459:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787446.127487:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787787446.127494:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503780096:0@lo:400:kworker.0 00000100:00100000:2.0:1787787446.127516:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787446.127535:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503780608:0@lo:400:kworker.0 00000100:00100000:2.0:1787787446.127554:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787446.127570:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874630503781120:0@lo:400:kworker.0 00000100:00100000:2.0:1787787446.127589:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787446.127626:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:655a2ac3-6e05-4716-af47-ef6019dc5f23:3653:1874630503779840:0@lo:400:kworker.0 00000100:00100000:2.0:1787787446.127656:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787446.127680:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503780352:0@lo:400:kworker.0 00000100:00100000:2.0:1787787446.127701:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787446.127721:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503780864:0@lo:400:kworker.0 00000100:00100000:2.0:1787787446.127755:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787446.127778:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503781376:0@lo:400:kworker.0 00000100:00100000:2.0:1787787446.127798:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787446.127812:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1787787446.127829:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503779968:0@lo:400:kworker.0 00000100:00100000:2.0:1787787446.127858:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0F:1787787446.131420:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503779712 00000100:00100000:0.0:1787787446.131444:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503779712 00000100:00100000:0.0:1787787446.131517:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787787446.131528:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc24b7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503779712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787787446.131564:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787787446.135228:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc24b7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503779712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3684us (7942us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787446.135250:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1787787446.135302:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787787446.135657:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503779712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787787446.135676:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787787446.135692:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503781632:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787787446.135966:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787446.136042:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503780224 00000100:00100000:2.0:1787787446.136049:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503780224 00000100:00100000:2.0:1787787446.136096:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503780736 00000100:00100000:2.0:1787787446.136100:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503780736 00000100:00100000:2.0:1787787446.136153:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503780096 00000100:00100000:2.0:1787787446.136157:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503780096 00000100:00100000:2.0:1787787446.136170:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503780608 00000100:00100000:2.0:1787787446.136173:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503780608 00000100:00100000:2.0:1787787446.136186:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787787446.136193:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffc5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503780224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787446.136254:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffc5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503780224:12345-0@lo:400:kworker.0 Request processed in 61us (8886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787446.136261:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787787446.136275:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787787446.136281:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffc5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503780736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787446.136310:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffc5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503780736:12345-0@lo:400:kworker.0 Request processed in 30us (8891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787446.136316:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787787446.136328:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787787446.136334:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffc5d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3656:x1874630503780096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787446.136363:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffc5d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3656:x1874630503780096:12345-0@lo:400:kworker.0 Request processed in 29us (8846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787446.136386:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787787446.136399:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787787446.136404:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffc5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503780608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787446.136436:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffc5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503780608:12345-0@lo:400:kworker.0 Request processed in 32us (8880us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787446.136442:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787787446.136469:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503781248 00000100:00100000:2.0:1787787446.136473:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503781248 00000100:00100000:2.0:1787787446.136494:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503781120 00000100:00100000:2.0:1787787446.136497:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503781120 00000100:00100000:2.0:1787787446.136509:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503780352 00000100:00100000:2.0:1787787446.136511:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503780352 00000100:00100000:2.0:1787787446.136521:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503780864 00000100:00100000:2.0:1787787446.136525:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503780864 00000100:00100000:2.0:1787787446.136535:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503781376 00000100:00100000:2.0:1787787446.136538:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503781376 00000100:00100000:2.0:1787787446.136552:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787787446.136557:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffc5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503781248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787446.136607:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffc5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503781248:12345-0@lo:400:kworker.0 Request processed in 49us (9146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787446.136614:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787787446.136628:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787787446.136634:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffc5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874630503781120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787446.136663:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffc5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874630503781120:12345-0@lo:400:kworker.0 Request processed in 30us (9073us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787446.136670:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787787446.136681:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787787446.136695:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffc5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503780352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787446.136729:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffc5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503780352:12345-0@lo:400:kworker.0 Request processed in 35us (9025us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787446.136749:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787787446.136763:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787787446.136769:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffc5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503780864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787446.136796:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffc5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503780864:12345-0@lo:400:kworker.0 Request processed in 28us (9041us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787446.136803:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787787446.136814:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787787446.136820:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffc5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503781376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787446.137123:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffc5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503781376:12345-0@lo:400:kworker.0 Request processed in 303us (9322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787446.137130:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787787446.137362:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503779840 00000100:00100000:2.0:1787787446.137368:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503779840 00000100:00100000:2.0:1787787446.137447:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787787446.137455:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:3653:x1874630503779840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787446.137491:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:3653:x1874630503779840:12345-0@lo:400:kworker.0 Request processed in 38us (9835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787446.137497:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787787446.137597:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503781632 00000100:00100000:0.0:1787787446.137602:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503781632 00000100:00100000:0.0:1787787446.137631:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787787446.137638:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffc5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503781632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787787446.137653:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787787446.137686:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffc5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503781632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (1721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787446.137692:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1787787446.137709:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787787446.137714:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787787446.137717:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787787446.137719:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0F:1787787446.138279:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503780480:0@lo:400:kworker.0 00000100:00100000:3.0:1787787446.138328:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787446.138352:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503780992:0@lo:400:kworker.0 00000100:00100000:3.0:1787787446.138378:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787446.138397:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed925680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503781504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787787446.138421:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787446.138451:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:655a2ac3-6e05-4716-af47-ef6019dc5f23:3653:1874630503779840:0@lo:400:kworker.0 00000100:00100000:3.0:1787787446.138467:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503780352:0@lo:400:kworker.0 00000100:00100000:3.0:1787787446.138479:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503780864:0@lo:400:kworker.0 00010000:00080000:3.0:1787787446.138497:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc24b61c0 x1874630503781376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787446.138508:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503781376:0@lo:400:kworker.0 00000100:00100000:0.0:1787787446.138680:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503779968 00000100:00100000:0.0:1787787446.138686:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503779968 00000100:00100000:0.0:1787787446.138727:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503780480 00000100:00100000:0.0:1787787446.138730:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503780480 00000100:00100000:0.0:1787787446.138761:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787787446.138767:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffc5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503779968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787446.138816:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffc5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503779968:12345-0@lo:400:kworker.0 Request processed in 48us (10957us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787446.138823:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787787446.139248:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503780992 00000100:00100000:1.0:1787787446.139253:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503780992 00000100:00100000:1.0:1787787446.139295:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787787446.139302:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874630503780992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787446.139342:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874630503780992:12345-0@lo:400:kworker.0 Request processed in 41us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787446.139349:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1787787446.139366:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787446.139502:0:20292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787787446.139513:0:20292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4295680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503780480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787446.139548:0:20292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4295680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503780480:12345-0@lo:400:kworker.0 Request processed in 38us (1220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787446.139553:0:20292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787787446.139605:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503781504 00000100:00100000:0.0:1787787446.139610:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503781504 00000100:00100000:0.0:1787787446.139675:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787787446.139682:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc42961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1874630503781504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787787446.139702:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 28672 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787787446.139747:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc42961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1874630503781504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787446.139754:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787787446.139991:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503781632:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787787446.140007:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503780096:0@lo:400:kworker.0 00000100:00100000:2.0:1787787446.140019:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503780608:0@lo:400:kworker.0 00010000:00080000:2.0:1787787446.140049:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc24b6940 x1874630503781120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787446.140060:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874630503781120:0@lo:400:kworker.0 00000100:00100000:2.0:1787787446.140072:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503780224:0@lo:400:kworker.0 00000100:00100000:2.0:1787787446.140081:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503780736:0@lo:400:kworker.0 00000100:00100000:2.0:1787787446.140092:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503781248:0@lo:400:kworker.0 00000100:00100000:0.0:1787787446.142049:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503779968:0@lo:400:kworker.0 00000100:00100000:0.0:1787787446.142071:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503780480:0@lo:400:kworker.0 00000100:00100000:0.0:1787787446.142085:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503780992:0@lo:400:kworker.0 00000100:00100000:0.0:1787787446.142110:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed925680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503781504:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1787787446.640514:0:17132:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00010000:00010000:2.0:1787787446.640528:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa678 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787446.640541:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa678 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787787446.640546:0:17132:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9870e085d900 refcount 2 committed 0 result 0 batchid 4294967529 00010000:00010000:2.0:1787787446.640549:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa678 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787787446.640551:0:17132:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9870c4b4f700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9870c30d20c0 00000020:00080000:0.0:1787787446.640554:0:17132:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9870c4b4f600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9870c4a88a00 00010000:00010000:2.0:1787787446.640556:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6658e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787446.640561:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa678 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787446.640569:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa678 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787446.640587:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9870d0b9e300) 00010000:00010000:2.0:1787787446.640590:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:3.0:1787787446.640691:0:17191:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:3.0:1787787446.640777:0:17191:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:0.0:1787787446.641180:0:18653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:0.0:1787787446.641191:0:18653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00010000:00010000:2.0:1787787446.642692:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa678 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787446.642710:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658e00/0x11620bc3f30aa678 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787447.022945:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787447.490706:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787447.490821:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484834560 00000100:00100000:1.0:1787787447.490833:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484834560 00000100:00100000:1.0:1787787447.490911:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 30 00000100:00100000:1.0:1787787447.490922:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed925680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:06eed6ec-d774-46ad-afc7-a8fd1799d109+5:2390:x1874630484834560:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:1.0:1787787447.490957:0:19542:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30aa337 00000100:00080000:1.0:1787787447.490977:0:19542:0:(import.c:65:import_set_state_nolock()) ffff9870c451c800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787787447.491024:0:19542:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1787787447.491238:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed925680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:06eed6ec-d774-46ad-afc7-a8fd1799d109+2:2390:x1874630484834560:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 317us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787447.491246:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 30 00010000:00010000:1.0:1787787447.491268:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787787447.491443:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787787447.497859:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787447.497897:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787447.497921:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787447.497942:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787447.497963:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787447.497994:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787447.498012:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787447.498034:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787447.498061:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484834048 00000100:00100000:0.0:1787787447.498070:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484834048 00000100:00100000:0.0:1787787447.498120:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 170 00000100:00100000:0.0:1787787447.498160:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66978c8d-7aad-4ae0-adce-30a3922603d6+13:2391:x1874630484834048:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787447.498232:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66978c8d-7aad-4ae0-adce-30a3922603d6+13:2391:x1874630484834048:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 104us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787447.498240:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 170 00000100:00100000:0.0:1787787447.498273:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484834304 00000100:00100000:0.0:1787787447.498277:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484834304 00000100:00100000:0.0:1787787447.498310:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484834176 00000100:00100000:0.0:1787787447.498313:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484834176 00000100:00100000:0.0:1787787447.498328:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484834688 00000100:00100000:0.0:1787787447.498330:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484834688 00000100:00100000:0.0:1787787447.498342:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484834816 00000100:00100000:0.0:1787787447.498344:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484834816 00000100:00100000:0.0:1787787447.498360:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 80 00000100:00100000:0.0:1787787447.498367:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed9270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+5:2391:x1874630484834304:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787447.498399:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed9270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+5:2391:x1874630484834304:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 32us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787447.498406:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 80 00000100:00100000:0.0:1787787447.498418:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 81 00000100:00100000:0.0:1787787447.498425:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+12:2391:x1874630484834176:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787447.498449:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+12:2391:x1874630484834176:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787447.498466:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 81 00000100:00100000:0.0:1787787447.498479:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 82 00000100:00100000:0.0:1787787447.498485:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:2391:x1874630484834688:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787447.498511:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:2391:x1874630484834688:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787447.498517:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 82 00000100:00100000:0.0:1787787447.498528:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 83 00000100:00100000:0.0:1787787447.498534:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+5:2392:x1874630484834816:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787447.498557:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+5:2392:x1874630484834816:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 23us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787447.498564:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 83 00000100:00100000:0.0:1787787447.498583:0:19137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484834432 00000100:00100000:0.0:1787787447.498586:0:19137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484834432 00000100:00100000:0.0:1787787447.498612:0:19137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484834944 00000100:00100000:0.0:1787787447.498615:0:19137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484834944 00000100:00100000:0.0:1787787447.498635:0:19137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484835072 00000100:00100000:0.0:1787787447.498638:0:19137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484835072 00000100:00100000:0.0:1787787447.498653:0:19137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 32 00000100:00100000:0.0:1787787447.498658:0:19137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:2391:x1874630484834432:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787447.498683:0:19137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:2391:x1874630484834432:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787447.498689:0:19137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 32 00000100:00100000:0.0:1787787447.498701:0:19137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 31 00000100:00100000:0.0:1787787447.498706:0:19137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+5:2390:x1874630484834944:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:0.0:1787787447.498746:0:19137:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30aa36f 00000100:00080000:0.0:1787787447.498763:0:19137:0:(import.c:65:import_set_state_nolock()) ffff9870f0372000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787787447.498802:0:19137:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:0.0:1787787447.498920:0:19137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+2:2390:x1874630484834944:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 213us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787447.498927:0:19137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 31 00000100:00100000:0.0:1787787447.498940:0:19137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 32 00000100:00100000:0.0:1787787447.498946:0:19137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+5:2390:x1874630484835072:12345-192.168.204.31@tcp:9:kworker.0 00000020:00000080:0.0:1787787447.498961:0:19137:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30aa376 00000100:00080000:0.0:1787787447.498967:0:19137:0:(import.c:65:import_set_state_nolock()) ffff9870f0370800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787787447.498989:0:19137:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1787787447.499055:0:19137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+2:2390:x1874630484835072:12345-192.168.204.31@tcp:9:kworker.0 Request processed in 108us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787447.499061:0:19137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 32 00000100:00080000:0.0:1787787447.499248:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787787447.499252:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787787447.499255:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787787447.499257:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787787447.499303:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787447.502401:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787447.659224:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787447.659309:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484835200 00000100:00100000:0.0:1787787447.659320:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484835200 00000100:00100000:0.0:1787787447.659385:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 74 00000100:00100000:0.0:1787787447.659395:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4281a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+12:15560:x1874630484835200:12345-192.168.204.31@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787787447.659505:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4281a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+12:15560:x1874630484835200:12345-192.168.204.31@tcp:60:lhsmtool_posix.0 Request processed in 111us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787447.659513:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 74 00000100:00100000:0.0:1787787447.663179:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787447.663266:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484835328 00000100:00100000:2.0:1787787447.663276:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484835328 00000100:00100000:2.0:1787787447.663329:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 75 00000100:00100000:2.0:1787787447.663340:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+5:15560:x1874630484835328:12345-192.168.204.31@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787787447.663450:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+5:15560:x1874630484835328:12345-192.168.204.31@tcp:60:lhsmtool_posix.0 Request processed in 111us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787447.663458:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 75 00000100:00100000:1.0:1787787447.671178:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787447.671261:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484835584 00000100:00100000:0.0:1787787447.671272:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484835584 00000100:00100000:0.0:1787787447.671335:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16 00000100:00100000:0.0:1787787447.671345:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc30a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+12:15560:x1874630484835584:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787787447.672082:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc30a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+13:15560:x1874630484835584:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 Request processed in 271us (488us total) trans 8589934636 rc 0/0 00000100:00100000:0.0:1787787447.672098:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16 00010000:00010000:0.0:1787787448.041564:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787448.170292:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4294f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503781760:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787787448.170447:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787448.170546:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503781760 00000100:00100000:1.0:1787787448.170619:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503781760 00000100:00100000:1.0:1787787448.170707:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787787448.170717:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffc5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503781760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787787448.170745:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1787787448.170808:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffc5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503781760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787448.170828:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787787448.170876:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4294f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503781760:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787787448.171202:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787787449.065861:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787449.194405:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503782016:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787787449.194487:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787449.194603:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffc5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503781888:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787449.194643:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787449.206783:0:20292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503782016 00000100:00100000:1.0:1787787449.206800:0:20292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503782016 00000100:00100000:1.0:1787787449.206877:0:20292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503781888 00000100:00100000:1.0:1787787449.206881:0:20292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503781888 00000100:00100000:1.0:1787787449.206902:0:20292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787787449.206912:0:20292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4294b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503782016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787787449.206966:0:20292:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787787449.207087:0:20292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4294b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503782016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 176us (12602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787449.207094:0:20292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787787449.207124:0:20292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787787449.207132:0:20292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503781888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787787449.207168:0:20292:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1787787449.207206:0:20292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503781888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (12562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787449.207212:0:20292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787787449.207296:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503782016:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787787449.208446:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffc5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503781888:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787787450.089515:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787451.127065:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787451.241447:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787787451.241485:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ffc5de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503782144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787787451.241591:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787451.241596:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503782656:0@lo:400:kworker.0 00000100:00100000:0.0:1787787451.241651:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787451.241675:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:655a2ac3-6e05-4716-af47-ef6019dc5f23:3656:1874630503782272:0@lo:400:kworker.0 00000100:00100000:0.0:1787787451.241685:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503783168:0@lo:400:kworker.0 00000100:00100000:2.0:1787787451.242700:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787451.242770:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503782784:0@lo:400:kworker.0 00000100:00100000:2.0:1787787451.242825:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787451.242852:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874630503783296:0@lo:400:kworker.0 00000100:00100000:2.0:1787787451.242875:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787451.242895:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874630503783808:0@lo:400:kworker.0 00000100:00100000:2.0:1787787451.242922:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787451.242972:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503782144 00000100:00100000:2.0:1787787451.242982:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503782144 00000100:00100000:2.0:1787787451.243063:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787787451.243083:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffc5e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503782144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787787451.243127:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787787451.243344:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffc5e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503782144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 263us (1752us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787451.243352:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787787451.243384:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503782272 00000100:00100000:2.0:1787787451.243389:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503782272 00000100:00100000:2.0:1787787451.243422:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787787451.243430:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:3656:x1874630503782272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787451.243467:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:3656:x1874630503782272:12345-0@lo:400:kworker.0 Request processed in 39us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787451.243475:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787787451.243509:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503782784 00000100:00100000:2.0:1787787451.243513:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503782784 00000100:00100000:2.0:1787787451.243552:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503783296 00000100:00100000:2.0:1787787451.243557:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503783296 00000100:00100000:2.0:1787787451.243570:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503783808 00000100:00100000:2.0:1787787451.243573:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503783808 00000100:00100000:2.0:1787787451.243590:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787787451.243597:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffc5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503782784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787451.243632:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffc5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503782784:12345-0@lo:400:kworker.0 Request processed in 35us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787451.243654:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787787451.243667:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787787451.243675:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffc5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874630503783296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787451.243706:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffc5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874630503783296:12345-0@lo:400:kworker.0 Request processed in 33us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787451.243725:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787787451.243740:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787787451.243748:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffc5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874630503783808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787451.243898:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffc5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874630503783808:12345-0@lo:400:kworker.0 Request processed in 151us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787451.243905:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1787787451.243929:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787787451.243935:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787787451.243977:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:655a2ac3-6e05-4716-af47-ef6019dc5f23:3656:1874630503782272:0@lo:400:kworker.0 00000100:00100000:2.0:1787787451.243996:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503782784:0@lo:400:kworker.0 00000100:00100000:2.0:1787787451.244009:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874630503783296:0@lo:400:kworker.0 00010000:00080000:2.0:1787787451.244027:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc43f83c0 x1874630503783808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787451.244038:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874630503783808:0@lo:400:kworker.0 00000100:00100000:2.0:1787787451.244061:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ffc5de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503782144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787787451.244113:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787451.244162:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503783680:0@lo:400:kworker.0 00000100:00100000:0.0:1787787451.244197:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787451.244241:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503783680 00000100:00100000:2.0:1787787451.244245:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503783680 00000100:00100000:0.0:1787787451.244265:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503782400:0@lo:400:kworker.0 00000100:00100000:2.0:1787787451.244272:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787787451.244278:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874630503783680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787451.244296:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787451.244312:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3655:x1874630503783680:12345-0@lo:400:kworker.0 Request processed in 34us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787451.244318:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787787451.244322:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503782912:0@lo:400:kworker.0 00000100:00080000:2.0:1787787451.244333:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787451.244343:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787451.244360:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503783680:0@lo:400:kworker.0 00000100:00100000:0.0:1787787451.244368:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503783424:0@lo:400:kworker.0 00000100:00100000:0.0:1787787451.244399:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787451.244409:0:19137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503782656 00000100:00100000:2.0:1787787451.244413:0:19137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503782656 00000100:00100000:0.0:1787787451.244416:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503783936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787451.244447:0:19137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503783168 00000100:00100000:2.0:1787787451.244451:0:19137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503783168 00000100:00100000:2.0:1787787451.244471:0:19137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787787451.244478:0:19137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503782656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787451.244515:0:19137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503782656:12345-0@lo:400:kworker.0 Request processed in 38us (2879us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787451.244521:0:19137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787787451.244533:0:19137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787787451.244539:0:19137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503783168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787451.244564:0:19137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503783168:12345-0@lo:400:kworker.0 Request processed in 27us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787451.244570:0:19137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787787451.244591:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503782528:0@lo:400:kworker.0 00000100:00100000:2.0:1787787451.244615:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787451.244652:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503783040:0@lo:400:kworker.0 00000100:00100000:2.0:1787787451.244676:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787451.244694:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874630503783552:0@lo:400:kworker.0 00000100:00100000:2.0:1787787451.244713:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787451.244729:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4294f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503784064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787787451.244751:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787451.245294:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503782528 00000100:00100000:2.0:1787787451.245302:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503782528 00000100:00100000:2.0:1787787451.245331:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503783040 00000100:00100000:2.0:1787787451.245344:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503783040 00000100:00100000:2.0:1787787451.245364:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787787451.245371:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ffc5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503782528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787451.245426:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ffc5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503782528:12345-0@lo:400:kworker.0 Request processed in 55us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787451.245434:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787787451.245446:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787787451.245452:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503783040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787451.245497:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503783040:12345-0@lo:400:kworker.0 Request processed in 45us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787451.245503:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787787451.245529:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503783424 00000100:00100000:2.0:1787787451.245532:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503783424 00000100:00100000:2.0:1787787451.245629:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503783552 00000100:00100000:2.0:1787787451.245633:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503783552 00000100:00100000:0.0:1787787451.246119:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787451.246199:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503782400 00000100:00100000:0.0:1787787451.246204:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503782400 00000100:00100000:0.0:1787787451.246236:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503782912 00000100:00100000:0.0:1787787451.246239:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503782912 00000100:00100000:0.0:1787787451.246259:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787787451.246266:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503782400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787451.246311:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787787451.246312:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503782400:12345-0@lo:400:kworker.0 Request processed in 46us (2014us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787451.246318:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874630503783424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787451.246318:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787787451.246331:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787787451.246336:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503782912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787451.246354:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874630503783424:12345-0@lo:400:kworker.0 Request processed in 37us (1956us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787451.246359:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503782912:12345-0@lo:400:kworker.0 Request processed in 23us (2015us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787451.246361:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787787451.246371:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787787451.246372:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787787451.246378:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874630503783552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787451.246411:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503782400:0@lo:400:kworker.0 00000100:00100000:2.0:1787787451.246678:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874630503783552:12345-0@lo:400:kworker.0 Request processed in 298us (1961us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787451.246685:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1787787451.246723:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787787451.246727:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787787451.246745:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787787451.246748:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787787451.246774:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503784064 00000100:00100000:2.0:1787787451.246780:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503784064 00000100:00100000:2.0:1787787451.246800:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503783936 00000100:00100000:2.0:1787787451.246811:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503783936 00000100:00100000:2.0:1787787451.246824:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787787451.246831:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503784064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787787451.246849:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787787451.246885:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503784064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (2132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787451.246890:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787787451.246901:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787787451.246906:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503783936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787787451.246927:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1787787451.246954:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503783936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787451.246960:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787787451.247001:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:2.0:1787787451.247007:0:3654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff987101f78f00, transno 8589934596 00000004:00080000:2.0:1787787451.247025:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:2.0:1787787451.247053:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503782528:0@lo:400:kworker.0 00000100:00100000:2.0:1787787451.247069:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503783040:0@lo:400:kworker.0 00010000:00080000:2.0:1787787451.247085:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc3b2580 x1874630503783552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787451.247096:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874630503783552:0@lo:400:kworker.0 00000100:00100000:2.0:1787787451.247128:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4294f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503784064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787787451.247351:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503782656:0@lo:400:kworker.0 00000100:00100000:2.0:1787787451.247366:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503783168:0@lo:400:kworker.0 00000100:00100000:0.0:1787787451.250578:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503782912:0@lo:400:kworker.0 00000100:00100000:2.0:1787787451.250683:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503783424:0@lo:400:kworker.0 00000100:00100000:2.0:1787787451.250712:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503783936:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787787451.342806:0:20528:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 19:37:29 (1787787449) 00010000:00010000:0.0:1787787452.137579:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787452.588486:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787452.588540:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787452.588572:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787452.588606:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787452.588641:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787452.588673:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787452.588699:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484835840 00000100:00100000:3.0:1787787452.588708:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484835840 00000100:00100000:3.0:1787787452.588762:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484836352 00000100:00100000:3.0:1787787452.588766:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484836352 00000100:00100000:3.0:1787787452.588778:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484835968 00000100:00100000:3.0:1787787452.588780:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484835968 00000100:00100000:3.0:1787787452.588792:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484836224 00000100:00100000:3.0:1787787452.588794:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484836224 00000100:00100000:3.0:1787787452.588808:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 90 00000100:00100000:3.0:1787787452.588818:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4296d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+13:2393:x1874630484835840:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787452.588896:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4296d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+13:2393:x1874630484835840:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 80us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787452.588905:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 90 00000100:00100000:3.0:1787787452.588921:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 91 00000100:00100000:3.0:1787787452.588928:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc42952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+5:2393:x1874630484836352:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787452.588956:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc42952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+5:2393:x1874630484836352:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787452.588962:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 91 00000100:00100000:3.0:1787787452.588974:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 92 00000100:00100000:3.0:1787787452.588980:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4295e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+5:2393:x1874630484835968:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787452.589002:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4295e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+5:2393:x1874630484835968:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 22us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787452.589023:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 92 00000100:00100000:3.0:1787787452.589036:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 93 00000100:00100000:3.0:1787787452.589042:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4295a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:2393:x1874630484836224:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787452.589068:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4295a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:2393:x1874630484836224:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 27us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787452.589074:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 93 00000100:00080000:3.0:1787787452.589097:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787787452.589101:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787452.589371:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484836096 00000100:00100000:0.0:1787787452.589376:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484836096 00000100:00100000:0.0:1787787452.589420:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 37 00000100:00100000:0.0:1787787452.589429:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4294780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:2393:x1874630484836096:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787452.589476:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4294780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:2393:x1874630484836096:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 49us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787452.589483:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 37 00000100:00100000:0.0:1787787452.589514:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484835712 00000100:00100000:0.0:1787787452.589518:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484835712 00000100:00100000:0.0:1787787452.589550:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 172 00000100:00100000:0.0:1787787452.589558:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66978c8d-7aad-4ae0-adce-30a3922603d6+13:2393:x1874630484835712:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1787787452.589584:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66978c8d-7aad-4ae0-adce-30a3922603d6+13:2393:x1874630484835712:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787452.589591:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 172 00000100:00080000:3.0:1787787452.590058:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1787787452.787525:0:18653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 72f0a557-2c5a-424e-9fbb-a30d283f0eb0 00000020:00000080:0.0:1787787452.787536:0:18653:0:(genops.c:885:class_export_put()) final put ffff9870f0373000/72f0a557-2c5a-424e-9fbb-a30d283f0eb0 00000020:00000080:0.0:1787787452.787581:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f0373000/72f0a557-2c5a-424e-9fbb-a30d283f0eb0 for lustre-OST0000 00000020:00000080:0.0:1787787452.787654:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870f0372000 for lustre-OST0000 00000001:00100000:0.0:1787787452.791643:0:19472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 72f0a557-2c5a-424e-9fbb-a30d283f0eb0 00000020:00000080:0.0:1787787452.791654:0:19472:0:(genops.c:885:class_export_put()) final put ffff9870f0376800/72f0a557-2c5a-424e-9fbb-a30d283f0eb0 00000001:00100000:0.0:1787787452.791684:0:19472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 06eed6ec-d774-46ad-afc7-a8fd1799d109 00000020:00000080:0.0:1787787452.791687:0:19472:0:(genops.c:885:class_export_put()) final put ffff9870c451a000/06eed6ec-d774-46ad-afc7-a8fd1799d109 00000020:00000080:1.0:1787787452.792116:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f0376800/72f0a557-2c5a-424e-9fbb-a30d283f0eb0 for lustre-OST0001 00000020:00000080:1.0:1787787452.792602:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870c451a000/06eed6ec-d774-46ad-afc7-a8fd1799d109 for lustre-OST0001 00000020:00000080:1.0:1787787452.792644:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870f0370800 for lustre-OST0001 00000020:00000080:1.0:1787787452.792648:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870c451c800 for lustre-OST0001 00000001:00080000:3.0:1787787452.799722:0:17132:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00080000:3.0:1787787452.799738:0:17132:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:0.0:1787787452.799784:0:17191:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:0.0:1787787452.799798:0:17191:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00010000:00010000:3.0:1787787453.162950:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787453.294752:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787787453.294776:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4296940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503784192:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787787453.294845:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787453.294889:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503784192 00000100:00100000:3.0:1787787453.294896:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503784192 00000100:00100000:3.0:1787787453.294946:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787787453.294954:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc42970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503784192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787787453.294981:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787787453.295018:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc42970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503784192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787453.295025:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1787787453.295045:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787453.295080:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4296940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503784192:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1787787453.609502:0:17186:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787787453.609516:0:17186:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787787453.609539:0:17186:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787787453.609549:0:17186:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1787787454.185439:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787454.313490:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503784320:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787787454.313563:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787454.315967:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503784320 00000100:00100000:1.0:1787787454.315988:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503784320 00000100:00100000:1.0:1787787454.316082:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787787454.316092:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4296940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503784320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787787454.316133:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787787454.316777:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4296940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503784320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 682us (3210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787454.316786:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787787454.317202:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787787454.317218:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503784448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787787454.317272:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787454.317314:0:20292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503784448 00000100:00100000:2.0:1787787454.317320:0:20292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503784448 00000100:00100000:2.0:1787787454.317355:0:20292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787787454.317362:0:20292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503784448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787787454.317385:0:20292:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1787787454.317425:0:20292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503784448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787454.317431:0:20292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787787454.317473:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503784448:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1787787454.319193:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787787454.327405:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503784320:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787787454.963472:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787454.963520:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787454.963621:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484836480 00000100:00100000:0.0:1787787454.963632:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484836480 00000100:00100000:0.0:1787787454.963692:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484836736 00000100:00100000:0.0:1787787454.963695:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484836736 00000100:00100000:0.0:1787787454.963727:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4 00000100:00100000:0.0:1787787454.963736:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4297480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66978c8d-7aad-4ae0-adce-30a3922603d6+14:2391:x1874630484836480:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787454.963766:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787454.963785:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c13f5e00/0x11620bc3f30aa30d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c84d7 expref: 14 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787454.963804:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787454.963856:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4297480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66978c8d-7aad-4ae0-adce-30a3922603d6+13:2391:x1874630484836480:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 121us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787454.963864:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4 00000100:00100000:0.0:1787787454.963881:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5 00000100:00100000:0.0:1787787454.963887:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4297840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66978c8d-7aad-4ae0-adce-30a3922603d6+12:2391:x1874630484836736:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787454.963895:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787454.963903:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c0030e00/0x11620bc3f30aa399 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85be expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787454.963914:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787454.963930:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4297840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66978c8d-7aad-4ae0-adce-30a3922603d6+11:2391:x1874630484836736:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 44us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787454.963936:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5 00000100:00100000:0.0:1787787454.970685:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787454.973478:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484836608 00000100:00100000:1.0:1787787454.973492:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484836608 00000100:00100000:1.0:1787787454.973652:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6 00000100:00100000:1.0:1787787454.973664:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66978c8d-7aad-4ae0-adce-30a3922603d6+11:2392:x1874630484836608:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787787454.973680:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787454.973700:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c7c15e00/0x11620bc3f30aa314 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8508 expref: 11 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787454.973719:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787454.973778:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66978c8d-7aad-4ae0-adce-30a3922603d6+10:2392:x1874630484836608:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 117us (3104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787454.973786:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6 00000100:00100000:3.0:1787787454.974400:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787454.974445:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484836992 00000100:00100000:3.0:1787787454.974451:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484836992 00000100:00100000:3.0:1787787454.974498:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 33 00000100:00100000:3.0:1787787454.974507:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4294f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+6:2390:x1874630484836992:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:3.0:1787787454.974542:0:18658:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30aa330 00000020:00010000:3.0:1787787454.974550:0:18658:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9870c451c000: total 0 00000100:00080000:3.0:1787787454.974556:0:18658:0:(import.c:65:import_set_state_nolock()) ffff9870c451d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787787454.974612:0:18658:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1787787454.974756:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4294f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:06eed6ec-d774-46ad-afc7-a8fd1799d109+4:2390:x1874630484836992:12345-192.168.204.31@tcp:9:umount.0 Request processed in 250us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787454.974764:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 33 00000100:00080000:3.0:1787787454.974782:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:3.0:1787787454.974790:0:17140:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9870c451c000: total 0 00010000:00010000:3.0:1787787454.974794:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787454.974814:0:17140:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9870c451c000, canceled 0 locks, left on hash table 1. 00002000:00010000:3.0:1787787454.974855:0:17140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787787454.974858:0:17140:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1787787440 -> 1787787441 00002000:00010000:3.0:1787787454.974861:0:17140:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1787787440 -> 1787787441 00002000:00010000:3.0:1787787454.974878:0:17140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1787787454.974901:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000551286a8/0x11620bc3f30aa6a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c869e expref: 3 pid: 18656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787454.974926:0:17140:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9870c451c000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787787454.974941:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787454.974943:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787454.974945:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787454.983831:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787454.984070:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484837888 00000100:00100000:2.0:1787787454.984080:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484837888 00000100:00100000:2.0:1787787454.984180:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 76 00000100:00100000:2.0:1787787454.984190:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+12:2390:x1874630484837888:12345-192.168.204.31@tcp:39:umount.0 00000020:00000080:2.0:1787787454.984222:0:18576:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30aa329 00000020:00010000:2.0:1787787454.984236:0:18576:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9870f0377000: total 0 00000100:00080000:2.0:1787787454.984250:0:18576:0:(import.c:65:import_set_state_nolock()) ffff9870f0374000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787787454.984278:0:18576:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000100:00100000:2.0:1787787454.984430:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06eed6ec-d774-46ad-afc7-a8fd1799d109+11:2390:x1874630484837888:12345-192.168.204.31@tcp:39:umount.0 Request processed in 241us (611us total) trans 8589934637 rc 0/0 00000100:00100000:2.0:1787787454.984438:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 76 00000020:00010000:1.0:1787787454.984931:0:17141:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9870f0377000: total 0 00010000:00010000:1.0:1787787454.984982:0:17141:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9870f0377000, canceled 0 locks, left on hash table 7. 00010000:00010000:1.0:1787787454.985020:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a1c800) 00010000:00010000:1.0:1787787454.985025:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787787454.985034:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6000/0x11620bc3f30aa448 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85da expref: 10 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787454.985055:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:1.0:1787787454.985065:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787787454.985071:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aa5f3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8666 expref: 9 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787454.985087:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9870d8b94800) 00010000:00010000:1.0:1787787454.985090:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787787454.985094:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f4800/0x11620bc3f30aa3ed lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85c5 expref: 8 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787454.985113:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9870d0b9eb00) 00010000:00010000:1.0:1787787454.985116:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787787454.985120:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6659600/0x11620bc3f30aa4cd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8604 expref: 7 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787454.985134:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9870d8b94e00) 00010000:00010000:1.0:1787787454.985171:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787787454.985176:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658400/0x11620bc3f30aa6b7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c86a5 expref: 6 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787454.985195:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9870d0b9e300) 00010000:00010000:1.0:1787787454.985198:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787787454.985202:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6658200/0x11620bc3f30aa64e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c867b expref: 5 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787454.985216:0:17141:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff986fc2a1c700) 00010000:00010000:1.0:1787787454.985218:0:17141:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787454.985222:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30aa409 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85cc expref: 4 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787454.985249:0:17141:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9870f0377000, canceled 7 locks, left on hash table 0. 00010000:00010000:1.0:1787787454.985263:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787454.985265:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787454.985266:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787787454.985628:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787454.993688:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787454.997647:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484838016 00000100:00100000:3.0:1787787454.997665:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484838016 00000100:00100000:3.0:1787787454.997770:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 77 00000100:00100000:3.0:1787787454.997784:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+5:2390:x1874630484838016:12345-192.168.204.31@tcp:39:umount.0 00000020:00000080:3.0:1787787454.997821:0:17152:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30aa322 00000100:00080000:3.0:1787787454.997842:0:17152:0:(import.c:65:import_set_state_nolock()) ffff986fc2760000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787787454.997875:0:17152:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1787787454.998119:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06eed6ec-d774-46ad-afc7-a8fd1799d109+3:2390:x1874630484838016:12345-192.168.204.31@tcp:39:umount.0 Request processed in 338us (4441us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787787454.998128:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 77 00000100:00080000:0.0:1787787454.998393:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787787454.999296:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787455.210188:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787456.237242:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787456.361509:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787787456.361515:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787787456.361547:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503784704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787787456.361548:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503784576:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787787456.362242:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503785088:0@lo:400:kworker.0 00000100:00100000:0.0:1787787456.362452:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503785216:0@lo:400:kworker.0 00000100:00100000:3.0:1787787456.366886:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787456.366939:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503784704 00000100:00100000:2.0:1787787456.366950:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503784704 00000100:00100000:3.0:1787787456.366979:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503784832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787456.367014:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787787456.367022:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787456.367028:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503784704:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787787456.367040:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503785344:0@lo:400:kworker.0 00000100:00100000:3.0:1787787456.367067:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1787787456.367077:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787787456.367107:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503785856:0@lo:400:kworker.0 00000100:00100000:2.0:1787787456.367130:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503784704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787456.367165:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787456.367165:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787787456.367188:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503784832 00000100:00100000:2.0:1787787456.367192:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503784832 00000100:00100000:3.0:1787787456.367194:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503786368:0@lo:400:kworker.0 00000100:00100000:2.0:1787787456.367219:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787787456.367229:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787456.367243:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503784832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787787456.367260:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787787456.367280:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503784704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787787456.367298:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503784832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787456.367306:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787787456.367318:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503784832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787456.367332:0:19137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503785344 00000100:00100000:2.0:1787787456.367336:0:19137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503785344 00000100:00100000:3.0:1787787456.368558:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503785856 00000100:00100000:3.0:1787787456.368569:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503785856 00000100:00100000:3.0:1787787456.368753:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787787456.368765:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503785344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787456.368852:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503785344:12345-0@lo:400:kworker.0 Request processed in 89us (1783us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787456.368860:0:19137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787787456.368939:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787456.368978:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4173c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503785600:0@lo:400:kworker.0 00000100:00100000:1.0:1787787456.369006:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787456.369026:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874630503786112:0@lo:400:kworker.0 00000100:00100000:1.0:1787787456.369051:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787456.369078:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1787787456.369085:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:655a2ac3-6e05-4716-af47-ef6019dc5f23:3654:1874630503784960:0@lo:400:kworker.0 00000100:00100000:1.0:1787787456.369113:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787456.369151:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503785472:0@lo:400:kworker.0 00000100:00100000:1.0:1787787456.369175:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787456.369193:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503785984:0@lo:400:kworker.0 00000100:00100000:1.0:1787787456.369213:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787456.369246:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874630503786496:0@lo:400:kworker.0 00000100:00100000:1.0:1787787456.369269:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787456.369298:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503786368 00000100:00100000:1.0:1787787456.369302:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503786368 00000100:00100000:1.0:1787787456.369341:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503786112 00000100:00100000:1.0:1787787456.369345:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503786112 00000100:00100000:1.0:1787787456.369359:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503785472 00000100:00100000:1.0:1787787456.369362:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503785472 00000100:00100000:1.0:1787787456.369372:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503785984 00000100:00100000:1.0:1787787456.369374:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503785984 00000100:00100000:1.0:1787787456.369384:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503786496 00000100:00100000:1.0:1787787456.369386:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503786496 00000100:00100000:1.0:1787787456.369399:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787787456.369566:0:19137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503785856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787456.369692:0:19137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503785856:12345-0@lo:400:kworker.0 Request processed in 823us (2531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787456.369723:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503786368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787456.369744:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787787456.369763:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503786368:12345-0@lo:400:kworker.0 Request processed in 356us (2533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787456.369771:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787787456.369791:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787787456.369800:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d9647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874630503786112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787456.369805:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503785344:0@lo:400:kworker.0 00000100:00100000:3.0:1787787456.369822:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503785856:0@lo:400:kworker.0 00000100:00100000:3.0:1787787456.369836:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503786368:0@lo:400:kworker.0 00000100:00100000:1.0:1787787456.369843:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d9647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874630503786112:12345-0@lo:400:kworker.0 Request processed in 44us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787456.369851:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787787456.369868:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787787456.369875:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d9647c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503785472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787456.369897:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787787456.369905:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d9647c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503785472:12345-0@lo:400:kworker.0 Request processed in 31us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787456.369910:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d96452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503785984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787456.369918:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787787456.369934:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787787456.369943:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874630503786496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787456.369959:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d96452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503785984:12345-0@lo:400:kworker.0 Request processed in 53us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787456.369967:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787787456.369982:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874630503786496:12345-0@lo:400:kworker.0 Request processed in 40us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787456.369998:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787456.370006:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787787456.370035:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503784960 00000100:00100000:1.0:1787787456.370040:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503784960 00000100:00100000:3.0:1787787456.370058:0:20292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503785088 00000100:00100000:3.0:1787787456.370063:0:20292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503785088 00000100:00100000:1.0:1787787456.370074:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787787456.370082:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:3654:x1874630503784960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787456.370103:0:20292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503785600 00000100:00100000:3.0:1787787456.370108:0:20292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503785600 00000100:00100000:1.0:1787787456.370118:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:3654:x1874630503784960:12345-0@lo:400:kworker.0 Request processed in 37us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787456.370127:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787787456.370129:0:20292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787787456.370162:0:20292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503785088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787456.370190:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787787456.370201:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503785600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787456.370207:0:20292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503785088:12345-0@lo:400:kworker.0 Request processed in 69us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787456.370214:0:20292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787787456.370239:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503784576 00000100:00100000:3.0:1787787456.370243:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503784576 00000100:00100000:1.0:1787787456.370260:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503785600:12345-0@lo:400:kworker.0 Request processed in 61us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787456.370268:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787787456.370271:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787787456.370279:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3653:x1874630503784576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787787456.370295:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787787456.370312:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4281680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:655a2ac3-6e05-4716-af47-ef6019dc5f23:3654:1874630503784960:0@lo:400:kworker.0 00000100:00100000:1.0:1787787456.370329:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503785472:0@lo:400:kworker.0 00000100:00100000:3.0:1787787456.370337:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3653:x1874630503784576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787456.370345:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503785984:0@lo:400:kworker.0 00000100:00100000:3.0:1787787456.370346:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1787787456.370367:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc3a05680 x1874630503786496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787456.370379:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874630503786496:0@lo:400:kworker.0 00000100:00100000:3.0:1787787456.370386:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503784576:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787787456.370396:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503785088:0@lo:400:kworker.0 00000100:00080000:3.0:1787787456.370422:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787787456.370427:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787787456.370429:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787787456.370431:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787787456.372573:0:19137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787787456.373419:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787456.373470:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503785728:0@lo:400:kworker.0 00000100:00100000:0.0:1787787456.373501:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787456.373515:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503786240:0@lo:400:kworker.0 00000100:00100000:0.0:1787787456.373566:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787456.373710:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503786240 00000100:00100000:0.0:1787787456.373718:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503786240 00000100:00100000:0.0:1787787456.373784:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787787456.373792:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503786240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787456.373837:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503786240:12345-0@lo:400:kworker.0 Request processed in 45us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787456.373843:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:0.0:1787787456.373880:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc41cf0c0 x1874630503786240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787456.373892:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503786240:0@lo:400:kworker.0 00000100:00080000:3.0:1787787456.374275:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787787456.374291:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503785216 00000100:00100000:3.0:1787787456.374296:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503785216 00000100:00100000:3.0:1787787456.374342:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503785728 00000100:00100000:3.0:1787787456.374346:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503785728 00000100:00100000:3.0:1787787456.374375:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787787456.374384:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503785216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787456.374432:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503785216:12345-0@lo:400:kworker.0 Request processed in 49us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787456.374448:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787787456.374463:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787787456.374469:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503785728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787456.374501:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503785728:12345-0@lo:400:kworker.0 Request processed in 33us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787456.374507:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1787787456.374524:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787456.376251:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4173c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503785600:0@lo:400:kworker.0 00000100:00100000:1.0:1787787456.376407:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874630503786112:0@lo:400:kworker.0 00000100:00100000:0.0:1787787456.376468:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503785216:0@lo:400:kworker.0 00000100:00100000:0.0:1787787456.376486:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503785728:0@lo:400:kworker.0 00010000:00010000:1.0:1787787457.257549:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787457.412808:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787457.412851:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787457.412944:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787457.416593:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484838144 00000100:00100000:0.0:1787787457.416609:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484838144 00000100:00100000:0.0:1787787457.416691:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484838400 00000100:00100000:0.0:1787787457.416695:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484838400 00000100:00100000:0.0:1787787457.416709:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484838272 00000100:00100000:0.0:1787787457.416712:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484838272 00000100:00100000:0.0:1787787457.416732:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7 00000100:00100000:0.0:1787787457.416741:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66978c8d-7aad-4ae0-adce-30a3922603d6+12:2394:x1874630484838144:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787457.416758:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787457.416779:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9871021c7000/0x11620bc3f30aa34c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8547 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787457.416799:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787457.416877:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66978c8d-7aad-4ae0-adce-30a3922603d6+11:2394:x1874630484838144:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 136us (4079us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787457.416885:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7 00000100:00100000:0.0:1787787457.416903:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8 00000100:00100000:0.0:1787787457.416911:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ead00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66978c8d-7aad-4ae0-adce-30a3922603d6+10:2394:x1874630484838400:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787457.416919:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787457.416928:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c0031e00/0x11620bc3f30aa392 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85b7 expref: 10 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787457.416939:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787457.416957:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ead00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66978c8d-7aad-4ae0-adce-30a3922603d6+9:2394:x1874630484838400:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 47us (4105us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787457.416964:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8 00000100:00100000:0.0:1787787457.416977:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9 00000100:00100000:0.0:1787787457.416983:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66978c8d-7aad-4ae0-adce-30a3922603d6+8:2394:x1874630484838272:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787457.416991:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787457.417000:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c0030800/0x11620bc3f30aa353 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8578 expref: 8 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787457.417009:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787787457.417026:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66978c8d-7aad-4ae0-adce-30a3922603d6+7:2394:x1874630484838272:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 43us (4084us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787457.417032:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9 00000100:00100000:0.0:1787787457.417911:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787457.421497:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484838656 00000100:00100000:1.0:1787787457.421525:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484838656 00000100:00100000:1.0:1787787457.421632:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 78 00000100:00100000:1.0:1787787457.421642:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+6:2390:x1874630484838656:12345-192.168.204.31@tcp:39:umount.0 00000020:00000080:1.0:1787787457.421686:0:17154:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30aa361 00000020:00010000:1.0:1787787457.421698:0:17154:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9870f0374800: total 0 00000100:00080000:1.0:1787787457.421703:0:17154:0:(import.c:65:import_set_state_nolock()) ffff9870f0371000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787787457.421729:0:17154:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00100000:1.0:1787787457.421896:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+5:2390:x1874630484838656:12345-192.168.204.31@tcp:39:umount.0 Request processed in 255us (3989us total) trans 8589934638 rc 0/0 00000100:00100000:1.0:1787787457.421904:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 78 00000020:00010000:1.0:1787787457.421950:0:17140:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9870f0374800: total 0 00010000:00010000:1.0:1787787457.421954:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787457.421995:0:17140:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9870f0374800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787787457.422029:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a1c800) 00010000:00010000:1.0:1787787457.422047:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787787457.422057:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30aa456 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c85e1 expref: 4 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787457.422079:0:17140:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9870f0374800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787787457.422090:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787457.422092:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787457.422094:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787787457.422861:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787457.435770:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787457.435870:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484838784 00000100:00100000:3.0:1787787457.435881:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484838784 00000100:00100000:3.0:1787787457.435955:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 79 00000100:00100000:3.0:1787787457.435965:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+5:2390:x1874630484838784:12345-192.168.204.31@tcp:39:umount.0 00000020:00000080:3.0:1787787457.436009:0:18576:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30aa368 00000100:00080000:3.0:1787787457.436020:0:18576:0:(import.c:65:import_set_state_nolock()) ffff9870f0376000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787787457.436054:0:18576:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1787787457.436212:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72f0a557-2c5a-424e-9fbb-a30d283f0eb0+3:2390:x1874630484838784:12345-192.168.204.31@tcp:39:umount.0 Request processed in 248us (452us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787787457.436221:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 79 00010000:00010000:2.0:1787787457.436390:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787787457.436444:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787787457.473544:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787457.473642:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484839040 00000100:00100000:0.0:1787787457.473666:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484839040 00000100:00100000:0.0:1787787457.473725:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 174 00000100:00100000:0.0:1787787457.473736:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66978c8d-7aad-4ae0-adce-30a3922603d6+7:2390:x1874630484839040:12345-192.168.204.31@tcp:251:umount.0 00000020:00000080:0.0:1787787457.473785:0:17145:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30aa2ff 00000020:00010000:0.0:1787787457.473793:0:17145:0:(genops.c:1921:obd_stale_export_put()) Put export ffff986fc4388800: total 0 00000100:00080000:0.0:1787787457.473798:0:17145:0:(import.c:65:import_set_state_nolock()) ffff986fc4389000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787787457.473880:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66978c8d-7aad-4ae0-adce-30a3922603d6+3:2390:x1874630484839040:12345-192.168.204.31@tcp:251:umount.0 Request processed in 145us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787457.473888:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 174 00000020:00010000:2.0:1787787457.473999:0:17140:0:(genops.c:1907:obd_stale_export_get()) Get export ffff986fc4388800: total 0 00010000:00010000:2.0:1787787457.474053:0:17140:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff986fc4388800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787787457.474088:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c7c15c00/0x11620bc3f30aa306 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c84d0 expref: 2 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787457.474103:0:17140:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff986fc4388800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1787787457.474114:0:17140:0:(genops.c:885:class_export_put()) final put ffff986fc4388800/66978c8d-7aad-4ae0-adce-30a3922603d6 00010000:00010000:2.0:1787787457.474135:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787457.474179:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787457.474181:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787787457.474423:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc4388800/66978c8d-7aad-4ae0-adce-30a3922603d6 for MGS 00000020:00000080:0.0:1787787457.474464:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff986fc4389000 for MGS 00010000:00010000:3.0:1787787458.281699:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787458.420337:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503786624:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787787458.420409:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787458.420468:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503786624 00000100:00100000:0.0:1787787458.420475:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503786624 00000100:00100000:0.0:1787787458.420549:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787787458.420558:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503786624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787787458.420588:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787787458.420638:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503786624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787458.420645:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1787787458.420666:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787458.420703:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503786624:0@lo:13:osp-pre-0-1.0 00000020:01000004:0.0:1787787459.261071:0:20723:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787787459.276759:0:20723:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1787787459.276814:0:20723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14c00/0x11620bc3f30a9ec2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9ec9 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787459.276848:0:20723:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14c00/0x11620bc3f30a9ec2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a9ec9 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787459.276855:0:20723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14c00/0x11620bc3f30a9ec2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a9ec9 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787459.276863:0:20723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff9870c7c14c00/0x11620bc3f30a9ec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a9ec9 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787459.276882:0:20723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787787459.276888:0:20723:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787787459.276912:0:20723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787787459.276916:0:20723:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787787459.276922:0:20723:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787787459.276947:0:20723:0:(import.c:65:import_set_state_nolock()) ffff986fc3a44000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787787459.276980:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874630503786752:0@lo:39:umount.0 00010000:00010000:2.0:1787787459.276995:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787459.277002:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c7c14c00/0x11620bc3f30a9ec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a9ec9 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787459.277011:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14c00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787459.277014:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c14c00/0x11620bc3f30a9ec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a9ec9 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787459.277022:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c7c14c00/0x11620bc3f30a9ec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30a9ec9 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787459.277028:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c14c00/0x11620bc3f30a9ec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30a9ec9 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787459.277040:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787787459.277057:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787459.277109:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503786752 00000100:00100000:1.0:1787787459.277117:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503786752 00000100:00100000:1.0:1787787459.277179:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787787459.277194:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874630503786752:12345-0@lo:39:umount.0 10000000:01000000:2.0:1787787459.277195:0:17140:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787787459.277197:0:17140:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000020:00000080:1.0:1787787459.277221:0:17154:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9ef3 00010000:00010000:2.0:1787787459.277223:0:17140:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c7c14c00/0x11620bc3f30a9ec2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a9ec9 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787787459.277228:0:17154:0:(import.c:65:import_set_state_nolock()) ffff9870ff9bb800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787787459.277229:0:17140:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787459.277246:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c7c14c00/0x11620bc3f30a9ec2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a9ec9 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787459.277252:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c7c14c00/0x11620bc3f30a9ec2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a9ec9 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787459.277264:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787459.277265:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787459.277267:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787459.277285:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3652:x1874630503786752:12345-0@lo:39:umount.0 Request processed in 99us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787459.277293:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:1.0:1787787459.277303:0:17154:0:(genops.c:885:class_export_put()) final put ffff986fc4157800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787787459.277334:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc4157800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787787459.277378:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870ff9bb800 for lustre-MDT0000 00000100:00080000:1.0:1787787459.277409:0:3652:0:(import.c:65:import_set_state_nolock()) ffff986fc3a44000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787787459.277415:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874630503786752:0@lo:39:umount.0 00000100:00080000:1.0:1787787459.277434:0:20723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787787459.277437:0:20723:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787787459.277440:0:20723:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787787459.278193:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787459.278253:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:655a2ac3-6e05-4716-af47-ef6019dc5f23:3655:1874630503786880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787459.278307:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787787459.278948:0:20723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee2600/0x11620bc3f30a9e13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9e1a expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787459.278961:0:20723:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee2600/0x11620bc3f30a9e13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a9e1a expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787459.278968:0:20723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee2600/0x11620bc3f30a9e13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a9e1a expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787459.278974:0:20723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff987101ee2600/0x11620bc3f30a9e13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a9e1a expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787459.278981:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503786880 00000100:00100000:3.0:1787787459.278990:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503786880 00010000:00010000:1.0:1787787459.278994:0:20723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787787459.279001:0:20723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30aa2f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa2f8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787459.279008:0:20723:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30aa2f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa2f8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787459.279013:0:20723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30aa2f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30aa2f8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787459.279036:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787787459.279036:0:20723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30aa2f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30aa2f8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787459.279047:0:20723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787787459.279054:0:20723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa3ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa3d1 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787459.279060:0:20723:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa3ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa3d1 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787459.279066:0:20723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa3ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30aa3d1 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787459.279072:0:20723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa3ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30aa3d1 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787459.279079:0:20723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787787459.279083:0:20723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee3600/0x11620bc3f30a9e05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9e0c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787459.279089:0:20723:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee3600/0x11620bc3f30a9e05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a9e0c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787459.279096:0:20723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee3600/0x11620bc3f30a9e05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a9e0c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787459.279102:0:20723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff987101ee3600/0x11620bc3f30a9e05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a9e0c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787459.279120:0:20723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1787787459.279124:0:20723:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1787787459.279172:0:20723:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1787787459.279177:0:20723:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1787787459.279181:0:20723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787787459.279187:0:20723:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1787787459.279193:0:20723:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9870f03b9800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787787459.279199:0:20723:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff986fc240d800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787787459.279203:0:20723:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9870f576e000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787787459.279207:0:20723:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9870c3eca800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787787459.279213:0:20723:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9870f0374800 72f0a557-2c5a-424e-9fbb-a30d283f0eb0 192.168.204.31@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:1.0:1787787459.279218:0:20723:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9870f0377000 06eed6ec-d774-46ad-afc7-a8fd1799d109 192.168.204.31@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934636 stale:0 00000020:00080000:1.0:1787787459.279222:0:20723:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff986fc38c3370) has exports, disconnecting them 00000020:00080000:1.0:1787787459.279227:0:20723:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9870f03b9800), last request at 1787787456 00000020:00000080:1.0:1787787459.279234:0:20723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30aa131 00000100:00080000:1.0:1787787459.279254:0:20723:0:(import.c:65:import_set_state_nolock()) ffff9870f03bb000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787787459.279310:0:20723:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9870f03b9800): rc 0 00000020:00000080:1.0:1787787459.279313:0:20723:0:(genops.c:885:class_export_put()) final put ffff9870f03b9800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1787787459.279324:0:20723:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff986fc240d800), last request at 1787787456 00000020:00000080:1.0:1787787459.279326:0:20723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30aa090 00000100:00080000:1.0:1787787459.279332:0:20723:0:(import.c:65:import_set_state_nolock()) ffff986fc2409000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787787459.279338:0:20723:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff986fc240d800): rc 0 00000020:00000080:1.0:1787787459.279340:0:20723:0:(genops.c:885:class_export_put()) final put ffff986fc240d800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1787787459.279344:0:20723:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9870f576e000), last request at 1787787382 00000020:00000080:1.0:1787787459.279346:0:20723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9fe1 00000100:00080000:1.0:1787787459.279356:0:20723:0:(import.c:65:import_set_state_nolock()) ffff9870f5769800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787787459.279363:0:20723:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9870f576e000): rc 0 00000020:00000080:1.0:1787787459.279365:0:20723:0:(genops.c:885:class_export_put()) final put ffff9870f576e000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1787787459.279369:0:20723:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9870c3eca800), last request at 1787787382 00000020:00000080:1.0:1787787459.279373:0:20723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9f86 00000100:00080000:1.0:1787787459.279376:0:20723:0:(import.c:65:import_set_state_nolock()) ffff9870fc38e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787787459.279382:0:20723:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000020:00080000:1.0:1787787459.279461:0:20723:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9870c3eca800): rc 0 00000004:00000080:1.0:1787787459.279466:0:20723:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa622456e7ae0 00000100:00080000:1.0:1787787459.279494:0:20723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787787459.279497:0:20723:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00100000:3.0:1787787459.279695:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5baf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:655a2ac3-6e05-4716-af47-ef6019dc5f23+24:3655:x1874630503786880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787787459.279710:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787459.279728:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c7c14a00/0x11620bc3f30a9ec9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30a9ec2 expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787459.279751:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:2.0:1787787459.280170:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f03b9800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787787459.280229:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc240d800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787787459.280250:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f576e000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787787459.280273:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870f03bb000 for lustre-MDT0000 00000020:00000080:2.0:1787787459.280277:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff986fc2409000 for lustre-MDT0000 00000020:00000080:2.0:1787787459.280280:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870f5769800 for lustre-MDT0000 00010000:00010000:2.0:1787787459.280291:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787787459.280296:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff987101ee2600/0x11620bc3f30a9e13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a9e1a expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787459.280316:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2600 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787459.280320:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff987101ee2600/0x11620bc3f30a9e13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a9e1a expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787459.280329:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff987101ee2600/0x11620bc3f30a9e13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30a9e1a expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787459.280336:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff987101ee2600/0x11620bc3f30a9e13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30a9e1a expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787459.280342:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787787459.280344:0:17140:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1787787459.280347:0:17140:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1787787459.280373:0:17140:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff987101ee2600/0x11620bc3f30a9e13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a9e1a expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787459.280379:0:17140:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787459.280399:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff987101ee2600/0x11620bc3f30a9e13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a9e1a expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787459.280405:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff987101ee2600/0x11620bc3f30a9e13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a9e1a expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787459.280418:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787787459.280421:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30aa2f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30aa2f8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787459.280426:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2c00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787459.280429:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30aa2f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30aa2f8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787459.280441:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30aa2f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30aa2f8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787459.280446:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30aa2f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30aa2f8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787459.280451:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787787459.280452:0:17140:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1787787459.280454:0:17140:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787787459.280468:0:17140:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30aa2f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30aa2f8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787459.280473:0:17140:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787459.280502:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30aa2f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30aa2f8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787459.280508:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff987101ee2c00/0x11620bc3f30aa2f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30aa2f8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787459.280517:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787787459.280520:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa3ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30aa3d1 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787459.280525:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14800 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787459.280527:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa3ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30aa3d1 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787459.280533:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa3ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30aa3d1 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787459.280549:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa3ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30aa3d1 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787459.280554:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787787459.280556:0:17140:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787787459.280557:0:17140:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787787459.280571:0:17140:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa3ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30aa3d1 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787459.280758:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5baf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:655a2ac3-6e05-4716-af47-ef6019dc5f23+23:3655:x1874630503786880:12345-0@lo:103:ldlm_bl.0 Request processed in 1712us (2449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787459.281250:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787787459.281320:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787459.281452:0:20724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787459.281458:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff987101ee3600/0x11620bc3f30a9e05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a9e0c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787459.281466:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3600 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:3.0:1787787459.281470:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff987101ee3600/0x11620bc3f30a9e05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a9e0c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787459.281478:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff987101ee3600/0x11620bc3f30a9e05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30a9e0c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787459.281497:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff987101ee3600/0x11620bc3f30a9e05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30a9e0c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787459.281502:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787787459.281504:0:17141:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787787459.281506:0:17141:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787787459.281523:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff987101ee3600/0x11620bc3f30a9e05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a9e0c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787459.281528:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787787459.281535:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff987101ee3600/0x11620bc3f30a9e05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a9e0c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787459.281555:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff987101ee3600/0x11620bc3f30a9e05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a9e0c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787459.281565:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787459.281566:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787459.281568:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787787459.282080:0:20723:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787787459.282099:0:20723:0:(import.c:65:import_set_state_nolock()) ffff9870ff9bd800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787787459.282158:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503787520:0@lo:39:umount.0 00010000:00010000:2.0:1787787459.282695:0:17140:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787459.282709:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa3ca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30aa3d1 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787459.282716:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c7c14800/0x11620bc3f30aa3ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30aa3d1 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787459.282732:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787459.282734:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787459.282736:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787459.282751:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:655a2ac3-6e05-4716-af47-ef6019dc5f23:3653:1874630503787136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787459.282911:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787459.282973:0:20292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503787520 00000100:00100000:1.0:1787787459.282979:0:20292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503787520 00000100:00100000:1.0:1787787459.283021:0:20292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787787459.283028:0:20292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874630503787520:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787787459.283058:0:20292:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30aa00b 00000100:00080000:1.0:1787787459.283066:0:20292:0:(import.c:65:import_set_state_nolock()) ffff9870c7f36800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787787459.283668:0:20724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1787787459.283668:0:20292:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:3.0:1787787459.283672:0:20724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787459.283748:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787459.283865:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503787136 00000100:00100000:3.0:1787787459.283870:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503787136 00000100:00100000:3.0:1787787459.283907:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787787459.283915:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f78f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:655a2ac3-6e05-4716-af47-ef6019dc5f23+23:3653:x1874630503787136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787787459.283927:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787459.283947:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c7c14400/0x11620bc3f30aa2f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30aa2f1 expref: 23 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787459.283962:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787459.284804:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f78f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:655a2ac3-6e05-4716-af47-ef6019dc5f23+22:3653:x1874630503787136:12345-0@lo:103:ldlm_bl.0 Request processed in 886us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787459.284814:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787787459.286507:0:20292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3652:x1874630503787520:12345-0@lo:39:umount.0 Request processed in 3470us (3589us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787787459.286523:0:20292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:1.0:1787787459.286770:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787459.287309:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:655a2ac3-6e05-4716-af47-ef6019dc5f23:3656:1874630503787008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787459.287378:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787459.287427:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787787459.287434:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:655a2ac3-6e05-4716-af47-ef6019dc5f23:3656:1874630503787264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787459.287457:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787459.287502:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503787008 00000100:00100000:1.0:1787787459.287509:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503787008 00000100:00100000:1.0:1787787459.287552:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503787264 00000100:00100000:1.0:1787787459.287555:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503787264 00000100:00100000:1.0:1787787459.287578:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787787459.287684:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787787459.287695:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a05680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:655a2ac3-6e05-4716-af47-ef6019dc5f23+23:3656:x1874630503787264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787787459.287711:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787459.287732:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c13f4400/0x11620bc3f30aa3d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30aa3ca expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787459.287751:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787459.287805:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a05680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:655a2ac3-6e05-4716-af47-ef6019dc5f23+22:3656:x1874630503787264:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787459.287812:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787787459.288222:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:655a2ac3-6e05-4716-af47-ef6019dc5f23:3654:1874630503787392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787787459.288254:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787459.288304:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:655a2ac3-6e05-4716-af47-ef6019dc5f23:3655:1874630503786880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787459.288320:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4173c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:3656:x1874630503787008:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787787459.288327:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503787392 00000100:00100000:3.0:1787787459.288330:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503787392 00010000:00010000:1.0:1787787459.288330:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787459.288341:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc39f3e00/0x11620bc3f30a9e1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30a9e13 expref: 22 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787459.288348:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1787787459.288352:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787459.288354:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:655a2ac3-6e05-4716-af47-ef6019dc5f23+21:3654:x1874630503787392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787787459.288360:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787459.288368:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc43e0800/0x11620bc3f30a9e0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30a9e05 expref: 21 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787459.288376:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4173c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:655a2ac3-6e05-4716-af47-ef6019dc5f23+20:3656:x1874630503787008:12345-0@lo:103:ldlm_bl.0 Request processed in 792us (999us total) trans 0 rc 0/0 00010000:00010000:3.0:1787787459.288377:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787459.288383:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787787459.288400:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:655a2ac3-6e05-4716-af47-ef6019dc5f23+19:3654:x1874630503787392:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787459.288406:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787787459.288412:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:655a2ac3-6e05-4716-af47-ef6019dc5f23:3656:1874630503787264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787459.288420:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:655a2ac3-6e05-4716-af47-ef6019dc5f23:3656:1874630503787008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787787459.288426:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:655a2ac3-6e05-4716-af47-ef6019dc5f23:3654:1874630503787392:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787787459.288686:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870ff9bd800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787787459.288695:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503787520:0@lo:39:umount.0 00000100:00100000:2.0:1787787459.289971:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:655a2ac3-6e05-4716-af47-ef6019dc5f23:3653:1874630503787136:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787787459.290425:0:20723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787787459.290445:0:20723:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1787787459.290511:0:20723:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787787459.290585:0:20723:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787787459.290611:0:20723:0:(import.c:65:import_set_state_nolock()) ffff9870c3ecd000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787787459.290634:0:20723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787787459.290637:0:20723:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1787787459.290657:0:20723:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787787459.290734:0:20723:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787787459.290745:0:20723:0:(import.c:65:import_set_state_nolock()) ffff987101e37800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787787459.290868:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503787648:0@lo:9:umount.0 00000100:00100000:3.0:1787787459.290928:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787459.290955:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503787776:0@lo:9:umount.0 00000100:00100000:3.0:1787787459.290975:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787459.291010:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503787648 00000100:00100000:3.0:1787787459.291018:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503787648 00000100:00100000:3.0:1787787459.291086:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503787776 00000100:00100000:3.0:1787787459.291097:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503787776 00000100:00100000:3.0:1787787459.291155:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787787459.291165:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3652:x1874630503787648:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787787459.291191:0:19542:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30aa14d 00000100:00080000:3.0:1787787459.291200:0:19542:0:(import.c:65:import_set_state_nolock()) ffff9870f03b9000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787787459.291244:0:19542:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1787787459.291350:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3652:x1874630503787648:12345-0@lo:9:umount.0 Request processed in 187us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787459.291357:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787787459.291371:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787787459.291376:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3652:x1874630503787776:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787787459.291386:0:19542:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30aa154 00000100:00080000:3.0:1787787459.291390:0:19542:0:(import.c:65:import_set_state_nolock()) ffff9870f03be000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787787459.291411:0:19542:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1787787459.291500:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3652:x1874630503787776:12345-0@lo:9:umount.0 Request processed in 123us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787459.291506:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1787787459.291538:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870c3ecd000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787787459.291738:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787787459.291742:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:0.0:1787787459.291752:0:20723:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff986fc38c3370) has no exports 00000004:00080000:3.0:1787787459.292910:0:3652:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787787459.292917:0:3652:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787787459.292924:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503787648:0@lo:9:umount.0 00000100:00080000:3.0:1787787459.292952:0:3652:0:(import.c:65:import_set_state_nolock()) ffff987101e37800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787787459.292961:0:3652:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787787459.292963:0:3652:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787787459.292965:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503787776:0@lo:9:umount.0 00010000:00010000:3.0:1787787459.292997:0:20724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787459.293033:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787787459.297408:0:20723:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff986fc38c3370) has no exports 00010000:00010000:3.0:1787787459.305373:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787787459.344660:0:20723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9e60 00000020:00000080:0.0:1787787459.344677:0:20723:0:(genops.c:885:class_export_put()) final put ffff9870c5463000/lustre-QMT0000_UUID 00000020:01000000:0.0:1787787459.344697:0:20723:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1787787459.345419:0:20723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787787459.345432:0:20723:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787787459.345436:0:20723:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff987101db3370) has no exports 00000020:00000080:2.0:1787787459.345796:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870c5463000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1787787459.346718:0:20723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9e59 00000020:00000080:1.0:1787787459.346729:0:20723:0:(genops.c:885:class_export_put()) final put ffff9870c7f36000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787787459.346811:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870c7f36000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787787459.346913:0:20723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787787459.346924:0:20723:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787787459.346934:0:20723:0:(genops.c:885:class_export_put()) final put ffff9870c3570000/lustre-QMT0000_UUID 00000020:00000080:1.0:1787787459.346937:0:20723:0:(genops.c:844:class_export_destroy()) destroying export ffff9870c3570000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1787787459.346946:0:20723:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:1.0:1787787459.433436:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503787904:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787787459.433528:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787459.433741:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503787904 00000100:00100000:2.0:1787787459.433750:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503787904 00000100:00100000:2.0:1787787459.433793:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787787459.433801:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3656:x1874630503787904:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1787787459.433810:0:17157:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787787459.434097:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3656:x1874630503787904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 295us (568us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787787459.434106:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:02020000:0.0:1787787459.434329:0:3656:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1787787459.441182:0:3656:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787787459.441192:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9870fc38a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787787459.441197:0:3656:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787787459.457813:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9870fc38a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787787459.457828:0:3656:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 526 00000100:00080000:0.0:1787787459.457848:0:3656:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9870fc38a800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:0.0:1787787459.457893:0:3656:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc43fad00 x1874630503788032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787787459.458004:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503788032:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1787787459.458092:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787459.459723:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503788032 00000100:00100000:0.0:1787787459.459735:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503788032 00000100:00100000:0.0:1787787459.459789:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787787459.459811:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4281680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3652:x1874630503788032:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1787787459.459830:0:17158:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787787459.463087:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4281680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3652:x1874630503788032:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 3267us (4986us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787787459.463101:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1787787459.463819:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870fc38a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787787459.463826:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787787459.463830:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503788032:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:3.0:1787787460.329386:0:20724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787787460.972392:0:18653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787787460.972401:0:18653:0:(genops.c:885:class_export_put()) final put ffff9870f03be800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787787460.972421:0:18653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 06eed6ec-d774-46ad-afc7-a8fd1799d109 00000020:00000080:1.0:1787787460.972424:0:18653:0:(genops.c:885:class_export_put()) final put ffff9870c451c000/06eed6ec-d774-46ad-afc7-a8fd1799d109 00000001:00100000:0.0:1787787460.972867:0:17884:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787787460.972878:0:17884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1787787460.972882:0:17884:0:(genops.c:885:class_export_put()) final put ffff9870c4531000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787787460.972889:0:17884:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 72f0a557-2c5a-424e-9fbb-a30d283f0eb0 00000001:00080000:0.0:1787787460.972893:0:17884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1787787460.972895:0:17884:0:(genops.c:885:class_export_put()) final put ffff9870f0375800/72f0a557-2c5a-424e-9fbb-a30d283f0eb0 00000001:00100000:0.0:1787787460.972900:0:17884:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 06eed6ec-d774-46ad-afc7-a8fd1799d109 00000001:00080000:0.0:1787787460.972903:0:17884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1787787460.972905:0:17884:0:(genops.c:885:class_export_put()) final put ffff986fc2765000/06eed6ec-d774-46ad-afc7-a8fd1799d109 00000020:00000080:3.0:1787787460.973040:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f03be800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787787460.973102:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870c451c000/06eed6ec-d774-46ad-afc7-a8fd1799d109 for lustre-OST0000 00000020:00000080:3.0:1787787460.973326:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870c4531000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1787787460.973357:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f0375800/72f0a557-2c5a-424e-9fbb-a30d283f0eb0 for lustre-MDT0001 00000020:00000080:3.0:1787787460.973382:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc2765000/06eed6ec-d774-46ad-afc7-a8fd1799d109 for lustre-MDT0001 00000020:00000080:3.0:1787787460.973402:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870f03b9000 for lustre-OST0000 00000020:00000080:3.0:1787787460.973406:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870c451d000 for lustre-OST0000 00000020:00000080:3.0:1787787460.973409:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870c7f36800 for lustre-MDT0001 00000020:00000080:3.0:1787787460.973412:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870f0376000 for lustre-MDT0001 00000020:00000080:3.0:1787787460.973416:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff986fc2760000 for lustre-MDT0001 00000001:00100000:3.0:1787787460.974599:0:17132:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787787460.974606:0:17132:0:(genops.c:885:class_export_put()) final put ffff9870c3eca800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1787787460.974629:0:17132:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 72f0a557-2c5a-424e-9fbb-a30d283f0eb0 00000001:00080000:3.0:1787787460.974635:0:17132:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934638 is committed 00000020:00000080:3.0:1787787460.974638:0:17132:0:(genops.c:885:class_export_put()) final put ffff9870f0374800/72f0a557-2c5a-424e-9fbb-a30d283f0eb0 00000001:00100000:3.0:1787787460.974644:0:17132:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 06eed6ec-d774-46ad-afc7-a8fd1799d109 00000001:00080000:3.0:1787787460.974649:0:17132:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:3.0:1787787460.974651:0:17132:0:(genops.c:885:class_export_put()) final put ffff9870f0377000/06eed6ec-d774-46ad-afc7-a8fd1799d109 00000020:00000080:2.0:1787787460.974705:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9870c3eca800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1787787460.974759:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f0374800/72f0a557-2c5a-424e-9fbb-a30d283f0eb0 for lustre-MDT0000 00000020:00000080:2.0:1787787460.974780:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f0377000/06eed6ec-d774-46ad-afc7-a8fd1799d109 for lustre-MDT0000 00000020:00000080:2.0:1787787460.974811:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870fc38e000 for lustre-MDT0000 00000020:00000080:2.0:1787787460.974818:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870f0371000 for lustre-MDT0000 00000020:00000080:2.0:1787787460.974821:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870f0374000 for lustre-MDT0000 00010000:00010000:1.0:1787787461.354713:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787787461.354794:0:20723:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9870d84d5060 - data ffff9870f06975e8/ffff986fc4383000 00000020:01000000:2.0:1787787461.354955:0:20723:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff986fc3be2f00 - data ffff9870f0762000/ffff9870f67c7800 00000001:00000004:2.0:1787787461.361573:0:20723:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000100:00080000:2.0:1787787461.404543:0:20723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787787461.404554:0:20723:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787787461.404570:0:20723:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9870c327d2c0 x1874630503787520/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787787469 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787461.404598:0:20723:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787787461.406465:0:20723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787787461.406471:0:20723:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:2.0:1787787461.406490:0:20723:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787787461.406493:0:20723:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787787461.406731:0:17176:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787787461.406736:0:17176:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:0.0:1787787461.406747:0:17176:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1787787461.407256:0:20723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787787461.407260:0:20723:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1787787461.407270:0:20723:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787787461.407272:0:20723:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787787461.407497:0:17178:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787787461.407501:0:17178:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:0.0:1787787461.407511:0:17178:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1787787461.408309:0:20723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9e28 00000020:00000080:2.0:1787787461.408319:0:20723:0:(genops.c:885:class_export_put()) final put ffff986fc43a4800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787787461.408913:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc43a4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787787461.409851:0:20723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9e3d 00000020:00000080:2.0:1787787461.409859:0:20723:0:(genops.c:885:class_export_put()) final put ffff9870e1a0c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787787461.409894:0:20723:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787787461.409899:0:20723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787787461.409907:0:20723:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787787461.409912:0:20723:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff986fc38c19b8) has no exports 00000004:01000000:2.0:1787787461.410056:0:20723:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787787461.410063:0:20723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9e9f 00000020:00000080:2.0:1787787461.410068:0:20723:0:(genops.c:885:class_export_put()) final put ffff986fc3418000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787787461.410071:0:20723:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787787461.410075:0:20723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787787461.410079:0:20723:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787787461.410081:0:20723:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9870f55f3370) has no exports 00000020:00000080:2.0:1787787461.410087:0:20723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9e98 00000020:00000080:2.0:1787787461.410090:0:20723:0:(genops.c:885:class_export_put()) final put ffff987101e31800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787787461.410450:0:20723:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787787461.410455:0:20723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787787461.410458:0:20723:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:2.0:1787787461.410463:0:20723:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787787461.410465:0:20723:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787787461.410507:0:20723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787787461.410513:0:20723:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787787461.410519:0:20723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9e8a 00000020:00000080:2.0:1787787461.410523:0:20723:0:(genops.c:885:class_export_put()) final put ffff987101e31000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787787461.410526:0:20723:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787787461.410530:0:20723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787787461.410532:0:20723:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787787461.410534:0:20723:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9870fc368000) has no exports 00000020:00000080:2.0:1787787461.410538:0:20723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9e83 00000020:00000080:2.0:1787787461.410540:0:20723:0:(genops.c:885:class_export_put()) final put ffff9870c3ece000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787787461.410845:0:20723:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787787461.410848:0:20723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787787461.410850:0:20723:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:2.0:1787787461.410853:0:20723:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787787461.410861:0:20723:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787787461.410884:0:20723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787787461.410888:0:20723:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1787787461.410898:0:20723:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1787787461.410902:0:20723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9e75 00000020:00000080:2.0:1787787461.410907:0:20723:0:(genops.c:885:class_export_put()) final put ffff9870c3ec8000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787787461.410910:0:20723:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1787787461.410913:0:20723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787787461.410917:0:20723:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787787461.410919:0:20723:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9870f55f19b8) has no exports 00000020:00000080:2.0:1787787461.410922:0:20723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9e6e 00000020:00000080:2.0:1787787461.410925:0:20723:0:(genops.c:885:class_export_put()) final put ffff9870ff9bc800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787787461.411454:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870e1a0c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1787787461.411756:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc3418000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787787461.411763:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff987101e31800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787787461.411768:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff987101e37800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787787461.411773:0:38:0:(genops.c:885:class_export_put()) final put ffff987101e36800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787787461.411775:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff987101e36800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787787461.411779:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787787461.411930:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff987101e31000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787787461.411939:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870c3ece000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787787461.411945:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870c3ecd000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787787461.411949:0:38:0:(genops.c:885:class_export_put()) final put ffff9870c3ecf000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787787461.411951:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870c3ecf000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787787461.411956:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787787461.411986:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870c3ec8000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787787461.411990:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870ff9bc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787787461.414223:0:20723:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1787787461.414232:0:20723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787787461.414237:0:20723:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787787461.414243:0:20723:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787787461.414287:0:20723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787787461.414297:0:20723:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787787461.414335:0:20723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787787461.414338:0:20723:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787787461.414342:0:20723:0:(genops.c:885:class_export_put()) final put ffff986fc43a0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787787461.414346:0:20723:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc43a0800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787787461.414353:0:20723:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787787461.414432:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870ff9bd800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787787461.414450:0:38:0:(genops.c:885:class_export_put()) final put ffff986fc3a41000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787787461.414453:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc3a41000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1787787461.414457:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787787461.414721:0:20723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9e44 00000020:00000080:3.0:1787787461.414729:0:20723:0:(genops.c:885:class_export_put()) final put ffff986fc43a4000/lustre-MDD0000_UUID 00000020:01000000:3.0:1787787461.414770:0:20723:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1787787461.414774:0:20723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787787461.414779:0:20723:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787787461.414783:0:20723:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff986fc38c0000) has no exports 00000020:00000080:3.0:1787787461.414803:0:20723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787787461.414805:0:20723:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1787787461.414809:0:20723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9e4b 00000020:00000080:3.0:1787787461.414812:0:20723:0:(genops.c:885:class_export_put()) final put ffff986fc43a0000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787787461.414868:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc43a4000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1787787461.414873:0:38:0:(genops.c:885:class_export_put()) final put ffff986fc43a2800/lustre-MDD0000_UUID 00000020:00000080:0.0:1787787461.414875:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc43a2800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1787787461.414882:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:3.0:1787787461.414967:0:20723:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9870c5465000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1787787461.414970:0:20723:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9870c5465000 3 00000020:01000004:3.0:1787787461.414973:0:20723:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9870c5465000 from lustre-MDT0000 00000020:00000080:3.0:1787787461.414993:0:20723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787787461.414997:0:20723:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1787787461.414999:0:20723:0:(genops.c:885:class_export_put()) final put ffff986fc43a7800/lustre-MDT0000_UUID 00000020:00000080:3.0:1787787461.415001:0:20723:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc43a7800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1787787461.415007:0:20723:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1787787461.415037:0:20723:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1787787461.415041:0:20723:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1787787461.415043:0:20723:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1787787461.415046:0:20723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787787461.415048:0:20723:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787787461.415055:0:20723:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff986fc2a12000 655a2ac3-6e05-4716-af47-ef6019dc5f23 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787787461.415060:0:20723:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff987101db0000) has exports, disconnecting them 00000020:00080000:3.0:1787787461.415065:0:20723:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff986fc2a12000), last request at 1787787370 00000020:00000080:3.0:1787787461.415079:0:20723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9de9 00000020:00010000:3.0:1787787461.415084:0:20723:0:(genops.c:1921:obd_stale_export_put()) Put export ffff986fc2a12000: total 1 00000100:00080000:3.0:1787787461.415087:0:20723:0:(import.c:65:import_set_state_nolock()) ffff986fc2a16800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787787461.415100:0:20723:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff986fc2a12000): rc 0 00000020:00080000:3.0:1787787461.415103:0:20723:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff987101db0000) has no exports 00000020:00010000:3.0:1787787461.415114:0:17141:0:(genops.c:1907:obd_stale_export_get()) Get export ffff986fc2a12000: total 1 00010000:00010000:3.0:1787787461.415134:0:17141:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff986fc2a12000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1787787461.415182:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c0031c00/0x11620bc3f30aa3b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30aa3ae expref: 14 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787461.415197:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc39f2c00/0x11620bc3f30a9f2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30a9f24 expref: 13 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787461.415206:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c7c15400/0x11620bc3f30aa3c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30aa3bc expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787461.415227:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c7c15a00/0x11620bc3f30aa115 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30aa10e expref: 11 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787461.415236:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c7c14200/0x11620bc3f30aa051 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30aa04a expref: 10 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787461.415246:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc39f2a00/0x11620bc3f30a9f1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30a9f16 expref: 9 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787461.415258:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc39f2200/0x11620bc3f30a9dfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30a9df7 expref: 8 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787461.415272:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc43e1e00/0x11620bc3f30aa0eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30aa0e4 expref: 7 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787461.415317:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c13f4a00/0x11620bc3f30aa2ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30aa2e3 expref: 6 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787461.415328:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff987101ee2000/0x11620bc3f30a9f0f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30a9f08 expref: 5 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787461.415338:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc43e1800/0x11620bc3f30aa07b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30aa074 expref: 4 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787461.415348:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c13f5400/0x11620bc3f30aa3a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30aa3a0 expref: 3 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787461.415360:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c7c14000/0x11620bc3f30a9fcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x11620bc3f30a9fc5 expref: 2 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787461.415380:0:17141:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff986fc2a12000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1787787461.415394:0:17141:0:(genops.c:885:class_export_put()) final put ffff986fc2a12000/655a2ac3-6e05-4716-af47-ef6019dc5f23 00010000:00010000:3.0:1787787461.415399:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787461.415401:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787461.415403:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787461.415525:0:17145:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9870d171d400:17145] 0 exiting: rc = 1 00000020:00000080:0.0:1787787461.415601:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc43a0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787787461.415608:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc2a12000/655a2ac3-6e05-4716-af47-ef6019dc5f23 for MGS 00000020:00000080:0.0:1787787461.415628:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff986fc2a16800 for MGS 00000100:00100000:3.0:1787787461.415661:0:17146:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9870d171d200:17146] 1 exiting: rc = 0 00000100:00100000:3.0:1787787461.415703:0:17147:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9870c36a1400:17147] 2 exiting: rc = 0 00000100:00100000:0.0:1787787461.415861:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.415868:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.415873:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.415879:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.415886:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.415890:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.415896:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.415902:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.415909:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.415915:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.415920:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.415926:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.415932:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.415937:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.415947:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.415952:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.415958:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.415962:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.415967:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.415972:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.415977:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.415982:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.415987:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416099:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416108:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416113:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416118:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416122:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416127:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416132:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416249:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416254:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416259:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416265:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416269:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416275:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416279:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416284:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416288:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416293:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416303:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416311:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416369:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416376:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416381:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416386:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416392:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416399:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416404:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416409:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416416:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416420:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416426:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416431:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416436:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416451:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416458:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416463:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416468:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416472:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416477:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416482:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416487:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787461.416500:0:20723:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1787787461.418565:0:20723:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff986fc3794180 - data ffff9870f0717ca8/ffff9870c4b36400 00000020:01000000:0.0:1787787461.418708:0:20723:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9870c121c780 - data ffff9870f0748870/ffff9870f6f02000 00000020:00000080:0.0:1787787461.419179:0:20723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9dd4 00000020:00000080:0.0:1787787461.419187:0:20723:0:(genops.c:885:class_export_put()) final put ffff9870d49de800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787787461.419202:0:20723:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9870c5465000 from MGS, refs=2 00000020:01000004:0.0:1787787461.419205:0:20723:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9870c5465000 2 00000020:01000004:0.0:1787787461.419208:0:20723:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9870c5465000 from MGS 00000020:00000080:0.0:1787787461.419226:0:20723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787787461.419232:0:20723:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787787461.419235:0:20723:0:(genops.c:885:class_export_put()) final put ffff9870c3244000/MGS 00000020:00000080:0.0:1787787461.419238:0:20723:0:(genops.c:844:class_export_destroy()) destroying export ffff9870c3244000/MGS for MGS 00000020:01000000:0.0:1787787461.419245:0:20723:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787787461.419305:0:20723:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787787461.419308:0:20723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787787461.419314:0:20723:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787787461.419319:0:20723:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff986fc372b800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787787461.419324:0:20723:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9870fc3699b8) has exports, disconnecting them 00000020:00080000:0.0:1787787461.419329:0:20723:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff986fc372b800), last request at 1787787370 00000020:00000080:0.0:1787787461.419333:0:20723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9ed7 00000020:00080000:0.0:1787787461.419342:0:20723:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff986fc372b800): rc 0 00000020:00000080:0.0:1787787461.419347:0:20723:0:(genops.c:885:class_export_put()) final put ffff986fc372b800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787787461.420083:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9870d49de800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787787461.420094:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc372b800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787787461.456203:0:20723:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787787461.456212:0:20723:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787787461.456217:0:20723:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787787461.456224:0:20723:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787787461.456384:0:20723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787787461.456393:0:20723:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787787461.456400:0:20723:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9870c5465000 1 00000020:00000080:2.0:1787787461.456406:0:20723:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9dc6 00000020:00000080:2.0:1787787461.456413:0:20723:0:(genops.c:885:class_export_put()) final put ffff9870c3243800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1787787461.456419:0:20723:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787787461.456425:0:20723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787787461.456428:0:20723:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787787461.456432:0:20723:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9870f55f0000) has no exports 00000020:00000080:3.0:1787787461.463171:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff986fc3a44000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787787461.463189:0:36:0:(genops.c:885:class_export_put()) final put ffff9870c3ec9800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787787461.463193:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9870c3ec9800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1787787461.463205:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1787787461.463287:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9870c3243800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00080000:2.0:1787787461.484741:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787787461.484748:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787787461.484751:0:36:0:(import.c:65:import_set_state_nolock()) ffff9870fc38a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787787461.484759:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 603 00000100:00080000:2.0:1787787461.484764:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787787461.484771:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9870fc38a800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:2.0:1787787461.484807:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870c327d2c0 x1874630503788288/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787787461.484893:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:655a2ac3-6e05-4716-af47-ef6019dc5f23:3653:1874630503788160:0@lo:400:kworker.0 00000400:00000100:2.0:1787787461.484942:0:3653:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874630503788160 offset 0 length 224: 4 00000100:00100000:2.0:1787787461.484981:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503788800:0@lo:400:kworker.0 00000100:00100000:3.0:1787787461.485245:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed924f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503788544:0@lo:400:kworker.0 00000100:00100000:3.0:1787787461.485284:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787461.485310:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503789056:0@lo:400:kworker.0 00000100:00100000:3.0:1787787461.485333:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787461.485431:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787787461.486236:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787461.486267:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787787461.486275:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503788416:0@lo:400:kworker.0 00000100:00100000:2.0:1787787461.486296:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787461.486313:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503788928:0@lo:400:kworker.0 00000100:00100000:2.0:1787787461.486329:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787461.486843:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503788672:0@lo:400:kworker.0 00000100:00100000:3.0:1787787461.486876:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787461.486898:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503789184:0@lo:400:kworker.0 00000100:00100000:3.0:1787787461.486923:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787461.486948:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870c327d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503788288:0@lo:38:kworker.0 00000100:00100000:2.0:1787787461.487169:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503789056 00000100:00100000:2.0:1787787461.487176:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503789056 00000100:00100000:2.0:1787787461.487203:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503788800 00000100:00100000:2.0:1787787461.487205:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503788800 00000100:00100000:2.0:1787787461.487213:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503788928 00000100:00100000:2.0:1787787461.487215:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503788928 00000100:00100000:2.0:1787787461.487240:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503788672 00000100:00100000:2.0:1787787461.487243:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503788672 00000100:00100000:2.0:1787787461.487249:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503789184 00000100:00100000:2.0:1787787461.487251:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503789184 00000100:00100000:2.0:1787787461.487267:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787787461.487275:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc24b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503788928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787461.487321:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc24b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503788928:12345-0@lo:400:kworker.0 Request processed in 47us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787461.487328:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787787461.487342:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787787461.487679:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787461.487720:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787787461.487730:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503789312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787787461.487761:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787461.487912:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503789184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787461.487952:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503789184:12345-0@lo:400:kworker.0 Request processed in 45us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787461.487964:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787787461.487972:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787787461.487974:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3655:x1874630503789056:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787787461.487983:0:18576:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787787461.488016:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3655:x1874630503789056:12345-0@lo:400:kworker.0 Request processed in 43us (2681us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787787461.488022:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787787461.488037:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787787461.488042:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc24b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3653:x1874630503788800:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787787461.488046:0:18576:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787787461.488068:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc24b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3653:x1874630503788800:12345-0@lo:400:kworker.0 Request processed in 25us (1833us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787787461.488073:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787787461.488086:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787787461.488090:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3655:x1874630503788672:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787787461.488094:0:18576:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787787461.488115:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3655:x1874630503788672:12345-0@lo:400:kworker.0 Request processed in 24us (1239us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787787461.488121:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787787461.488133:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503788544 00000100:00100000:2.0:1787787461.488159:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503788544 00000100:00100000:2.0:1787787461.488191:0:19542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503788416 00000100:00100000:2.0:1787787461.488195:0:19542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503788416 00000100:00100000:2.0:1787787461.488236:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787787461.488244:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503788544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787461.488279:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503788544:12345-0@lo:400:kworker.0 Request processed in 36us (2995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787461.488284:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787787461.488294:0:19542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787787461.488300:0:19542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc24b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503788416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787461.488328:0:19542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc24b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503788416:12345-0@lo:400:kworker.0 Request processed in 28us (2031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787461.488334:0:19542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1787787461.489184:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787787461.489190:0:3655:0:(import.c:65:import_set_state_nolock()) ffff9870f576a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:0.0:1787787461.489194:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503789312 00000100:02000400:3.0:1787787461.489195:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1787787461.489202:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503789312 00000100:00100000:1.0:1787787461.489218:0:20292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503788288 00000100:00100000:1.0:1787787461.489224:0:20292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503788288 00000100:00100000:0.0:1787787461.489243:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787787461.489255:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503789312:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787787461.489256:0:20292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787787461.489266:0:20292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3652:x1874630503788288:12345-0@lo:38:kworker.0 00002000:00000024:0.0:1787787461.489282:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00010000:00020000:1.0:1787787461.489285:0:20292:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787787461.489692:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503789312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 439us (1928us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787461.489700:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787787461.489744:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503789312:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787787461.489944:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503788416:0@lo:400:kworker.0 00010000:00080000:2.0:1787787461.489959:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc24b43c0 x1874630503788928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787461.489968:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503788928:0@lo:400:kworker.0 00000100:00080000:2.0:1787787461.489977:0:3653:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787787461.489980:0:3653:0:(import.c:65:import_set_state_nolock()) ffff986fc4152000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787787461.490084:0:3653:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787787461.490096:0:3653:0:(import.c:65:import_set_state_nolock()) ffff986fc4152000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787787461.490100:0:3653:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 541 00000100:00080000:2.0:1787787461.490106:0:3653:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff986fc4152000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:2.0:1787787461.490129:0:3653:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc24b4b40 x1874630503789440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787787461.490166:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503788800:0@lo:400:kworker.0 00000100:00100000:2.0:1787787461.490209:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1874630503789440:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787787461.490247:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787461.490282:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503789440 00000100:00100000:2.0:1787787461.490287:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503789440 00000100:00100000:2.0:1787787461.490310:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787787461.490316:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc24b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3652:x1874630503789440:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1787787461.490328:0:17153:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787787461.490692:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc24b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3652:x1874630503789440:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 374us (444us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787787461.490700:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1787787461.490802:0:3652:0:(import.c:65:import_set_state_nolock()) ffff986fc4152000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787787461.490808:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787787461.490811:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1874630503789440:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1787787461.491553:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787787461.491559:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787787461.491562:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787787461.509294:0:20292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3652:x1874630503788288:12345-0@lo:38:kworker.0 Request processed in 20021us (21609us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787787461.509310:0:20292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1787787461.509374:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870fc38a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787787461.509380:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787787461.509384:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870c327d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503788288:0@lo:38:kworker.0 00000100:00080000:3.0:1787787461.522322:0:3655:0:(import.c:65:import_set_state_nolock()) ffff9870f576a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787787461.522543:0:3655:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 526 00000100:00080000:3.0:1787787461.522554:0:3655:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9870f576a000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:3.0:1787787461.522833:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc418e1c0 x1874630503789568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787787461.522893:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874630503789568:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1787787461.522967:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787461.523048:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503789568 00000100:00100000:0.0:1787787461.523058:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503789568 00000100:00100000:0.0:1787787461.523096:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787787461.523104:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc24b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1874630503789568:12345-0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1787787461.523122:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503788672:0@lo:400:kworker.0 00010000:00020000:0.0:1787787461.523128:0:17154:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1787787461.523192:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc24b4000 x1874630503789184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787461.523211:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503789184:0@lo:400:kworker.0 00000100:00100000:3.0:1787787461.523246:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed924f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503788544:0@lo:400:kworker.0 00000100:00080000:3.0:1787787461.523260:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787787461.523264:0:3655:0:(import.c:65:import_set_state_nolock()) ffff986fc438a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787787461.523267:0:3655:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787787461.523271:0:3655:0:(import.c:65:import_set_state_nolock()) ffff986fc438a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787787461.523274:0:3655:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 558 00000100:00080000:3.0:1787787461.523277:0:3655:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff986fc438a000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:3.0:1787787461.523291:0:3655:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc4297480 x1874630503789696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787787461.523950:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1874630503789696:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1787787461.523996:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787461.526025:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc24b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1874630503789568:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 2739us (2876us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787787461.526039:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787787461.526071:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503789696 00000100:00100000:0.0:1787787461.526079:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503789696 00000100:00100000:0.0:1787787461.526119:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787787461.526125:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc24b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1874630503789696:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1787787461.526160:0:17154:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787787461.526213:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc24b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1874630503789696:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 86us (2225us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787787461.526218:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787787461.528264:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3655:1874630503789056:0@lo:400:kworker.0 00000100:00080000:2.0:1787787461.529815:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870f576a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787787461.529828:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787787461.529833:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874630503789568:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1787787461.530838:0:3652:0:(import.c:65:import_set_state_nolock()) ffff986fc438a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787787461.530846:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787787461.530851:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1874630503789696:0@lo:38:ptlrpcd_00_02.0 00000020:00000080:0.0:1787787461.582112:0:20723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787787461.582124:0:20723:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787787461.582130:0:20723:0:(genops.c:885:class_export_put()) final put ffff9870c5461800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787787461.582134:0:20723:0:(genops.c:844:class_export_destroy()) destroying export ffff9870c5461800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787787461.582210:0:20723:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787787461.582325:0:20723:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9870c5465800 00000020:02000400:0.0:1787787461.582567:0:20723:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1787787462.377307:0:20724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787463.401725:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787463.529395:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787787463.529427:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503789824:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787787463.529504:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787463.529657:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503789824 00000100:00100000:0.0:1787787463.529666:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503789824 00000100:00100000:0.0:1787787463.529740:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787787463.529751:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc24b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503789824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787787463.529796:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787787463.529846:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc24b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503789824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787463.529853:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787787463.529898:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503789824:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787787463.530000:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787787464.430494:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787787464.554299:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:0.0:1787787464.558825:0:19472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787787464.558834:0:19472:0:(genops.c:885:class_export_put()) final put ffff9870f03bd800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787787464.561534:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f03bd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787787464.562556:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870f03be000 for lustre-OST0001 00000020:01000004:3.0:1787787465.161854:0:20925:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787787465.174639:0:20925:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1787787465.174695:0:20925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc39f3800/0x11620bc3f30a9fc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9fcc expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.174712:0:20925:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc39f3800/0x11620bc3f30a9fc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a9fcc expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.174720:0:20925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc39f3800/0x11620bc3f30a9fc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a9fcc expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.174728:0:20925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff986fc39f3800/0x11620bc3f30a9fc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a9fcc expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.174827:0:20925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787787465.174834:0:20925:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787787465.174861:0:20925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787787465.174866:0:20925:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787787465.174871:0:20925:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787787465.174878:0:20925:0:(import.c:65:import_set_state_nolock()) ffff9870f576a000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1787787465.174897:0:20925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787787465.174898:0:20925:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787787465.174901:0:20925:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787787465.175156:0:20724:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787465.175165:0:20724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff986fc39f3800/0x11620bc3f30a9fc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a9fcc expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.175175:0:20724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f3800 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:3.0:1787787465.175179:0:20724:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff986fc39f3800/0x11620bc3f30a9fc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a9fcc expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.175189:0:20724:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff986fc39f3800/0x11620bc3f30a9fc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30a9fcc expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787465.175196:0:20724:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff986fc39f3800/0x11620bc3f30a9fc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30a9fcc expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787465.175202:0:20724:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787787465.175206:0:20724:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787787465.175208:0:20724:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787787465.175248:0:20724:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff986fc39f3800/0x11620bc3f30a9fc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a9fcc expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.175255:0:20724:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787787465.175280:0:20724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff986fc39f3800/0x11620bc3f30a9fc5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a9fcc expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.175287:0:20724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff986fc39f3800/0x11620bc3f30a9fc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a9fcc expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787465.175299:0:20724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.175301:0:20724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787465.175310:0:20724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787465.175344:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed924f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:655a2ac3-6e05-4716-af47-ef6019dc5f23:3655:1874630503789952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787787465.175418:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787465.175634:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503789952 00000100:00100000:0.0:1787787465.175642:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503789952 00000100:00100000:0.0:1787787465.175714:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787787465.175721:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed9261c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3655:x1874630503789952:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787787465.175728:0:17137:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787787465 with bad export cookie 1252576582586506729 00010000:00010000:2.0:1787787465.175998:0:20925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a9f24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9f2b expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.176010:0:20925:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a9f24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a9f2b expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.176016:0:20925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a9f24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a9f2b expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.176023:0:20925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a9f24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a9f2b expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.176038:0:20925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787465.176044:0:20925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14600/0x11620bc3f30aa2e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa2ea expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.176051:0:20925:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14600/0x11620bc3f30aa2e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa2ea expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.176057:0:20925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14600/0x11620bc3f30aa2e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30aa2ea expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.176063:0:20925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff9870c7c14600/0x11620bc3f30aa2e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30aa2ea expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.176074:0:20925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787787465.176080:0:20925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9871021c6800/0x11620bc3f30aa3bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa3c3 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.176093:0:20925:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9871021c6800/0x11620bc3f30aa3bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa3c3 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.176099:0:20925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9871021c6800/0x11620bc3f30aa3bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30aa3c3 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.176105:0:20925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff9871021c6800/0x11620bc3f30aa3bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30aa3c3 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.176116:0:20925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787787465.176121:0:20925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14e00/0x11620bc3f30a9f16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30a9f1d expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.176127:0:20925:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14e00/0x11620bc3f30a9f16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30a9f1d expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.176133:0:20925:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c7c14e00/0x11620bc3f30a9f16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a9f1d expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.176159:0:20925:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff9870c7c14e00/0x11620bc3f30a9f16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30a9f1d expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.176168:0:20925:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1787787465.176171:0:20925:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1787787465.176197:0:20925:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1787787465.176201:0:20925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1787787465.176205:0:20925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787787465.176211:0:20925:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1787787465.176216:0:20925:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff986fc438f800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787787465.176227:0:20925:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff986fc486b000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787787465.176233:0:20925:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9870f458b370) has exports, disconnecting them 00000020:00080000:2.0:1787787465.176237:0:20925:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff986fc438f800), last request at 1787787461 00000020:00000080:2.0:1787787465.176244:0:20925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30aa13f 00000100:00080000:2.0:1787787465.176260:0:20925:0:(import.c:65:import_set_state_nolock()) ffff986fc4389800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787787465.176299:0:20925:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff986fc438f800): rc 0 00000020:00000080:2.0:1787787465.176301:0:20925:0:(genops.c:885:class_export_put()) final put ffff986fc438f800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1787787465.176311:0:20925:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff986fc486b000), last request at 1787787461 00000020:00000080:2.0:1787787465.176314:0:20925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30aa0a5 00000100:00080000:2.0:1787787465.176319:0:20925:0:(import.c:65:import_set_state_nolock()) ffff986fc4869800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1787787465.176329:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc438f800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1787787465.176388:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff986fc4389800 for lustre-MDT0001 00000020:00080000:2.0:1787787465.176401:0:20925:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff986fc486b000): rc 0 00000020:00000080:2.0:1787787465.176403:0:20925:0:(genops.c:885:class_export_put()) final put ffff986fc486b000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1787787465.176414:0:20925:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa62241c67ae0 00000020:00000080:2.0:1787787465.176770:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc486b000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1787787465.176797:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff986fc4869800 for lustre-MDT0001 00000100:00080000:2.0:1787787465.176817:0:20925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787787465.176825:0:20925:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff987101f78b40 x1874630503787904/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787787475 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787465.176840:0:20925:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787787465.177938:0:20925:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787787465.177945:0:20925:0:(import.c:65:import_set_state_nolock()) ffff9870fc38a800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1787787465.178551:0:20925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787787465.178556:0:20925:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1787787465.178603:0:20925:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787787465.178664:0:20925:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787787465.178696:0:20925:0:(import.c:65:import_set_state_nolock()) ffff9870f3637800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787787465.178719:0:20925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787787465.178721:0:20925:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1787787465.178730:0:20925:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787787465.178793:0:20925:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787787465.178802:0:20925:0:(import.c:65:import_set_state_nolock()) ffff9870f576d800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1787787465.178839:0:20925:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9870f458b370) has no exports 00010000:00010000:2.0:1787787465.179200:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787787465.179209:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a9f24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a9f2b expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.179221:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15000 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787465.179225:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a9f24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a9f2b expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.179235:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a9f24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30a9f2b expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787465.179242:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a9f24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30a9f2b expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787465.179248:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787787465.179251:0:17141:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:2.0:1787787465.179254:0:17141:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:2.0:1787787465.179283:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a9f24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a9f2b expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.179290:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787465.179309:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a9f24 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a9f2b expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.179328:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c7c15000/0x11620bc3f30a9f24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a9f2b expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.179342:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787787465.179346:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c7c14600/0x11620bc3f30aa2e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30aa2ea expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.179352:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14600 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787465.179355:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c14600/0x11620bc3f30aa2e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30aa2ea expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.179362:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c7c14600/0x11620bc3f30aa2e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30aa2ea expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787465.179388:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c14600/0x11620bc3f30aa2e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30aa2ea expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787465.179393:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787787465.179395:0:17141:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1787787465.179397:0:17141:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787787465.179411:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c7c14600/0x11620bc3f30aa2e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30aa2ea expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.179417:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787465.179443:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c7c14600/0x11620bc3f30aa2e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30aa2ea expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.179450:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c7c14600/0x11620bc3f30aa2e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30aa2ea expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.179474:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787787465.179479:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9871021c6800/0x11620bc3f30aa3bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30aa3c3 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.179484:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c6800 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787465.179487:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9871021c6800/0x11620bc3f30aa3bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30aa3c3 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.179494:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9871021c6800/0x11620bc3f30aa3bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30aa3c3 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787465.179500:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9871021c6800/0x11620bc3f30aa3bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30aa3c3 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787465.179506:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787787465.179508:0:17141:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787787465.179510:0:17141:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787787465.179524:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9871021c6800/0x11620bc3f30aa3bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30aa3c3 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.179530:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787465.179537:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9871021c6800/0x11620bc3f30aa3bc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30aa3c3 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.179543:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9871021c6800/0x11620bc3f30aa3bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30aa3c3 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.179553:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787465.179557:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c7c14e00/0x11620bc3f30a9f16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a9f1d expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.179568:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14e00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787465.179571:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c14e00/0x11620bc3f30a9f16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30a9f1d expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.179579:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c7c14e00/0x11620bc3f30a9f16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30a9f1d expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787465.179585:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c7c14e00/0x11620bc3f30a9f16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30a9f1d expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787465.179591:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787787465.179593:0:17141:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1787787465.179594:0:17141:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1787787465.179609:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c7c14e00/0x11620bc3f30a9f16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a9f1d expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.179614:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787465.179620:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c7c14e00/0x11620bc3f30a9f16 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a9f1d expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.179625:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c7c14e00/0x11620bc3f30a9f16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x11620bc3f30a9f1d expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787465.179635:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787465.179636:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787465.179638:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787465.179646:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787465.179667:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:655a2ac3-6e05-4716-af47-ef6019dc5f23:3656:1874630503790336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787465.179731:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787465.179852:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:655a2ac3-6e05-4716-af47-ef6019dc5f23:3655:1874630503790720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787465.180203:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:655a2ac3-6e05-4716-af47-ef6019dc5f23:3653:1874630503790464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787465.180234:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787465.180324:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503787904:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787787465.180355:0:20724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787465.181274:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503790080:0@lo:9:umount.0 00000100:00100000:2.0:1787787465.181320:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787465.181346:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503790208:0@lo:9:umount.0 00000100:00100000:2.0:1787787465.181388:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787465.181424:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503790080 00000100:00100000:2.0:1787787465.181432:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503790080 00000100:00100000:2.0:1787787465.181488:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503790208 00000100:00100000:2.0:1787787465.181492:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503790208 00000100:00100000:2.0:1787787465.181515:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787787465.181523:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874630503790080:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787787465.181548:0:18659:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30aa0cf 00000100:00080000:2.0:1787787465.181559:0:18659:0:(import.c:65:import_set_state_nolock()) ffff987101cdc000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787787465.181596:0:18659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1787787465.181727:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3652:x1874630503790080:12345-0@lo:9:umount.0 Request processed in 203us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787465.181735:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787787465.181749:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787787465.181755:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874630503790208:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787787465.181765:0:18659:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30aa15b 00000100:00080000:2.0:1787787465.181770:0:18659:0:(import.c:65:import_set_state_nolock()) ffff9870f03bd000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787787465.181788:0:18659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1787787465.181863:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3652:x1874630503790208:12345-0@lo:9:umount.0 Request processed in 107us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787465.181870:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1787787465.181892:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787787465.181906:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787787465.181916:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787787465.181943:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870f3637800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787787465.181956:0:3652:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787787465.181958:0:3652:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787787465.181961:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503790080:0@lo:9:umount.0 00000100:00080000:2.0:1787787465.181986:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870f576d800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787787465.181994:0:3652:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787787465.181995:0:3652:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787787465.181998:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503790208:0@lo:9:umount.0 00010000:00010000:2.0:1787787465.182021:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787465.184225:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:655a2ac3-6e05-4716-af47-ef6019dc5f23:3654:1874630503790592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787787465.190601:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503790336 00000100:00100000:3.0:1787787465.190616:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503790336 00000100:00100000:3.0:1787787465.190667:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503790464 00000100:00100000:3.0:1787787465.190670:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503790464 00000100:00100000:1.0:1787787465.190680:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787787465.190692:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc24b5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3656:x1874630503790336:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787787465.190701:0:17139:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787787465 with bad export cookie 1252576582586506729 00000100:00100000:1.0:1787787465.190783:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc24b5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3656:x1874630503790336:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (11051us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787787465.190790:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787787465.190810:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787787465.190814:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3653:x1874630503790464:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787787465.190818:0:17139:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787787465 with bad export cookie 1252576582586506729 00000100:00100000:1.0:1787787465.190843:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3653:x1874630503790464:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (10609us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787787465.190861:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787787465.190907:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787465.190954:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787465.191054:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503790592 00000100:00100000:1.0:1787787465.191059:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503790592 00000100:00100000:1.0:1787787465.191072:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503790720 00000100:00100000:1.0:1787787465.191075:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503790720 00000100:00100000:1.0:1787787465.191085:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787787465.191089:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3654:x1874630503790592:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787787465.191094:0:17139:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787787465 with bad export cookie 1252576582586506729 00000100:00100000:1.0:1787787465.191157:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3654:x1874630503790592:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (249us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787787465.191163:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787787465.191176:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787787465.191180:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f5bacc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3655:x1874630503790720:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787787465.191184:0:17139:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787787465 with bad export cookie 1252576582586506729 00000100:00100000:1.0:1787787465.191211:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f5bacc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3655:x1874630503790720:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (257us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787787465.191216:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1787787465.191247:0:3654:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.131@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787787465.191253:0:3654:0:(import.c:65:import_set_state_nolock()) ffff9870c5802000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787787465.191257:0:3654:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1787787465.191336:0:3656:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.131@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1787787465.191579:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed9261c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3655:x1874630503789952:12345-0@lo:103:ldlm_bl.0 Request processed in 15856us (16160us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787787465.191587:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1787787465.199839:0:3655:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.131@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787787465.202850:0:3654:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.131@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787787465.202858:0:3654:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787787465.202869:0:3654:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff987101f78000 x1874630503788160/t0(0) o400->MGC192.168.204.131@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787787477 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787465.202886:0:3654:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9870ed924f00 x1874630503789952/t0(0) o103->MGC192.168.204.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787787481 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787465.202896:0:3654:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff986fc24b61c0 x1874630503790336/t0(0) o103->MGC192.168.204.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787787481 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787465.202906:0:3654:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff986fc24b4000 x1874630503790720/t0(0) o103->MGC192.168.204.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787787481 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787465.202914:0:3654:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff986fc24b5a40 x1874630503790464/t0(0) o103->MGC192.168.204.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787787481 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787465.202922:0:3654:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff986fc24b52c0 x1874630503790592/t0(0) o103->MGC192.168.204.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787787481 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787787465.202932:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787787465.202955:0:3654:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787787465.202957:0:3654:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787787465.203843:0:3656:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9870c5802000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1787787465.203872:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:655a2ac3-6e05-4716-af47-ef6019dc5f23:3656:1874630503790336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787787465.204632:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:655a2ac3-6e05-4716-af47-ef6019dc5f23:3653:1874630503790464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787787465.204647:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:655a2ac3-6e05-4716-af47-ef6019dc5f23:3653:1874630503788160:0@lo:400:kworker.0 00000100:00080000:2.0:1787787465.205462:0:3655:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9870c5802000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1787787465.205485:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed924f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:655a2ac3-6e05-4716-af47-ef6019dc5f23:3655:1874630503789952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787465.205504:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:655a2ac3-6e05-4716-af47-ef6019dc5f23:3655:1874630503790720:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787787465.208516:0:3654:0:(import.c:65:import_set_state_nolock()) ffff9870c5802000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787787465.208531:0:3654:0:(import.c:510:import_select_connection()) MGC192.168.204.131@tcp: connect to NID 0@lo last attempt 514 00000100:00080000:1.0:1787787465.208542:0:3654:0:(import.c:624:import_select_connection()) MGC192.168.204.131@tcp: import ffff9870c5802000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:1.0:1787787465.208585:0:3654:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc4899a40 x1874630503790848/t0(0) o250->MGC192.168.204.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787787465.208635:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:655a2ac3-6e05-4716-af47-ef6019dc5f23:3654:1874630503790592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787465.209169:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4899a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:655a2ac3-6e05-4716-af47-ef6019dc5f23:3652:1874630503790848:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:2.0:1787787465.209231:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874630503790848 offset 0 length 520: 4 00000020:00080000:2.0:1787787465.212536:0:20925:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9870f458b370) has no exports 00000020:01000000:1.0:1787787465.298583:0:20925:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9870d84d56c0 - data ffff9870f0697798/ffff986fc3675400 00000020:01000000:1.0:1787787465.298751:0:20925:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9870c5ee6120 - data ffff9870f05c0d80/ffff9870c44ec000 00000001:00000004:1.0:1787787465.314488:0:20925:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1787787465.370785:0:20925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787787465.370794:0:20925:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787787465.370803:0:20925:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787787465.372574:0:20925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787787465.372580:0:20925:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1787787465.372597:0:20925:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787787465.372599:0:20925:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787787465.372831:0:17892:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787787465.372836:0:17892:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1787787465.372846:0:17892:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1787787465.374278:0:20925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787787465.374283:0:20925:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1787787465.374552:0:20925:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787787465.374563:0:20925:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787787465.375982:0:17894:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787787465.375989:0:17894:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1787787465.375999:0:17894:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1787787465.381094:0:20925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9f39 00000020:00000080:2.0:1787787465.381109:0:20925:0:(genops.c:885:class_export_put()) final put ffff986fc4029000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787787465.382698:0:20925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9f4e 00000020:00000080:3.0:1787787465.382711:0:20925:0:(genops.c:885:class_export_put()) final put ffff9870fc117800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787787465.383714:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc4029000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1787787465.386454:0:20925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1787787465.386495:0:20925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787787465.386508:0:20925:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787787465.386513:0:20925:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff986fc38c4d28) has no exports 00000004:01000000:3.0:1787787465.387176:0:20925:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787787465.387194:0:20925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9fa2 00000020:00000080:3.0:1787787465.387202:0:20925:0:(genops.c:885:class_export_put()) final put ffff9870f576c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787787465.388389:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9870fc117800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:1.0:1787787465.388639:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f576c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1787787465.388722:0:20925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1787787465.388733:0:20925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787787465.388744:0:20925:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787787465.388749:0:20925:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9870f45899b8) has no exports 00000020:00000080:3.0:1787787465.388758:0:20925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9f9b 00000020:00000080:3.0:1787787465.388781:0:20925:0:(genops.c:885:class_export_put()) final put ffff9870d1e05800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787787465.389446:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9870d1e05800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1787787465.390703:0:20925:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1787787465.390711:0:20925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787787465.390716:0:20925:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1787787465.390723:0:20925:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787787465.390726:0:20925:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787787465.390774:0:20925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787787465.390784:0:20925:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787787465.390793:0:20925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9f8d 00000020:00000080:3.0:1787787465.390801:0:20925:0:(genops.c:885:class_export_put()) final put ffff9870f3636000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787787465.390808:0:20925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1787787465.390815:0:20925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787787465.390820:0:20925:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787787465.390824:0:20925:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9870d22f3370) has no exports 00000020:00000080:3.0:1787787465.390830:0:20925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9f7f 00000020:00000080:3.0:1787787465.390833:0:20925:0:(genops.c:885:class_export_put()) final put ffff9870f3634000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787787465.391033:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870f576d800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1787787465.391042:0:36:0:(genops.c:885:class_export_put()) final put ffff9870f3635800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787787465.391045:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f3635800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1787787465.391051:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787787465.391156:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f3636000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1787787465.391163:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f3634000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1787787465.392793:0:20925:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1787787465.392800:0:20925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787787465.392803:0:20925:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1787787465.392809:0:20925:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787787465.392811:0:20925:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787787465.392847:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870f3637800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787787465.392854:0:20925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787787465.392862:0:20925:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787787465.392878:0:20925:0:(genops.c:885:class_export_put()) final put ffff9870f3631800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787787465.392882:0:20925:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f3631800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1787787465.392888:0:20925:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1787787465.394413:0:20925:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1787787465.394424:0:20925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9f71 00000020:00000080:3.0:1787787465.394432:0:20925:0:(genops.c:885:class_export_put()) final put ffff9870f3634800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1787787465.394452:0:20925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1787787465.394519:0:20925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787787465.394537:0:20925:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787787465.394541:0:20925:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9870fc36cd28) has no exports 00000020:00000080:3.0:1787787465.394547:0:20925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9f6a 00000020:00000080:3.0:1787787465.394552:0:20925:0:(genops.c:885:class_export_put()) final put ffff9870fc388000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787787465.394572:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f3634800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1787787465.394601:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9870fc388000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1787787465.397325:0:20925:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1787787465.397334:0:20925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787787465.397339:0:20925:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787787465.397346:0:20925:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787787465.397400:0:20925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787787465.397411:0:20925:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787787465.397425:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870fc38a800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1787787465.397439:0:36:0:(genops.c:885:class_export_put()) final put ffff9870fc38b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787787465.397441:0:20925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787787465.397444:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9870fc38b000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1787787465.397446:0:20925:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787787465.397462:0:20925:0:(genops.c:885:class_export_put()) final put ffff986fc43a2000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787787465.397465:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787787465.397466:0:20925:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc43a2000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1787787465.397474:0:20925:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787787465.397635:0:20925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9f55 00000020:00000080:2.0:1787787465.397641:0:20925:0:(genops.c:885:class_export_put()) final put ffff9870fc110000/lustre-MDD0001_UUID 00000020:01000000:2.0:1787787465.397651:0:20925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1787787465.397665:0:20925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787787465.397669:0:20925:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787787465.397673:0:20925:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9870f458cd28) has no exports 00000020:00000080:2.0:1787787465.397693:0:20925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787787465.397696:0:20925:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1787787465.397699:0:20925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9f5c 00000020:00000080:2.0:1787787465.397702:0:20925:0:(genops.c:885:class_export_put()) final put ffff9870fc115000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787787465.397787:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9870fc110000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000004:2.0:1787787465.397793:0:20925:0:(tgt_mount.c:187:server_put_mount()) put mount ffff987101e33000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1787787465.397793:0:36:0:(genops.c:885:class_export_put()) final put ffff9870d165a800/lustre-MDD0001_UUID 00000020:00000080:1.0:1787787465.397797:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9870d165a800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000004:2.0:1787787465.397799:0:20925:0:(obd_mount.c:710:lustre_put_lsi()) put ffff987101e33000 2 00000020:01000000:1.0:1787787465.397802:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:01000004:2.0:1787787465.397805:0:20925:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff987101e33000 from lustre-MDT0001 00000020:00000080:2.0:1787787465.397833:0:20925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787787465.397837:0:20925:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1787787465.397849:0:20925:0:(genops.c:885:class_export_put()) final put ffff986fc402d000/lustre-MDT0001_UUID 00000020:00000080:2.0:1787787465.397851:0:20925:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc402d000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1787787465.397860:0:20925:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1787787465.397900:0:20925:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1787787465.397904:0:20925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1787787465.397907:0:20925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787787465.397911:0:20925:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787787465.397917:0:20925:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9870f5768800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787787465.397922:0:20925:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9870f57799b8) has exports, disconnecting them 00000020:00080000:2.0:1787787465.397926:0:20925:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9870f5768800), last request at 1787787382 00000020:00000080:2.0:1787787465.397929:0:20925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9fda 00000020:00000080:1.0:1787787465.397939:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9870fc115000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00080000:2.0:1787787465.397941:0:20925:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9870f5768800): rc 0 00000020:00000080:2.0:1787787465.397947:0:20925:0:(genops.c:885:class_export_put()) final put ffff9870f5768800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1787787465.397967:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f5768800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1787787465.442499:0:20925:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1787787465.442510:0:20925:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787787465.442514:0:20925:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787787465.442521:0:20925:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787787465.442591:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870f576a000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1787787465.443070:0:20925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787787465.443079:0:20925:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1787787465.443085:0:20925:0:(genops.c:885:class_export_put()) final put ffff9870c4bbd000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1787787465.443089:0:20925:0:(genops.c:844:class_export_destroy()) destroying export ffff9870c4bbd000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1787787465.443096:0:20925:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1787787465.443183:0:20925:0:(obd_mount.c:710:lustre_put_lsi()) put ffff987101e33000 1 00000020:00000080:2.0:1787787465.443189:0:20925:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9f01 00000020:00000080:2.0:1787787465.443196:0:20925:0:(genops.c:885:class_export_put()) final put ffff986fc341c000/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1787787465.443206:0:20925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1787787465.443216:0:20925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787787465.443221:0:20925:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787787465.443225:0:20925:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9870d22f19b8) has no exports 00000020:00000080:3.0:1787787465.445540:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc341c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:00010000:2.0:1787787465.451043:0:20724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787787465.547410:0:20925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787787465.547424:0:20925:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1787787465.547430:0:20925:0:(genops.c:885:class_export_put()) final put ffff987101e36000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787787465.547435:0:20925:0:(genops.c:844:class_export_destroy()) destroying export ffff987101e36000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1787787465.547448:0:20925:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1787787465.547559:0:20925:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff987101e32000 00000020:01000000:1.0:1787787465.547579:0:20925:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1787787465.547583:0:20925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787787465.547587:0:20925:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787787465.547591:0:20925:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9870f55f4d28) has no exports 00000100:00100000:0.0:1787787465.548074:0:17154:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff986fc3a83800:17154] 2 exiting: rc = 0 00000100:00100000:0.0:1787787465.548250:0:18576:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9870c4bf8c00:18576] 3 exiting: rc = 0 00000100:00100000:3.0:1787787465.548450:0:17153:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9870c3287800:17153] 1 exiting: rc = 0 00000100:00100000:3.0:1787787465.549940:0:17152:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9870c3286e00:17152] 0 exiting: rc = 1 00000100:00100000:1.0:1787787465.551057:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551066:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551072:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551078:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551083:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551088:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551093:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551099:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551103:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551124:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551129:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551135:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551219:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551225:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551231:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551237:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551243:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551249:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551255:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551260:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551266:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551271:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551277:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551283:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551288:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551294:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551303:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551308:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551314:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551320:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551325:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551331:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551336:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551342:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551347:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551352:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551367:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551375:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551380:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551387:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551392:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551398:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551403:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551408:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551421:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551426:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551431:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551437:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551441:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551446:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551451:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551457:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551462:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551468:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551473:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551479:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551485:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551491:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551496:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551502:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551509:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551516:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551521:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.551526:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.558291:0:17155:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff986fc3a82600:17155] 0 exiting: rc = 1 00000100:00100000:3.0:1787787465.559549:0:17156:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff986fc276a400:17156] 1 exiting: rc = 0 00000100:00100000:2.0:1787787465.560181:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560190:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560197:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560205:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560210:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560215:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560220:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560225:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560241:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560246:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560252:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560257:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560262:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560267:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560273:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560278:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560282:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560287:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560292:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560296:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560302:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560306:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560312:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560317:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560322:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560328:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560333:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560338:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560344:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560349:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560353:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560369:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560375:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560380:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560385:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560403:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560407:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560412:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560418:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560423:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560428:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560433:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560438:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560443:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560447:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560452:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560457:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560461:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560473:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560480:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560485:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560490:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560494:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560499:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560504:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560510:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560514:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560519:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560523:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560528:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560533:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560537:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560542:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.560547:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.561435:0:17158:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff986fc276a000:17158] 1 exiting: rc = 0 00000100:00100000:2.0:1787787465.561935:0:17157:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9870fc2fd800:17157] 0 exiting: rc = 1 00000100:00100000:1.0:1787787465.563489:0:20292:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff986fc2967200:20292] 2 exiting: rc = 0 00000100:00100000:0.0:1787787465.563730:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.563742:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.563756:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.563767:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.563775:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.563782:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.563788:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.563795:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.563800:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.563806:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.563825:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.563831:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.563855:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.563863:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.563870:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.563876:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.563882:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.563887:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.563893:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.563899:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.563905:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.563910:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.564788:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.564802:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.564826:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.564835:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.564843:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.564850:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.564857:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.564863:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.564869:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.564874:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.564880:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.564886:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.564891:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.564897:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.565618:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.565633:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.565639:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.565645:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.565652:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.565657:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.565662:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.565669:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.565678:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.565695:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.565700:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.565707:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.565726:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.565733:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.565738:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.565744:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.565750:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.565755:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.565761:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.565767:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.565773:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.565780:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.565786:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.565792:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.565809:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.565815:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.565820:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787465.565826:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.582934:0:17159:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff986fc276b000:17159] 0 exiting: rc = 1 00000100:00100000:0.0:1787787465.583039:0:17160:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff986fc276b600:17160] 1 exiting: rc = 0 00000100:00100000:3.0:1787787465.584072:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584080:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584085:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584091:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584096:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584101:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584106:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584112:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584117:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584121:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584127:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584133:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584302:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584310:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584315:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584320:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584326:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584331:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584336:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584342:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584347:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584352:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584375:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584600:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584609:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584614:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584632:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584637:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584641:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584646:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584651:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584656:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584661:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584666:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584672:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584677:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584682:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584688:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584692:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584698:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584703:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584708:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584775:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584780:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584785:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584790:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584795:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584800:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584806:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584812:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584817:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584822:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584826:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584831:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584836:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584840:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584845:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584850:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584856:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584861:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584867:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584879:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584884:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.584889:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.586082:0:17161:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff986fc3775c00:17161] 0 exiting: rc = 1 00000100:00100000:2.0:1787787465.586085:0:17162:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9870fc162000:17162] 1 exiting: rc = 0 00000100:00100000:3.0:1787787465.586290:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586300:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586304:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586309:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586314:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586319:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586324:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586330:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586335:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586340:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586345:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586350:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586356:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586375:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586381:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586444:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586450:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586455:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586459:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586464:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586470:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586475:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586480:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586486:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586491:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586495:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586500:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586504:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586509:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586514:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586518:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586681:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586701:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586707:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586894:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586900:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586904:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586909:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586914:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586919:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586924:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586930:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586935:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586940:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586944:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586950:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586965:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586971:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586977:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586982:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586987:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586992:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.586997:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.587001:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.587007:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.587012:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.587017:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.587022:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.587027:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.587031:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.587036:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.587041:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.587046:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.587051:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787465.587721:0:17163:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9870fc163400:17163] 0 exiting: rc = 1 00000100:00100000:0.0:1787787465.587979:0:17164:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9870fc162200:17164] 1 exiting: rc = 0 00000100:00100000:3.0:1787787465.588112:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588122:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588127:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588174:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588180:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588185:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588190:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588200:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588206:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588213:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588228:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588235:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588240:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588246:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588251:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588256:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588261:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588265:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588279:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588285:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588290:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588295:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588300:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588310:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588315:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588323:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588328:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588336:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588342:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588350:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588355:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588375:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588381:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588389:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588394:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588401:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588407:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588413:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588428:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588437:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588442:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588450:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588455:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588460:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588468:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588474:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588482:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588488:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588496:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588502:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588509:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588515:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588520:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588528:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588533:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588538:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588543:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588548:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588552:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588557:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588561:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588567:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588572:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.588577:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787465.589335:0:17167:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9870ed905400:17167] 2 exiting: rc = 0 00000100:00100000:0.0:1787787465.589417:0:17166:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9870ed905200:17166] 1 exiting: rc = 0 00000100:00100000:2.0:1787787465.589706:0:17165:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9870fc163000:17165] 0 exiting: rc = 1 00000100:00100000:3.0:1787787465.589870:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.589877:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.589882:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.589896:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.589903:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.589913:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.589919:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.589925:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.589930:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.589948:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.589962:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.589968:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.589998:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590006:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590012:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590018:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590023:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590028:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590034:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590039:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590044:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590051:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590057:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590062:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590067:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590072:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590078:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590083:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590090:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590096:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590102:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590108:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590120:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590127:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590132:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590166:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590187:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590193:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590199:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590204:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590209:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590214:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590219:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590235:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590250:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590256:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590261:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590266:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590502:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590512:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590517:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590523:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590528:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590534:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590539:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590546:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590551:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590556:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590562:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590567:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590573:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590578:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590583:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787465.590589:0:20925:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787787465.603586:0:20925:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787787465.603600:0:20925:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787787465.603606:0:20925:0:(genops.c:885:class_export_put()) final put ffff9870d4e4e000/MDS_uuid 00000020:00000080:2.0:1787787465.603611:0:20925:0:(genops.c:844:class_export_destroy()) destroying export ffff9870d4e4e000/MDS_uuid for MDS 00000020:01000000:2.0:1787787465.603617:0:20925:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787787465.603834:0:20925:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1787787466.475725:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787787466.601371:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 655a2ac3-6e05-4716-af47-ef6019dc5f23->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787787466.601381:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 655a2ac3-6e05-4716-af47-ef6019dc5f23->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787787466.601384:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787787466.601388:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787787466.601400:0:36:0:(import.c:65:import_set_state_nolock()) ffff986fc4152000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787787466.601408:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 605 00000100:00080000:2.0:1787787466.601415:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787787466.601421:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff986fc4152000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:2.0:1787787466.601467:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc418d680 x1874630503790976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787787466.601530:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787787466.601534:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787787466.601535:0:36:0:(import.c:65:import_set_state_nolock()) ffff986fc438a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787787466.601539:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 605 00000100:00080000:2.0:1787787466.601541:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787787466.601545:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff986fc438a000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:2.0:1787787466.601557:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc418de00 x1874630503791232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787787466.601715:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1874630503790976:0@lo:38:kworker.0 00000400:00000100:0.0:1787787466.601770:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874630503790976 offset 0 length 520: 4 00000100:00100000:0.0:1787787466.601860:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1874630503791232:0@lo:38:kworker.0 00000400:00000100:0.0:1787787466.601877:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874630503791232 offset 0 length 520: 4 00000100:00100000:1.0:1787787466.601946:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787787466.601957:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503791104:0@lo:400:kworker.0 00000400:00000100:1.0:1787787466.601980:0:3655:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874630503791104 offset 0 length 224: 4 00000100:00100000:1.0:1787787466.601998:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787787466.602005:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874630503791360:0@lo:400:kworker.0 00000400:00000100:1.0:1787787466.602020:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874630503791360 offset 0 length 224: 4 00010000:00010000:2.0:1787787467.497304:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787468.522248:0:20724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787787469.322311:0:21126:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787787469.338514:0:21126:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1787787469.338576:0:21126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc39f2000/0x11620bc3f30aa074 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa07b expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787469.338602:0:21126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc39f2000/0x11620bc3f30aa074 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa07b expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787469.338610:0:21126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc39f2000/0x11620bc3f30aa074 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30aa07b expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787469.338618:0:21126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff986fc39f2000/0x11620bc3f30aa074 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30aa07b expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787469.338648:0:21126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787787469.338655:0:21126:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787787469.338688:0:21126:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787787469.338701:0:21126:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff986fc418d680 x1874630503790976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787787481 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787469.338723:0:21126:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787787469.338729:0:21126:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787787469.338736:0:21126:0:(import.c:65:import_set_state_nolock()) ffff986fc4152000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787787469.338741:0:21126:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787787469.338746:0:21126:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff986fc418d680 x1874630503790976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787787481 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787787469.338749:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787787469.338758:0:21126:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00010000:00010000:3.0:1787787469.338761:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff986fc39f2000/0x11620bc3f30aa074 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30aa07b expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787469.338762:0:21126:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00010000:00010000:3.0:1787787469.338772:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f2000 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:3.0:1787787469.338777:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff986fc39f2000/0x11620bc3f30aa074 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30aa07b expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787469.338787:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff986fc39f2000/0x11620bc3f30aa074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30aa07b expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787469.338794:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff986fc39f2000/0x11620bc3f30aa074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30aa07b expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787469.338811:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787787469.338814:0:17140:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787787469.338817:0:17140:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787787469.338832:0:17140:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9870c5802000 00010000:00010000:3.0:1787787469.338836:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff986fc39f2000/0x11620bc3f30aa074 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x11620bc3f30aa07b expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787469.338843:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff986fc39f2000/0x11620bc3f30aa074 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x11620bc3f30aa07b expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787469.338857:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787469.338858:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787469.338860:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787787469.339073:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1874630503790976:0@lo:38:kworker.0 00000100:00080000:1.0:1787787469.341316:0:21126:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787787469.341334:0:21126:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff986fc418f480 x1874630503791104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787482 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787469.341351:0:21126:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787787469.341356:0:21126:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787787469.341394:0:21126:0:(import.c:65:import_set_state_nolock()) ffff986fc240a000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787787469.341713:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503791104:0@lo:400:kworker.0 00000100:00100000:2.0:1787787469.341919:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4898b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3652:1874630503791488:0@lo:39:umount.0 00000400:00000100:2.0:1787787469.341967:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874630503791488 offset 0 length 224: 4 00010000:00010000:2.0:1787787469.545527:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787470.570392:0:20724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787787470.633274:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 655a2ac3-6e05-4716-af47-ef6019dc5f23->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787787470.633285:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 655a2ac3-6e05-4716-af47-ef6019dc5f23->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787787470.633289:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787787470.633293:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787787470.633404:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874630503791616:0@lo:400:kworker.0 00000400:00000100:1.0:1787787470.633473:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874630503791616 offset 0 length 224: 4 00000001:00100000:0.0:1787787470.699945:0:19472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787787470.699956:0:19472:0:(genops.c:885:class_export_put()) final put ffff9870f03ba000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787787470.700096:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f03ba000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787787470.700178:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870f03bd000 for lustre-OST0001 00000001:00100000:1.0:1787787470.700283:0:18653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787787470.700300:0:18653:0:(genops.c:885:class_export_put()) final put ffff987101cd9000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787787470.700372:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff987101cd9000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787787470.703874:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff987101cdc000 for lustre-OST0000 00010000:00010000:3.0:1787787471.593404:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787787471.657342:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 655a2ac3-6e05-4716-af47-ef6019dc5f23->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787787471.657353:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 655a2ac3-6e05-4716-af47-ef6019dc5f23->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787787471.657357:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787787471.657360:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787787471.657466:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503791744:0@lo:400:kworker.0 00000400:00000100:1.0:1787787471.657536:0:3655:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874630503791744 offset 0 length 224: 4 00010000:00010000:2.0:1787787472.620524:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787473.641487:0:20724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787474.665433:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787475.497709:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787787465/real 1787787465] req@ffff986fc4899a40 x1874630503790848/t0(0) o250->MGC192.168.204.131@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787787475 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787475.497742:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff986fc4899a40 x1874630503790848/t0(0) o250->MGC192.168.204.131@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787787475 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787787475.497762:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870c5802000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787787475.497788:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787787475.497793:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4899a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:655a2ac3-6e05-4716-af47-ef6019dc5f23:3652:1874630503790848:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:0.0:1787787475.497943:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 655a2ac3-6e05-4716-af47-ef6019dc5f23->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787787475.497948:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1787787475.497951:0:36:0:(import.c:65:import_set_state_nolock()) ffff9870c5802000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787787475.497955:0:36:0:(import.c:510:import_select_connection()) MGC192.168.204.131@tcp: connect to NID 0@lo last attempt 609 00000100:00080000:0.0:1787787475.497960:0:36:0:(import.c:589:import_select_connection()) MGC192.168.204.131@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787787475.497966:0:36:0:(import.c:624:import_select_connection()) MGC192.168.204.131@tcp: import ffff9870c5802000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:0.0:1787787475.497996:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc43fa1c0 x1874630503791872/t0(0) o250->MGC192.168.204.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787787475.498020:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787787475.498024:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787787475.498163:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787787475.498192:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503792000:0@lo:400:kworker.0 00000400:00000100:1.0:1787787475.498253:0:3655:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874630503792000 offset 0 length 224: 4 00000100:00100000:2.0:1787787475.498629:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:655a2ac3-6e05-4716-af47-ef6019dc5f23:3652:1874630503791872:0@lo:250:kworker.0 00000400:00000100:2.0:1787787475.498655:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874630503791872 offset 0 length 520: 4 00010000:00010000:2.0:1787787475.689708:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787476.713470:0:20724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787477.737422:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787478.761411:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787479.593322:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787787469/real 1787787469] req@ffff986fc4898b40 x1874630503791488/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787787479 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787479.593379:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff986fc4898b40 x1874630503791488/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787787479 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787787479.593486:0:3652:0:(import.c:65:import_set_state_nolock()) ffff986fc240a000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787787479.593563:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4898b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3652:1874630503791488:0@lo:39:umount.0 00000100:00080000:1.0:1787787479.596486:0:21126:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787787479.596496:0:21126:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787787479.596503:0:21126:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787787479.598226:0:21126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc39f3400/0x11620bc3f30aa04a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa051 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787479.598246:0:21126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc39f3400/0x11620bc3f30aa04a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa051 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787479.598254:0:21126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc39f3400/0x11620bc3f30aa04a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30aa051 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787479.598261:0:21126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff986fc39f3400/0x11620bc3f30aa04a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30aa051 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787479.598322:0:21126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787787479.598331:0:21126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c0030600/0x11620bc3f30aa3ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa3b5 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787479.598353:0:21126:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c0030600/0x11620bc3f30aa3ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa3b5 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787479.598359:0:21126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c0030600/0x11620bc3f30aa3ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30aa3b5 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787479.598364:0:21126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff9870c0030600/0x11620bc3f30aa3ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30aa3b5 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787479.598420:0:20724:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787787479.598429:0:20724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff986fc39f3400/0x11620bc3f30aa04a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30aa051 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787479.598436:0:20724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc39f3400 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:3.0:1787787479.598440:0:20724:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff986fc39f3400/0x11620bc3f30aa04a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30aa051 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787479.598448:0:20724:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff986fc39f3400/0x11620bc3f30aa04a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30aa051 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787479.598455:0:20724:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff986fc39f3400/0x11620bc3f30aa04a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30aa051 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787479.598461:0:20724:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787787479.598463:0:20724:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:3.0:1787787479.598475:0:20724:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9870c5802000 00010000:00010000:3.0:1787787479.598479:0:20724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff986fc39f3400/0x11620bc3f30aa04a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x11620bc3f30aa051 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787479.598486:0:20724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff986fc39f3400/0x11620bc3f30aa04a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x11620bc3f30aa051 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787479.598501:0:20724:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787479.598504:0:20724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c0030600/0x11620bc3f30aa3ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30aa3b5 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787479.598509:0:20724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030600 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:3.0:1787787479.598511:0:20724:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c0030600/0x11620bc3f30aa3ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30aa3b5 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787479.598529:0:20724:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c0030600/0x11620bc3f30aa3ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30aa3b5 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787479.598535:0:20724:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c0030600/0x11620bc3f30aa3ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30aa3b5 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787479.598540:0:20724:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787787479.598542:0:20724:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1787787479.598547:0:20724:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9870c5802000 00010000:00010000:3.0:1787787479.598549:0:20724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c0030600/0x11620bc3f30aa3ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x11620bc3f30aa3b5 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787479.598556:0:20724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787479.598557:0:20724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787479.598560:0:20724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787479.598619:0:21126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787787479.598623:0:21126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c0030600/0x11620bc3f30aa3ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x11620bc3f30aa3b5 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787479.598647:0:21126:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1787787479.598654:0:21126:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1787787479.598656:0:21126:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1787787479.598693:0:21126:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1787787479.598697:0:21126:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1787787479.598702:0:21126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787787479.598708:0:21126:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787787479.598716:0:21126:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9870f577cd28) has no exports 00000020:00080000:1.0:1787787479.598739:0:21126:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9870f577cd28) has no exports 00000020:01000000:1.0:1787787479.600520:0:21126:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff986fc3794900 - data ffff9870e07d9288/ffff9870c4b37400 00000020:01000000:1.0:1787787479.600675:0:21126:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff986fc10d00c0 - data ffff9870d2f6caf8/ffff986fc342e800 00010000:00010000:3.0:1787787479.601439:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1787787479.608932:0:21126:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787787479.618943:0:21126:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30aa05f 00000020:00000080:3.0:1787787479.618955:0:21126:0:(genops.c:885:class_export_put()) final put ffff986fc2a0a800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787787479.619190:0:21126:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9870fc38d000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787787479.619195:0:21126:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9870fc38d000 2 00000020:01000004:3.0:1787787479.619198:0:21126:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9870fc38d000 from lustre-OST0000 00000020:00000080:3.0:1787787479.619225:0:21126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787787479.619238:0:21126:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787787479.619241:0:21126:0:(genops.c:885:class_export_put()) final put ffff9870c4536800/lustre-OST0000_UUID 00000020:00000080:3.0:1787787479.619244:0:21126:0:(genops.c:844:class_export_destroy()) destroying export ffff9870c4536800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787787479.619256:0:21126:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787787479.619307:0:21126:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787787479.619312:0:21126:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787787479.619316:0:21126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787787479.619321:0:21126:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787787479.619338:0:21126:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff986fc240e000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787787479.619345:0:21126:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff987101db4d28) has exports, disconnecting them 00000020:00080000:3.0:1787787479.619350:0:21126:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff986fc240e000), last request at 1787787397 00000020:00000080:3.0:1787787479.619354:0:21126:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30aa089 00000020:00080000:3.0:1787787479.619364:0:21126:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff986fc240e000): rc 0 00000020:00000080:3.0:1787787479.619370:0:21126:0:(genops.c:885:class_export_put()) final put ffff986fc240e000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787787479.619580:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc2a0a800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787787479.620104:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc240e000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1787787479.622700:0:21126:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787787479.622713:0:21126:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787787479.622718:0:21126:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787787479.622726:0:21126:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787787479.622930:0:21126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787787479.622941:0:21126:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1787787479.622950:0:21126:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787787479.622956:0:21126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787787479.622960:0:21126:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787787479.622967:0:21126:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff986fc240e800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787787479.622974:0:21126:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff9870f4588000) has exports, disconnecting them 00000020:00080000:3.0:1787787479.622979:0:21126:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff986fc240e800), last request at 1787787397 00000020:00000080:3.0:1787787479.622983:0:21126:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30aa09e 00000020:00080000:3.0:1787787479.622999:0:21126:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff986fc240e800): rc 0 00000020:00000080:3.0:1787787479.623018:0:21126:0:(genops.c:885:class_export_put()) final put ffff986fc240e800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787787479.626320:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff986fc4152000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787787479.626336:0:38:0:(genops.c:885:class_export_put()) final put ffff9870c451f000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787787479.626341:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870c451f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787787479.626353:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787787479.626434:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc240e800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1787787479.631232:0:21126:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787787479.631241:0:21126:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787787479.631245:0:21126:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787787479.631252:0:21126:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787787479.631280:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff986fc240a000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787787479.631463:0:21126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787787479.631472:0:21126:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1787787479.631477:0:21126:0:(genops.c:885:class_export_put()) final put ffff986fc2408000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1787787479.631481:0:21126:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc2408000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1787787479.631488:0:21126:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1787787479.631556:0:21126:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9870fc38d000 1 00000020:00000080:1.0:1787787479.631561:0:21126:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30aa03c 00000020:00000080:1.0:1787787479.631566:0:21126:0:(genops.c:885:class_export_put()) final put ffff9870c4531800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1787787479.631575:0:21126:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1787787479.631582:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870c4531800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787787479.631600:0:21126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787787479.631605:0:21126:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787787479.631609:0:21126:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff9870d22f0000) has no exports 00000020:00000080:1.0:1787787479.670346:0:21126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787787479.670360:0:21126:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1787787479.670367:0:21126:0:(genops.c:885:class_export_put()) final put ffff9870f662f800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787787479.670371:0:21126:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f662f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1787787479.670385:0:21126:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1787787479.670521:0:21126:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9870f662a800 00000020:02000400:1.0:1787787479.670576:0:21126:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1787787479.788604:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787480.809615:0:20724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787787480.938231:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 655a2ac3-6e05-4716-af47-ef6019dc5f23->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787787480.938243:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 655a2ac3-6e05-4716-af47-ef6019dc5f23->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787787480.938245:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787787480.938248:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787787480.938653:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503792128:0@lo:400:kworker.0 00000400:00000100:3.0:1787787480.938729:0:3653:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874630503792128 offset 0 length 224: 4 00000100:00100000:2.0:1787787481.641230:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787787466/real 1787787466] req@ffff986fc418de00 x1874630503791232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787787481 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787481.641261:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff986fc418de00 x1874630503791232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787787481 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787787481.641281:0:3652:0:(import.c:65:import_set_state_nolock()) ffff986fc438a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787787481.641304:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787787481.641308:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1874630503791232:0@lo:38:kworker.0 00000100:00080000:0.0:1787787481.641388:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 655a2ac3-6e05-4716-af47-ef6019dc5f23->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787787481.641394:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 655a2ac3-6e05-4716-af47-ef6019dc5f23->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787787481.641396:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787787481.641399:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787787481.641402:0:36:0:(import.c:65:import_set_state_nolock()) ffff986fc438a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787787481.641419:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 610 00000100:00080000:0.0:1787787481.641424:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787787481.641430:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff986fc438a000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:0.0:1787787481.641462:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc43f8000 x1874630503792256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787787481.641522:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1874630503792256:0@lo:38:kworker.0 00000400:00000100:2.0:1787787481.641570:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874630503792256 offset 0 length 520: 4 00010000:00010000:3.0:1787787481.834171:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787482.872435:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1787787482.985447:0:3654:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787787466/real 1787787466] req@ffff986fc418d2c0 x1874630503791360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787787482 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:01000004:2.0:1787787482.990739:0:21328:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000100:00100000:3.0:1787787483.010998:0:3654:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff986fc418d2c0 x1874630503791360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787787482 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787787483.011014:0:3654:0:(import.c:65:import_set_state_nolock()) ffff986fc4388000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787787483.011018:0:3654:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787787483.026616:0:3654:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:1.0:1787787483.026911:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 655a2ac3-6e05-4716-af47-ef6019dc5f23->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787787483.026918:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 655a2ac3-6e05-4716-af47-ef6019dc5f23->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787787483.026921:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787787483.026939:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787787483.026942:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787787483.026945:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787787483.026948:0:38:0:(import.c:65:import_set_state_nolock()) ffff986fc4388000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787787483.026956:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 558 00000100:00080000:1.0:1787787483.026965:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff986fc4388000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:1.0:1787787483.027001:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc489a1c0 x1874630503792384/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787787483.027106:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874630503791360:0@lo:400:kworker.0 00000100:00100000:0.0:1787787483.027246:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3652:1874630503792384:0@lo:38:kworker.0 00000400:00000100:0.0:1787787483.027303:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874630503792384 offset 0 length 520: 4 00000020:01000004:2.0:1787787483.031299:0:21328:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1787787483.031390:0:21328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e0e00/0x11620bc3f30aa10e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa115 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.031424:0:21328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e0e00/0x11620bc3f30aa10e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa115 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.031430:0:21328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e0e00/0x11620bc3f30aa10e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30aa115 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.031438:0:21328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff986fc43e0e00/0x11620bc3f30aa10e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30aa115 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.031469:0:21328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787787483.031474:0:21328:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787787483.031500:0:21328:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787787483.031512:0:21328:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff986fc43f8000 x1874630503792256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787787501 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787483.031533:0:21328:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787787483.031538:0:21328:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787787483.031544:0:21328:0:(import.c:65:import_set_state_nolock()) ffff986fc438a000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1787787483.031549:0:21328:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787787483.031553:0:21328:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff986fc43f8000 x1874630503792256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787787501 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787483.031560:0:21328:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787787483.031562:0:21328:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:0.0:1787787483.031903:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1874630503792256:0@lo:38:kworker.0 00010000:00010000:3.0:1787787483.031988:0:20724:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787483.031996:0:20724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff986fc43e0e00/0x11620bc3f30aa10e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30aa115 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.032005:0:20724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc43e0e00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:3.0:1787787483.032009:0:20724:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff986fc43e0e00/0x11620bc3f30aa10e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30aa115 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.032018:0:20724:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff986fc43e0e00/0x11620bc3f30aa10e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30aa115 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787483.032038:0:20724:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff986fc43e0e00/0x11620bc3f30aa10e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30aa115 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787483.032045:0:20724:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787787483.032047:0:20724:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787787483.032050:0:20724:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787787483.032065:0:20724:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9870c5802000 00010000:00010000:3.0:1787787483.032069:0:20724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff986fc43e0e00/0x11620bc3f30aa10e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x11620bc3f30aa115 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.032076:0:20724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff986fc43e0e00/0x11620bc3f30aa10e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x11620bc3f30aa115 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787483.032099:0:20724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787483.032101:0:20724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787483.032103:0:20724:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787787483.034034:0:21328:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787787483.034049:0:21328:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff986fc418f480 x1874630503791616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787486 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787483.034558:0:21328:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9870ed9243c0 x1874630503791744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787487 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787483.034659:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874630503791616:0@lo:400:kworker.0 00000100:00100000:2.0:1787787483.034699:0:21328:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff986fc43f9680 x1874630503792000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787491 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787483.034707:0:21328:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff986fc43fa580 x1874630503792128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787496 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787483.034723:0:21328:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff986fc489a1c0 x1874630503792384/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787787493 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787483.034739:0:21328:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1787787483.034802:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503792128:0@lo:400:kworker.0 00000100:00100000:1.0:1787787483.034848:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503792000:0@lo:400:kworker.0 00000100:00080000:2.0:1787787483.034945:0:3652:0:(import.c:65:import_set_state_nolock()) ffff986fc4388000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787787483.034950:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-5) 00000100:00100000:2.0:1787787483.034954:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3652:1874630503792384:0@lo:38:kworker.0 00000100:00080000:2.0:1787787483.034976:0:21328:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787787483.034981:0:21328:0:(import.c:65:import_set_state_nolock()) ffff986fc4388000 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1787787483.034986:0:21328:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787787483.034990:0:21328:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9870ed9243c0 x1874630503791744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787487 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787483.034998:0:21328:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff986fc43f9680 x1874630503792000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787491 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787483.035006:0:21328:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff986fc43fa580 x1874630503792128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787496 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787483.035012:0:21328:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787787483.035015:0:21328:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00100000:1.0:1787787483.035373:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503791744:0@lo:400:kworker.0 00010000:00010000:2.0:1787787483.036348:0:21328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee2200/0x11620bc3f30aa0e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa0eb expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.036365:0:21328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee2200/0x11620bc3f30aa0e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa0eb expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.036389:0:21328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee2200/0x11620bc3f30aa0e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30aa0eb expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.036396:0:21328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff987101ee2200/0x11620bc3f30aa0e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30aa0eb expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.036415:0:21328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787483.036422:0:21328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30aa3a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa3a7 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.036429:0:21328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30aa3a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa3a7 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.036436:0:21328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30aa3a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30aa3a7 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.036442:0:21328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30aa3a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x11620bc3f30aa3a7 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787483.036655:0:21328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787787483.036661:0:21328:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787787483.036687:0:21328:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787787483.036691:0:21328:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1787787483.036696:0:21328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787787483.036701:0:21328:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787787483.036705:0:21328:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9870d22f4d28) has no exports 00000020:00080000:2.0:1787787483.036729:0:21328:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9870d22f4d28) has no exports 00010000:00010000:0.0:1787787483.038681:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787787483.038695:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff987101ee2200/0x11620bc3f30aa0e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30aa0eb expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.038707:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2200 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:0.0:1787787483.038712:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff987101ee2200/0x11620bc3f30aa0e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30aa0eb expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.038723:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff987101ee2200/0x11620bc3f30aa0e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30aa0eb expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787483.038731:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff987101ee2200/0x11620bc3f30aa0e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30aa0eb expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787483.038742:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787787483.038746:0:17141:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1787787483.038748:0:17141:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1787787483.038763:0:17141:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9870c5802000 00010000:00010000:0.0:1787787483.038767:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff987101ee2200/0x11620bc3f30aa0e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x11620bc3f30aa0eb expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.038774:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff987101ee2200/0x11620bc3f30aa0e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x11620bc3f30aa0eb expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.038806:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787483.038810:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30aa3a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30aa3a7 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.038816:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f5200 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:0.0:1787787483.038819:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30aa3a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x11620bc3f30aa3a7 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.038827:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30aa3a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30aa3a7 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787483.038833:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30aa3a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30aa3a7 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787483.038838:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787787483.038840:0:17141:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787787483.038841:0:17141:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787787483.038847:0:17141:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9870c5802000 00010000:00010000:0.0:1787787483.038850:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30aa3a0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x11620bc3f30aa3a7 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.038856:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30aa3a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x11620bc3f30aa3a7 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787483.038870:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787483.038872:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787483.038874:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787787483.039337:0:21328:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff986fc37949c0 - data ffff986fc204eaf8/ffff9870c4b37000 00000020:01000000:2.0:1787787483.039494:0:21328:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff986fc3a326c0 - data ffff9870f04a1af8/ffff9870f039d800 00010000:00010000:3.0:1787787483.039830:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787787483.053410:0:21328:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787787483.072976:0:21328:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30aa0f9 00000020:00000080:1.0:1787787483.072989:0:21328:0:(genops.c:885:class_export_put()) final put ffff986fc486e800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1787787483.073014:0:21328:0:(tgt_mount.c:187:server_put_mount()) put mount ffff987101cdc800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1787787483.073017:0:21328:0:(obd_mount.c:710:lustre_put_lsi()) put ffff987101cdc800 2 00000020:01000004:1.0:1787787483.073030:0:21328:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff987101cdc800 from lustre-OST0001 00000020:00000080:1.0:1787787483.073056:0:21328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787787483.073066:0:21328:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1787787483.073092:0:21328:0:(genops.c:885:class_export_put()) final put ffff986fc4869000/lustre-OST0001_UUID 00000020:00000080:2.0:1787787483.073124:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc486e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787787483.073232:0:21328:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc4869000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1787787483.073240:0:21328:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1787787483.073339:0:21328:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 655a2ac3-6e05-4716-af47-ef6019dc5f23->MGS 00010000:00010000:1.0:1787787483.073354:0:21328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff986fc39f3c00/0x11620bc3f30a9f08 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30a9f0f expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787483.073365:0:21328:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff986fc39f3c00/0x11620bc3f30a9f08 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30a9f0f expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787483.073386:0:21328:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1787787483.073389:0:21328:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1787787483.073392:0:21328:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1787787483.073410:0:21328:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9870c5802000 00010000:00010000:1.0:1787787483.073414:0:21328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff986fc39f3c00/0x11620bc3f30a9f08 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x11620bc3f30a9f0f expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787483.073428:0:21328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff987101ee3c00/0x11620bc3f30a9df7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x11620bc3f30a9dfe expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787483.073435:0:21328:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff987101ee3c00/0x11620bc3f30a9df7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x11620bc3f30a9dfe expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787483.073446:0:21328:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787787483.073449:0:21328:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1787787483.073451:0:21328:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1787787483.073461:0:21328:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9870c5802000 00010000:00010000:1.0:1787787483.073468:0:21328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff987101ee3c00/0x11620bc3f30a9df7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x11620bc3f30a9dfe expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787787483.073485:0:21328:0:(import.c:65:import_set_state_nolock()) ffff9870c5802000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1787787483.073489:0:21328:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787787483.073491:0:21328:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787787483.073493:0:21328:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787787483.073497:0:21328:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787787483.073523:0:21328:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff986fc43fa1c0 x1874630503791872/t0(0) o250->MGC192.168.204.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787787490 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787787483.073560:0:21328:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787787483.073563:0:21328:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:2.0:1787787483.073632:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:655a2ac3-6e05-4716-af47-ef6019dc5f23:3652:1874630503791872:0@lo:250:kworker.0 10000000:01000000:1.0:1787787483.073692:0:21328:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787787483.073704:0:21328:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30a9de2 00000020:00000080:1.0:1787787483.073709:0:21328:0:(genops.c:885:class_export_put()) final put ffff9870d4e4a000/655a2ac3-6e05-4716-af47-ef6019dc5f23 00000020:01000000:1.0:1787787483.073722:0:21328:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.131@tcp (flags='') 00000020:00000080:1.0:1787787483.073726:0:21328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787787483.073730:0:21328:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.131@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787787483.073734:0:21328:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9870fc36b370) has no exports 10000000:01000000:3.0:1787787483.073776:0:17149:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:2.0:1787787483.073780:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870d4e4a000/655a2ac3-6e05-4716-af47-ef6019dc5f23 for MGC192.168.204.131@tcp 10000000:01000000:1.0:1787787483.073871:0:21328:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.131@tcp: client import never connected 00000100:00080000:1.0:1787787483.073874:0:21328:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787787483.073875:0:21328:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787787483.073877:0:21328:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787787483.073879:0:21328:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787787483.073925:0:21328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787787483.073929:0:21328:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.131@tcp (uuid 655a2ac3-6e05-4716-af47-ef6019dc5f23) 00000020:01000000:1.0:1787787483.073935:0:21328:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787787483.073938:0:21328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787787483.073941:0:21328:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787787483.073945:0:21328:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff986fc438b800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787787483.073950:0:21328:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff986fc2968000) has exports, disconnecting them 00000020:00080000:1.0:1787787483.073954:0:21328:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff986fc438b800), last request at 1787787414 00000020:00000080:1.0:1787787483.073957:0:21328:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30aa123 00000020:00080000:1.0:1787787483.073968:0:21328:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff986fc438b800): rc 0 00000020:00000080:1.0:1787787483.073971:0:21328:0:(genops.c:885:class_export_put()) final put ffff986fc438b800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787787483.074065:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9870c5802000 for MGC192.168.204.131@tcp 00000020:00000080:2.0:1787787483.074071:0:38:0:(genops.c:885:class_export_put()) final put ffff9870c5807000/655a2ac3-6e05-4716-af47-ef6019dc5f23 00000020:00000080:2.0:1787787483.074073:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870c5807000/655a2ac3-6e05-4716-af47-ef6019dc5f23 for MGC192.168.204.131@tcp 00000020:01000000:2.0:1787787483.074078:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.131@tcp (655a2ac3-6e05-4716-af47-ef6019dc5f23) 00000020:00000080:2.0:1787787483.074683:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc438b800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787787483.084282:0:21328:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787787483.084292:0:21328:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787787483.084306:0:21328:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787787483.084313:0:21328:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787787483.084341:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff986fc438a000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787787483.084503:0:21328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787787483.084511:0:21328:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1787787483.084516:0:21328:0:(genops.c:885:class_export_put()) final put ffff9870c451e800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1787787483.084520:0:21328:0:(genops.c:844:class_export_destroy()) destroying export ffff9870c451e800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1787787483.084529:0:21328:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1787787483.084599:0:21328:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787787483.084603:0:21328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787787483.084608:0:21328:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787787483.084615:0:21328:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff986fc438a800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787787483.084621:0:21328:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff986fc29699b8) has exports, disconnecting them 00000020:00080000:0.0:1787787483.084625:0:21328:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff986fc438a800), last request at 1787787414 00000020:00000080:0.0:1787787483.084629:0:21328:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30aa138 00000020:00080000:0.0:1787787483.084644:0:21328:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff986fc438a800): rc 0 00000020:00000080:0.0:1787787483.084648:0:21328:0:(genops.c:885:class_export_put()) final put ffff986fc438a800/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1787787483.084725:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc438a800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1787787483.085742:0:21328:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787787483.085749:0:21328:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787787483.085753:0:21328:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787787483.085758:0:21328:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787787483.085935:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff986fc4388000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1787787483.086043:0:20724:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1787787483.086328:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1787787483.086518:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1787787483.086706:0:17135:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff987101e2d600:17135] 0 exiting: rc = 1 00000100:00100000:3.0:1787787483.086746:0:17136:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff987101e87000:17136] 1 exiting: rc = 0 00000100:00100000:1.0:1787787483.086817:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787787483.087641:0:17138:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff987101e86200:17138] 1 exiting: rc = 0 00000100:00100000:3.0:1787787483.087699:0:17137:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff987101e86a00:17137] 0 exiting: rc = 1 00000100:00100000:1.0:1787787483.087771:0:17139:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff987101e86800:17139] 2 exiting: rc = 0 00000100:00100000:3.0:1787787483.087914:0:18684:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff986fc4a04400:18684] 3 exiting: rc = 0 00000100:00100000:1.0:1787787483.088062:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088068:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088074:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088080:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088085:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088090:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088107:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088112:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088117:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088122:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088128:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088133:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088323:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088331:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088337:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088342:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088351:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088356:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088361:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088366:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088371:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088445:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088453:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088458:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088463:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088468:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088473:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088477:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088482:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088486:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088491:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088501:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088507:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088512:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088518:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088523:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088528:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088533:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088538:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088544:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088549:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088561:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088565:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088570:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088575:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088586:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088591:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088596:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088601:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088606:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088611:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088616:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088621:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088627:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088632:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088637:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088642:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088647:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088652:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088657:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088662:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088668:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088673:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.088678:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787787483.089577:0:21328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787787483.089587:0:21328:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1787787483.089593:0:21328:0:(genops.c:885:class_export_put()) final put ffff986fc438d000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1787787483.089597:0:21328:0:(genops.c:844:class_export_destroy()) destroying export ffff986fc438d000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1787787483.089608:0:21328:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1787787483.089652:0:21328:0:(obd_mount.c:710:lustre_put_lsi()) put ffff987101cdc800 1 00000020:00000080:1.0:1787787483.089659:0:21328:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x11620bc3f30aa0dd 00000020:00000080:1.0:1787787483.089665:0:21328:0:(genops.c:885:class_export_put()) final put ffff9870f03b8800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1787787483.089676:0:21328:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1787787483.089680:0:21328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787787483.089684:0:21328:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787787483.089695:0:21328:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff987101db19b8) has no exports 00000020:00000080:2.0:1787787483.089934:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9870f03b8800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787787483.115583:0:21328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787787483.115597:0:21328:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1787787483.115603:0:21328:0:(genops.c:885:class_export_put()) final put ffff9870c4bbf000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1787787483.115607:0:21328:0:(genops.c:844:class_export_destroy()) destroying export ffff9870c4bbf000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787787483.115618:0:21328:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1787787483.116080:0:21328:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9870c4bb8800 00000020:01000000:0.0:1787787483.116113:0:21328:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1787787483.116117:0:21328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787787483.116121:0:21328:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787787483.116134:0:21328:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9870f5778000) has no exports 00000020:00000080:0.0:1787787483.116214:0:21328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787787483.116220:0:21328:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1787787483.116224:0:21328:0:(genops.c:885:class_export_put()) final put ffff9870c4537800/OSS_uuid 00000020:00000080:0.0:1787787483.116226:0:21328:0:(genops.c:844:class_export_destroy()) destroying export ffff9870c4537800/OSS_uuid for OSS 00000020:01000000:0.0:1787787483.116230:0:21328:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1787787483.116314:0:18658:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9870c4bf5400:18658] 1 exiting: rc = 0 00000100:00100000:2.0:1787787483.116320:0:19542:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff986fc4385800:19542] 4 exiting: rc = 0 00000100:00080000:3.0:1787787483.116404:0:17148:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1787787483.116405:0:18659:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff986fc3538c00:18659] 2 exiting: rc = 0 00000100:00100000:0.0:1787787483.117076:0:19137:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff986fc4a04600:19137] 3 exiting: rc = 0 00000100:00100000:2.0:1787787483.117269:0:18656:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9870f451a600:18656] 0 exiting: rc = 1 00000100:00100000:0.0:1787787483.117470:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117478:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117484:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117489:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117495:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117500:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117505:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117511:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117516:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117521:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117527:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117532:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117543:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117551:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117556:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117561:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117566:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117572:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117577:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117582:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117587:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117593:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117598:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117603:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117608:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117613:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117618:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117634:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117640:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117645:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117650:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117654:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117659:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117663:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117668:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117673:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117678:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117684:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117689:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117693:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117697:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117702:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117707:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117711:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117716:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117722:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117728:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117733:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117738:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117743:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117747:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117752:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117756:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117761:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117766:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117770:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117775:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117779:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117784:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117789:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117794:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117799:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117812:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.117817:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787483.120296:0:18660:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff987101cb8400:18660] 0 exiting: rc = 1 00000100:00100000:1.0:1787787483.120314:0:18661:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff987101cb9200:18661] 1 exiting: rc = 0 00000100:00100000:0.0:1787787483.120386:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120393:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120397:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120401:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120406:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120410:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120415:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120420:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120425:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120431:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120435:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120441:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120445:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120450:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120456:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120466:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120472:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120478:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120483:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120489:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120494:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120498:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120503:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120508:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120512:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120518:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120523:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120527:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120532:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120537:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120542:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120547:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120551:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120574:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120579:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120585:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120589:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120595:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120601:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120606:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120611:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120616:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120621:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120627:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120632:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120637:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120641:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120647:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120652:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120658:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120662:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120668:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120673:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120679:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120685:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120691:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120697:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120702:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120707:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120712:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120719:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120724:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120729:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.120741:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.122860:0:18662:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9870f36bcc00:18662] 0 exiting: rc = 1 00000100:00100000:3.0:1787787483.122963:0:18663:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9870f451ae00:18663] 1 exiting: rc = 0 00000100:00100000:1.0:1787787483.123258:0:18664:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9870f451be00:18664] 2 exiting: rc = 0 00000100:00100000:0.0:1787787483.123346:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123355:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123362:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123367:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123510:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123516:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123522:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123539:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123546:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123552:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123558:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123565:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123571:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123577:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123583:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123589:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123595:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123600:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123605:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123610:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123617:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123623:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123629:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123636:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123642:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123648:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123654:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123659:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123665:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123672:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123678:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123699:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123706:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123712:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123718:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123724:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123730:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123736:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123742:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123757:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123763:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123770:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123776:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123782:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123787:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123794:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123800:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123805:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123811:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123816:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123823:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123829:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123834:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123840:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123846:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123852:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123858:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123875:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123882:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123889:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123895:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123912:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123930:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.123943:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787787483.136582:0:18665:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9870f451a200:18665] 0 exiting: rc = 1 00000100:00100000:1.0:1787787483.137570:0:18666:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9870f451b000:18666] 1 exiting: rc = 0 00000100:00100000:0.0:1787787483.140237:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140248:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140253:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140258:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140262:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140268:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140273:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140279:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140284:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140288:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140312:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140317:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140323:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140327:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140332:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140337:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140342:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140348:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140353:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140359:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140758:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140768:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140773:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140779:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140787:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140793:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140798:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140802:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140807:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140812:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140816:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140821:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140827:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140832:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140837:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140842:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140854:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140860:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140865:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140871:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140876:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140883:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140888:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140894:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140899:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140914:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140920:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140925:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140931:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140936:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140941:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140947:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140952:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140958:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140963:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140968:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140974:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140979:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140984:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140988:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.140994:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.141000:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.141005:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787787483.141011:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.149038:0:18667:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9870fc10c400:18667] 0 exiting: rc = 1 00000100:00100000:2.0:1787787483.149577:0:18668:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9870f451bc00:18668] 1 exiting: rc = 0 00000100:00100000:1.0:1787787483.150794:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.150830:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.150838:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.150845:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.150863:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.150870:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.150877:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.150882:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.150887:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.150893:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.150898:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.150904:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.150910:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.150939:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.150946:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.150952:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.150958:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.150963:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.150969:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.150975:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.150981:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.150986:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.150991:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.150997:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151002:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151033:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151051:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151058:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151063:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151207:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151216:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151224:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151230:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151236:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151241:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151247:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151253:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151275:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151282:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151287:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151293:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151298:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151304:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151309:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151314:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151320:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151325:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151331:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151336:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151357:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151364:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151369:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151374:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151380:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151385:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151390:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151396:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151402:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151407:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151412:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151417:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151432:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151438:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787787483.151450:0:21328:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787787483.174736:0:21328:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1787787500.999729:0:22093:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg431-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787787510.101546:0:22693:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787787510.101561:0:22693:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787787510.101563:0:22693:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787787510.101681:0:22693:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff986fc2938000 00000020:01000004:2.0:1787787510.101698:0:22693:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787787510.101706:0:22693:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787787510.101720:0:22693:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff987101db19b8) 00000020:00000080:2.0:1787787510.104788:0:22693:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787787510.143707:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787787510.146893:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1787787510.149065:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1787787510.149342:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787787510.149860:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1787787510.150054:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787787510.150263:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1787787510.150495:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1787787510.150730:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1787787510.150951:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787787510.151173:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1787787510.151384:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1787787510.151621:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1787787510.151809:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1787787510.152307:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1787787510.153309:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1787787510.153512:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1787787510.153820:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1787787510.154016:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1787787510.154317:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1787787510.154555:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1787787510.154815:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1787787510.154997:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1787787510.155222:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1787787510.155421:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1787787510.155707:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1787787510.155900:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1787787510.156093:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1787787510.156397:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1787787510.156608:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1787787510.156802:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1787787510.157000:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1787787510.157275:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1787787510.157512:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1787787510.157753:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1787787510.158011:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1787787510.158280:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1787787510.158528:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1787787510.158840:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1787787510.159037:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1787787510.159245:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1787787510.159490:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1787787510.159805:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1787787510.159999:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1787787510.160361:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1787787510.160602:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1787787510.160853:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1787787510.161922:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1787787510.162308:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1787787510.162508:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1787787510.163009:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1787787510.163268:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1787787510.163493:0:22693:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:0.0:1787787510.164035:0:22693:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787787510.164388:0:22693:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787787510.164397:0:22693:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787787510.164415:0:22693:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x11620bc3f30aa6e8 00000020:01000004:0.0:1787787510.164422:0:22693:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1787787510.164427:0:22693:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787787510.164432:0:22693:0:(tgt_mount.c:101:server_register_mount()) register mount ffff986fc2938000 from MGS 00000020:01000004:0.0:1787787510.164436:0:22693:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787787510.164445:0:22693:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff986fc2968000) 00000020:00000080:0.0:1787787510.164455:0:22693:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787787510.164528:0:22693:0:(tgt_mount.c:153:server_get_mount()) get mount ffff986fc2938000 from MGS, refs=2 00080000:01000000:0.0:1787787510.164534:0:22693:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787787510.164540:0:22693:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x11620bc3f30aa6f6 00000100:00100000:0.0:1787787510.164645:0:22693:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787787510.164776:0:22693:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787787510.164783:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787787510.165237:0:22693:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787787510.165244:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787787510.165832:0:22693:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787787510.165998:0:22693:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787787510.166003:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787787510.166538:0:22693:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787787510.166600:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787787510.166963:0:22693:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787787510.166970:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787787510.167691:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787510.167696:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787510.167698:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787510.168113:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787510.168115:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787510.168117:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787510.168708:0:22693:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00000040:01000000:2.0:1787787510.173546:0:22693:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 00010000:00010000:1.0:1787787510.174222:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787787510.174360:0:22705:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787787510.174399:0:22693:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787787510.174431:0:22693:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787787510.175007:0:22693:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787787510.175338:0:22693:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787787510.175484:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787787510.175490:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787787510.176014:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787787510.176021:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787787510.176399:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787787510.176405:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787787510.184011:0:22693:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787787510.184037:0:22693:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.131@tcp' 00000020:01000004:0.0:1787787510.184040:0:22693:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787787510.184113:0:22693:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.131@tcp (typ=mgc) 00000020:00000080:0.0:1787787510.184125:0:22693:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.131@tcp (ffff986fc296cd28) 00000100:00080000:3.0:1787787510.184288:0:22710:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1787787510.184354:0:22693:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787787510.184428:0:22693:0:(ldlm_lib.c:102:import_set_conn()) imp ffff986fc2a11800@MGC192.168.204.131@tcp: add connection 192.168.204.131@tcp at head 00010000:00010000:0.0:1787787510.184664:0:22693:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.131@tcp-0 is initialized 00000040:01000000:0.0:1787787510.184670:0:22693:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.131@tcp ctxt 1 is initialized 10000000:01000000:2.0:1787787510.187069:0:22711:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787787510.187179:0:22693:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.131@tcp (uuid 3fd2c107-7647-408e-8048-4ef16ee44cbc) 00000020:00000080:3.0:1787787510.187202:0:22693:0:(genops.c:1385:class_connect()) connect: client 3fd2c107-7647-408e-8048-4ef16ee44cbc, cookie 0x11620bc3f30aa704 00000100:00080000:3.0:1787787510.187215:0:22693:0:(import.c:510:import_select_connection()) MGC192.168.204.131@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787787510.187221:0:22693:0:(import.c:624:import_select_connection()) MGC192.168.204.131@tcp: import ffff986fc2a11800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:3.0:1787787510.187261:0:22693:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870ed924f00 x1874630503792512/t0(0) o250->MGC192.168.204.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787787510.187284:0:22693:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 3fd2c107-7647-408e-8048-4ef16ee44cbc->MGS 00000020:01000004:3.0:1787787510.187304:0:22693:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787787510.187327:0:22693:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787787510.187341:0:22693:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9870d22f3370) 00000020:00000080:3.0:1787787510.187353:0:22693:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787787510.189701:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed924f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3fd2c107-7647-408e-8048-4ef16ee44cbc:3652:1874630503792512:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787787510.189783:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787510.190369:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503792512 00000100:00100000:2.0:1787787510.190377:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503792512 00000100:00100000:2.0:1787787510.190409:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787787510.190417:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f521f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3652:x1874630503792512:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787787510.190441:0:22706:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 3fd2c107-7647-408e-8048-4ef16ee44cbc@0@lo t0 exp 0000000000000000 cur 654 last 0 00000020:00000080:2.0:1787787510.190469:0:22706:0:(genops.c:1385:class_connect()) connect: client 3fd2c107-7647-408e-8048-4ef16ee44cbc, cookie 0x11620bc3f30aa712 00000100:00080000:2.0:1787787510.190695:0:22706:0:(import.c:65:import_set_state_nolock()) ffff986fc293d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787510.190756:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f521f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+5:3652:x1874630503792512:12345-0@lo:250:mount.lustre.0 Request processed in 338us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787510.190764:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787787510.190814:0:3652:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.131@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787787510.190824:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.131@tcp: connect to target with instance 0 00000100:00080000:2.0:1787787510.190832:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.131@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787787510.190837:0:3652:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787787510.190840:0:3652:0:(import.c:65:import_set_state_nolock()) ffff986fc2a11800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787787510.190842:0:3652:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787787510.190857:0:3652:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787787510.190863:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed924f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3fd2c107-7647-408e-8048-4ef16ee44cbc:3652:1874630503792512:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787787510.202637:0:22693:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787787510.202825:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787787510.202831:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787787510.204119:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787787510.204128:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787787510.204710:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787787510.204717:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787787510.205471:0:22693:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787787510.205727:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787787510.205734:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787787510.206391:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787787510.206398:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787787510.234745:0:22693:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787787510.234977:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787787510.234984:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787787510.236289:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787787510.236300:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787787510.236922:0:22693:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787787510.237070:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787787510.237074:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787787510.237624:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787787510.237631:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787787510.238362:0:22693:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787787510.238535:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787787510.238541:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787787510.238990:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787787510.238997:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787787510.239613:0:22693:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787787510.239752:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787787510.239758:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787787510.240396:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787787510.240403:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787787510.255392:0:22693:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787787510.255708:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787787510.255715:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787787510.257056:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787787510.257067:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787787510.257932:0:22693:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787787510.257942:0:22693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787787510.258798:0:22693:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787787510.258826:0:22693:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1787787510.258833:0:22693:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.131@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787787510.258943:0:22693:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.131@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787787510.258978:0:22693:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.131@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787787510.258983:0:22693:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787787510.258985:0:22693:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787787510.258986:0:22693:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787510.258988:0:22693:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787510.258990:0:22693:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787510.258991:0:22693:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787510.258993:0:22693:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787787510.258995:0:22693:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787787510.258997:0:22693:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787510.258998:0:22693:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787787510.259001:0:22693:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787787510.259003:0:22693:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787787510.259008:0:22693:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787787510.259010:0:22693:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787510.259011:0:22693:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787510.259012:0:22693:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787510.259013:0:22693:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787510.259014:0:22693:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787787510.259015:0:22693:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787787510.259016:0:22693:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787510.259017:0:22693:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787787510.259043:0:22693:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787787510.259062:0:22693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9261c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503792640:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787787510.259128:0:22693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787510.259278:0:22693:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc3761f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787787510.259326:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503792640 00000100:00100000:1.0:1787787510.259333:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503792640 00000100:00100000:1.0:1787787510.259422:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787787510.259432:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f521f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+5:22693:x1874630503792640:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787787510.259470:0:22708:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787787510.259473:0:22708:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787787510.259476:0:22708:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1787787510.259820:0:22730:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787787510.260274:0:22708:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:0.0:1787787510.261530:0:22731:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787787510.261537:0:22731:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1787787510.261540:0:22731:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787787510.261543:0:22731:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787787510.261760:0:22731:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1787787510.261958:0:22708:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787787510.261968:0:22708:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787787510.263400:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f521f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+5:22693:x1874630503792640:12345-0@lo:253:mount.lustre.0 Request processed in 3961us (4262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787510.263418:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787787510.263575:0:22693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9261c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503792640:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787787510.263591:0:22693:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787787510.263594:0:22693:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787787510.263596:0:22693:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787787510.263598:0:22693:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787787510.263599:0:22693:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787787510.263600:0:22693:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787787510.263601:0:22693:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787787510.263603:0:22693:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787787510.263605:0:22693:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787787510.263606:0:22693:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787787510.263608:0:22693:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787787510.263628:0:22693:0:(tgt_mount.c:101:server_register_mount()) register mount ffff986fc2938000 from lustre-MDT0000 10000000:01000000:1.0:1787787510.263660:0:22693:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787787510.263663:0:22693:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787787510.263667:0:22693:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff986fc296cd28 10000000:01000000:1.0:1787787510.263671:0:22693:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787787510.263678:0:22693:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff986fc296cd28 from 1 10000000:01000000:1.0:1787787510.263681:0:22693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787787510.263717:0:22693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e0600/0x11620bc3f30aa719 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787510.263741:0:22693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff986fc43e0600/0x11620bc3f30aa719 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787510.263751:0:22693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff986fc43e0600/0x11620bc3f30aa719 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787510.263772:0:22693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503792768:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787787510.263811:0:22693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787510.263887:0:22693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e085d900 going to sleep for 11 seconds 00000100:00100000:3.0:1787787510.263976:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503792768 00000100:00100000:3.0:1787787510.263982:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503792768 00000100:00100000:3.0:1787787510.264017:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787787510.264025:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f521c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+5:22693:x1874630503792768:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787787510.264037:0:22708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787510.264051:0:22708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c13f4a00/0x11620bc3f30aa720 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa719 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787510.264074:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c13f4a00/0x11620bc3f30aa720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa719 expref: 6 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787510.264085:0:22708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c13f4a00/0x11620bc3f30aa720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa719 expref: 6 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787510.264106:0:22708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f4a00, rc 0) 00000100:00100000:3.0:1787787510.264209:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f521c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+6:22693:x1874630503792768:12345-0@lo:101:mount.lustre.0 Request processed in 183us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787510.264216:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787787510.264330:0:22693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503792768:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787510.264343:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff986fc43e0600/0x11620bc3f30aa719 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa720 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787510.264353:0:22693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff986fc43e0600/0x11620bc3f30aa719 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa720 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787510.264401:0:22693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503792896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787510.264425:0:22693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787510.264486:0:22693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e085d900 going to sleep for 11 seconds 00000100:00100000:3.0:1787787510.264534:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503792896 00000100:00100000:3.0:1787787510.264539:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503792896 00000100:00100000:3.0:1787787510.264661:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787787510.264669:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f521d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+6:22693:x1874630503792896:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787510.264777:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f521d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+6:22693:x1874630503792896:12345-0@lo:501:mount.lustre.0 Request processed in 108us (350us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787787510.264785:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787787510.264849:0:22693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503792896:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787787510.264874:0:22693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787787510.264926:0:22693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e0600/0x11620bc3f30aa719 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa720 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787510.264935:0:22693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff986fc43e0600/0x11620bc3f30aa719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa720 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787510.264953:0:22693:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff986fc2938000 10000000:01000000:1.0:1787787510.264958:0:22693:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787787510.264962:0:22693:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff986fc2938000 10000000:01000000:1.0:1787787510.264965:0:22693:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787787510.264967:0:22693:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff986fc2938000 from 1 10000000:01000000:1.0:1787787510.264970:0:22693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787787510.264987:0:22693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e1600/0x11620bc3f30aa727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787510.264994:0:22693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff986fc43e1600/0x11620bc3f30aa727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787510.265003:0:22693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff986fc43e1600/0x11620bc3f30aa727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787510.265016:0:22693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503793024:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787787510.265042:0:22693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787510.265055:0:22693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e085d900 going to sleep for 11 seconds 00000100:00100000:3.0:1787787510.265096:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503793024 00000100:00100000:3.0:1787787510.265100:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503793024 00000100:00100000:3.0:1787787510.265122:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787787510.265128:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+6:22693:x1874630503793024:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787787510.265213:0:22708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787510.265226:0:22708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c13f5400/0x11620bc3f30aa72e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa727 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787510.265242:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c13f5400/0x11620bc3f30aa72e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa727 expref: 7 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787510.265252:0:22708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c13f5400/0x11620bc3f30aa72e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa727 expref: 7 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787510.265259:0:22708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f5400, rc 0) 00000100:00100000:3.0:1787787510.265284:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+7:22693:x1874630503793024:12345-0@lo:101:mount.lustre.0 Request processed in 156us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787510.265296:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787787510.265364:0:22693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503793024:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787510.265375:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff986fc43e1600/0x11620bc3f30aa727 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa72e expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787510.265384:0:22693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff986fc43e1600/0x11620bc3f30aa727 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa72e expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787510.265395:0:22693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787787510.265510:0:22693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e1600/0x11620bc3f30aa727 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa72e expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787510.265526:0:22693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff986fc43e1600/0x11620bc3f30aa727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa72e expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787510.265533:0:22693:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787787510.265536:0:22693:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787787510.265541:0:22693:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff986fc2938000 10000000:01000000:1.0:1787787510.265543:0:22693:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787787510.265556:0:22693:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787787510.265559:0:22693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787787510.265574:0:22693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e1a00/0x11620bc3f30aa735 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787510.265581:0:22693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff986fc43e1a00/0x11620bc3f30aa735 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787510.265589:0:22693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff986fc43e1a00/0x11620bc3f30aa735 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787510.265602:0:22693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503793152:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787787510.265627:0:22693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787510.265652:0:22693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e085d900 going to sleep for 11 seconds 00000100:00100000:3.0:1787787510.265754:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503793152 00000100:00100000:3.0:1787787510.265759:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503793152 00000100:00100000:3.0:1787787510.265794:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787787510.265800:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+7:22693:x1874630503793152:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787787510.265808:0:22708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787510.265816:0:22708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c13f4400/0x11620bc3f30aa73c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa735 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787510.265829:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c13f4400/0x11620bc3f30aa73c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa735 expref: 8 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787510.265837:0:22708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c13f4400/0x11620bc3f30aa73c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa735 expref: 8 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787510.265844:0:22708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f4400, rc 0) 00000100:00100000:3.0:1787787510.265879:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+8:22693:x1874630503793152:12345-0@lo:101:mount.lustre.0 Request processed in 79us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787510.265885:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787787510.265978:0:22693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503793152:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787510.265990:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff986fc43e1a00/0x11620bc3f30aa735 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa73c expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787510.265998:0:22693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff986fc43e1a00/0x11620bc3f30aa735 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa73c expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787510.266055:0:22693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503793280:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787510.266079:0:22693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787510.266100:0:22693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e085d900 going to sleep for 11 seconds 00000100:00100000:3.0:1787787510.266165:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503793280 00000100:00100000:3.0:1787787510.266170:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503793280 00000100:00100000:3.0:1787787510.266233:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787787510.266241:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+8:22693:x1874630503793280:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787510.266359:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+9:22693:x1874630503793280:12345-0@lo:501:mount.lustre.0 Request processed in 119us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787510.266365:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787787510.266430:0:22693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503793280:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787787510.266458:0:22693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503793408:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787787510.266506:0:22693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787510.266714:0:22693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c538f480 going to sleep for 11 seconds 00000100:00100000:1.0:1787787510.266773:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503793408 00000100:00100000:1.0:1787787510.266778:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503793408 00000100:00100000:1.0:1787787510.266801:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787787510.266807:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+9:22693:x1874630503793408:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787510.267555:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+9:22693:x1874630503793408:12345-0@lo:503:mount.lustre.0 Request processed in 738us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787510.267563:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787787510.267644:0:22693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503793408:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787787510.268378:0:22732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3fd2c107-7647-408e-8048-4ef16ee44cbc:22732:1874630503793536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787787510.268423:0:22732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787510.268508:0:22732:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c538f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787787510.268541:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503793536 00000100:00100000:1.0:1787787510.268610:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503793536 00000100:00100000:1.0:1787787510.268683:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787787510.268692:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+9:22732:x1874630503793536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787510.269263:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+9:22732:x1874630503793536:12345-0@lo:502:llog_process_th.0 Request processed in 570us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787510.269270:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787787510.269368:0:22732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f8780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3fd2c107-7647-408e-8048-4ef16ee44cbc:22732:1874630503793536:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787787510.269393:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787510.269404:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787510.269407:0:22732:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787787510.269427:0:22732:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787787510.269431:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787787510.269445:0:22732:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff986fc296b370) 00000020:00000080:0.0:1787787510.269460:0:22732:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787787510.269465:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787787510.269565:0:22732:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787787510.269572:0:22732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x11620bc3f30aa74a 00000020:00000080:0.0:1787787510.269774:0:22732:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787787510.269785:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787510.269789:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787510.269791:0:22732:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787787510.269796:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787510.269800:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787510.269801:0:22732:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787787510.269804:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787787510.269812:0:22732:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff986fc29699b8) 00000020:00000080:0.0:1787787510.269822:0:22732:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787787510.269826:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787787510.269828:0:22732:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787787510.269830:0:22732:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787787510.269836:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787787510.269881:0:22732:0:(tgt_mount.c:153:server_get_mount()) get mount ffff986fc2938000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787787510.269895:0:22732:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9870fc36b370) 00000020:00000080:0.0:1787787510.269903:0:22732:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787787510.269976:0:22732:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787787510.269982:0:22732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x11620bc3f30aa75f 00000020:00000080:0.0:1787787510.270071:0:22732:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787787510.270077:0:22732:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787787510.270082:0:22732:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x11620bc3f30aa766 00080000:01000000:0.0:1787787510.270086:0:22732:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787787510.270090:0:22732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x11620bc3f30aa76d 00010000:00010000:1.0:1787787510.323222:0:22732:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1787787510.323675:0:22732:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934638 00000001:00080000:1.0:1787787510.324167:0:22732:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787787510.324867:0:22732:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9870f577b370) 00000020:00000080:1.0:1787787510.324884:0:22732:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787787510.324949:0:22732:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787787510.324958:0:22732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x11620bc3f30aa77b 00000020:00000080:1.0:1787787510.325461:0:22732:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787787510.330823:0:22732:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x11620bc3f30aa782 00000020:00000080:0.0:1787787510.332308:0:22732:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787787510.332322:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787510.332329:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787510.332331:0:22732:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787787510.332335:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787787510.332339:0:22732:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1787787510.332340:0:22732:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787787510.332342:0:22732:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787787510.332344:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787787510.332346:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787510.332347:0:22732:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787787510.332362:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787510.332367:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787510.332369:0:22732:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787787510.332374:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787787510.332418:0:22732:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787787510.332435:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787510.332439:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787510.332440:0:22732:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787787510.332443:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787510.332446:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787510.332447:0:22732:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1787787510.332450:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787787510.332455:0:22732:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.131@tcp to nid 0x20000c0a8cc83 (192.168.204.131@tcp) 00000020:00000080:0.0:1787787510.332482:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787787510.332508:0:22732:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9870fc36cd28) 00000020:00000080:0.0:1787787510.332523:0:22732:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1787787510.332529:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787787510.332802:0:22732:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1787787510.332808:0:22732:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787787510.332815:0:22732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x11620bc3f30aa790 00010000:00080000:0.0:1787787510.332849:0:22732:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9870f3633000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.131@tcp at head 00010000:00010000:0.0:1787787510.335328:0:22732:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1787787510.336554:0:22732:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787787510.336575:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787787510.336612:0:22732:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787787510.336635:0:22732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x11620bc3f30aa797 00000100:00080000:3.0:1787787510.336646:0:22732:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787787510.336652:0:22732:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9870f3633000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:3.0:1787787510.336802:0:22732:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870ed9261c0 x1874630503793664/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787787510.336834:0:22732:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1787787510.336914:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787510.336919:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787510.336920:0:22732:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1787787510.336923:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787787510.336926:0:22732:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1787787510.336928:0:22732:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787787510.336929:0:22732:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787787510.336931:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787787510.336933:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787510.336934:0:22732:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787787510.336936:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787787510.336941:0:22732:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787787510.336944:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787510.336945:0:22732:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787787510.336948:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787787510.336952:0:22732:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.131@tcp to nid 0x20000c0a8cc83 (192.168.204.131@tcp) 00000020:01000000:3.0:1787787510.336976:0:22732:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787787510.336978:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787787510.336991:0:22732:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9870d22f4d28) 00000020:00000080:3.0:1787787510.337004:0:22732:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787787510.337009:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787787510.337066:0:22732:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787787510.337073:0:22732:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787787510.337086:0:22732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x11620bc3f30aa7a5 00010000:00080000:3.0:1787787510.337116:0:22732:0:(ldlm_lib.c:102:import_set_conn()) imp ffff987101e32800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.131@tcp at head 00010000:00010000:3.0:1787787510.337337:0:22732:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1787787510.337654:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503793664:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787787510.337744:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787510.339089:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503793664 00000100:00100000:3.0:1787787510.339102:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503793664 00000100:00100000:3.0:1787787510.339164:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787787510.339173:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1874630503793664:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1787787510.339191:0:22719:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:0.0:1787787510.339747:0:22732:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787787510.340073:0:22732:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787787510.344879:0:22732:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787787510.345231:0:22732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1787787510.353215:0:22732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:0.0:1787787510.358934:0:22738:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787787510.358942:0:22738:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:3.0:1787787510.364089:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1874630503793664:12345-0@lo:38:llog_process_th.0 Request processed in 24906us (26336us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787787510.364104:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787787510.364190:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870f3633000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787787510.364195:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787787510.364199:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503793664:0@lo:38:llog_process_th.0 00000020:00000080:1.0:1787787510.365343:0:22732:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787787510.365369:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787787510.365415:0:22732:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787787510.365434:0:22732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x11620bc3f30aa7ac 00000100:00080000:1.0:1787787510.365443:0:22732:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787787510.365449:0:22732:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff987101e32800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:1.0:1787787510.365481:0:22732:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc489b0c0 x1874630503793792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787787510.365564:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503793792:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787787510.365610:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874630503793792 offset 0 length 520: 4 00000100:00080000:1.0:1787787510.365716:0:22732:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787787510.365781:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787787510.365785:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787510.365787:0:22732:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787787510.365790:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787787510.365793:0:22732:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1787787510.365795:0:22732:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787787510.365797:0:22732:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787787510.365798:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787787510.365801:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787510.365802:0:22732:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787787510.365805:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787787510.365809:0:22732:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787787510.365812:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787787510.365814:0:22732:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787787510.365817:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787787510.365820:0:22732:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.131@tcp to nid 0x20000c0a8cc83 (192.168.204.131@tcp) 00000020:01000000:1.0:1787787510.365841:0:22732:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787787510.365845:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787787510.365856:0:22732:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9870f5778000) 00000020:00000080:1.0:1787787510.365868:0:22732:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1787787510.365874:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787787510.365935:0:22732:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787787510.365941:0:22732:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:1.0:1787787510.365955:0:22732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x11620bc3f30aa7ba 00010000:00080000:1.0:1787787510.365984:0:22732:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9870c580d800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.131@tcp at head 00010000:00010000:1.0:1787787510.366211:0:22732:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787787510.366275:0:22732:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787787510.366287:0:22732:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787787510.368395:0:22732:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787787510.368679:0:22732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1787787510.368809:0:22732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:0.0:1787787510.369306:0:22740:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787787510.369311:0:22740:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787787510.370306:0:22732:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787787510.370319:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787787510.370356:0:22732:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787787510.370377:0:22732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x11620bc3f30aa7c1 00000100:00080000:0.0:1787787510.370388:0:22732:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787787510.370394:0:22732:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9870c580d800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:0.0:1787787510.370430:0:22732:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc43fa940 x1874630503793920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787787510.370486:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503793920:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787787510.370620:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874630503793920 offset 0 length 520: 4 00000100:00080000:0.0:1787787510.370676:0:22732:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787787510.370744:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787510.370749:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787510.370750:0:22732:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787787510.370753:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787510.370757:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787510.370758:0:22732:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787787510.370761:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787787510.370763:0:22732:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787787510.370765:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787510.370767:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787510.370768:0:22732:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787787510.370770:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787510.370772:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787510.370773:0:22732:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787787510.370777:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787787510.370806:0:22732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3fd2c107-7647-408e-8048-4ef16ee44cbc:22732:1874630503794048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787787510.370858:0:22732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787510.370884:0:22732:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c538f300 going to sleep for 11 seconds 00000100:00100000:2.0:1787787510.370949:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503794048 00000100:00100000:2.0:1787787510.370956:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503794048 00000100:00100000:2.0:1787787510.371007:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787787510.371017:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+9:22732:x1874630503794048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787510.371134:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+9:22732:x1874630503794048:12345-0@lo:502:llog_process_th.0 Request processed in 118us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787510.371165:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787787510.371406:0:22732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3fd2c107-7647-408e-8048-4ef16ee44cbc:22732:1874630503794048:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787787510.371432:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787510.371436:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787510.371439:0:22732:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787787510.371442:0:22732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1787787510.371702:0:22693:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1787787510.371725:0:22693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787787510.371745:0:22693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e1a00/0x11620bc3f30aa735 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa73c expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787510.371757:0:22693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff986fc43e1a00/0x11620bc3f30aa735 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa73c expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787510.371765:0:22693:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff986fc2938000 from 1 10000000:01000000:1.0:1787787510.371768:0:22693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787787510.371798:0:22693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aa7c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787510.371807:0:22693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aa7c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787510.371817:0:22693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aa7c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787510.371834:0:22693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503794176:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787787510.371872:0:22693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787510.371907:0:22693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0920c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787510.372049:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503794176 00000100:00100000:0.0:1787787510.372054:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503794176 00000100:00100000:0.0:1787787510.372089:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787787510.372098:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+9:22693:x1874630503794176:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787787510.372108:0:22708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787510.372122:0:22708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870f6658400/0x11620bc3f30aa7cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa7c8 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787510.372170:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870f6658400/0x11620bc3f30aa7cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa7c8 expref: 10 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787510.372182:0:22708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870f6658400/0x11620bc3f30aa7cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa7c8 expref: 10 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787510.372191:0:22708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f6658400, rc 0) 00000100:00100000:0.0:1787787510.372227:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+10:22693:x1874630503794176:12345-0@lo:101:mount.lustre.0 Request processed in 130us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787510.372234:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787787510.372354:0:22693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503794176:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787510.372368:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aa7c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa7cf expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787510.372387:0:22693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aa7c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa7cf expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787510.372976:0:22693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503794304:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787787510.373030:0:22693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787510.373062:0:22693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0920c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787510.373325:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503794304 00000100:00100000:0.0:1787787510.373331:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503794304 00000100:00100000:0.0:1787787510.373363:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787787510.373370:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+10:22693:x1874630503794304:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787787510.373386:0:22707:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787787510.373398:0:22707:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787787510.373465:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+10:22693:x1874630503794304:12345-0@lo:256:mount.lustre.0 Request processed in 95us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787510.373472:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787787510.373667:0:22693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503794304:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787787510.374543:0:22693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787787510.374674:0:22693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aa7c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa7cf expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787510.374685:0:22693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aa7c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa7cf expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787510.374869:0:22693:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff986fc2938000 from 1 10000000:01000000:2.0:1787787510.374873:0:22693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787787510.374910:0:22693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee2e00/0x11620bc3f30aa7d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787510.374918:0:22693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff987101ee2e00/0x11620bc3f30aa7d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787510.374928:0:22693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff987101ee2e00/0x11620bc3f30aa7d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787510.374957:0:22693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503794432:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787787510.375011:0:22693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787510.375088:0:22693:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101e38b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787787510.375230:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503794432 00000100:00100000:0.0:1787787510.375236:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503794432 00000100:00100000:0.0:1787787510.375317:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787787510.375326:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+10:22693:x1874630503794432:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787787510.375338:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787510.375351:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870f6659600/0x11620bc3f30aa7dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa7d6 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787510.375373:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870f6659600/0x11620bc3f30aa7dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa7d6 expref: 11 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787510.375384:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870f6659600/0x11620bc3f30aa7dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa7d6 expref: 11 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787510.375393:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f6659600, rc 0) 00000100:00100000:0.0:1787787510.375439:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+11:22693:x1874630503794432:12345-0@lo:101:mount.lustre.0 Request processed in 114us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787510.375446:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787787510.375528:0:22693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503794432:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787787510.375541:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff987101ee2e00/0x11620bc3f30aa7d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa7dd expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787510.375562:0:22693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff987101ee2e00/0x11620bc3f30aa7d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa7dd expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787510.375621:0:22693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503794560:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787787510.375647:0:22693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787510.375864:0:22693:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101e38b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787787510.375894:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503794560 00000100:00100000:3.0:1787787510.375899:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503794560 00000100:00100000:3.0:1787787510.375923:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787787510.375930:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+11:22693:x1874630503794560:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787510.376092:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+11:22693:x1874630503794560:12345-0@lo:501:mount.lustre.0 Request processed in 161us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787510.376099:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787787510.377663:0:22693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503794560:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787787510.377788:0:22693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503794688:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787787510.377852:0:22693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787510.377939:0:22693:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101e38b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787787510.378058:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503794688 00000100:00100000:0.0:1787787510.378065:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503794688 00000100:00100000:1.0:1787787510.378351:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787787510.378363:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+11:22693:x1874630503794688:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787510.378534:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+11:22693:x1874630503794688:12345-0@lo:503:mount.lustre.0 Request processed in 173us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787510.378543:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787787510.378835:0:22693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503794688:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787787510.379314:0:22742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3fd2c107-7647-408e-8048-4ef16ee44cbc:22742:1874630503794816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787510.379361:0:22742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787510.379571:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101e38240 going to sleep for 11 seconds 00000100:00100000:1.0:1787787510.379763:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503794816 00000100:00100000:1.0:1787787510.379769:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503794816 00000100:00100000:1.0:1787787510.379800:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787787510.379809:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+11:22742:x1874630503794816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787510.380239:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+11:22742:x1874630503794816:12345-0@lo:502:llog_process_th.0 Request processed in 430us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787510.380258:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787787510.380407:0:22742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3fd2c107-7647-408e-8048-4ef16ee44cbc:22742:1874630503794816:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787787510.380433:0:22742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787787510.380447:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787510.380449:0:22742:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787787510.380457:0:22742:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff986fc2938000 00000020:00000080:2.0:1787787510.380459:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787787510.380467:0:22742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787510.380469:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787510.380471:0:22742:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787787510.380473:0:22742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787787510.380476:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787510.380478:0:22742:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787787510.380481:0:22742:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff986fc2938000 00000020:00000080:2.0:1787787510.380483:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787787510.380622:0:22742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787510.380626:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787510.380628:0:22742:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787787510.380630:0:22742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787787510.380633:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787510.380634:0:22742:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787787510.380637:0:22742:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff986fc2938000 00000020:00000080:2.0:1787787510.380639:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787787510.380659:0:22742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787510.380662:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787510.380664:0:22742:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787787510.380666:0:22742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787787510.380668:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787510.380669:0:22742:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787787510.380672:0:22742:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff986fc2938000 00000020:00000080:2.0:1787787510.380674:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787787510.380724:0:22742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3fd2c107-7647-408e-8048-4ef16ee44cbc:22742:1874630503794944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787787510.380766:0:22742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787510.380789:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101e38240 going to sleep for 11 seconds 00000100:00100000:1.0:1787787510.382735:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503794944 00000100:00100000:1.0:1787787510.382749:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503794944 00000100:00100000:1.0:1787787510.382803:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787787510.382813:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+11:22742:x1874630503794944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787510.382965:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+11:22742:x1874630503794944:12345-0@lo:502:llog_process_th.0 Request processed in 153us (2197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787510.382973:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787787510.383670:0:22742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3fd2c107-7647-408e-8048-4ef16ee44cbc:22742:1874630503794944:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787787510.383724:0:22742:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787510.383732:0:22742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787510.383734:0:22742:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787787510.383739:0:22742:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787787510.385806:0:22693:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787787510.385848:0:22693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787787510.385869:0:22693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee2e00/0x11620bc3f30aa7d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa7dd expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787510.385882:0:22693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff987101ee2e00/0x11620bc3f30aa7d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa7dd expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787510.385937:0:22693:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787787510.385940:0:22693:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff986fc2938000 10000000:01000000:1.0:1787787510.385944:0:22693:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff986fc2938000 10000000:01000000:1.0:1787787510.385948:0:22693:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787787510.385954:0:22693:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff986fc2938000 from 1 10000000:01000000:1.0:1787787510.385957:0:22693:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787787510.385992:0:22693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e1800/0x11620bc3f30aa7e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787510.386001:0:22693:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff986fc43e1800/0x11620bc3f30aa7e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787510.386013:0:22693:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff986fc43e1800/0x11620bc3f30aa7e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787510.386045:0:22693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503795072:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787787510.386113:0:22693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787510.386176:0:22693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e085da80 going to sleep for 11 seconds 00000100:00100000:1.0:1787787510.386208:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503795072 00000100:00100000:1.0:1787787510.386214:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503795072 00000100:00100000:1.0:1787787510.386256:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787787510.386265:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+11:22693:x1874630503795072:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787510.386277:0:22708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787510.386291:0:22708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc43e1e00/0x11620bc3f30aa7eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa7e4 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787510.386313:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc43e1e00/0x11620bc3f30aa7eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa7e4 expref: 12 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787510.386323:0:22708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc43e1e00/0x11620bc3f30aa7eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa7e4 expref: 12 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787510.386331:0:22708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc43e1e00, rc 0) 00000100:00100000:1.0:1787787510.386370:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+12:22693:x1874630503795072:12345-0@lo:101:mount.lustre.0 Request processed in 106us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787510.386378:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787787510.386432:0:22693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503795072:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787510.386446:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff986fc43e1800/0x11620bc3f30aa7e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa7eb expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787510.386455:0:22693:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff986fc43e1800/0x11620bc3f30aa7e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa7eb expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787510.386529:0:22693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503795200:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787510.387429:0:22693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787510.387461:0:22693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e085da80 going to sleep for 11 seconds 00000100:00100000:1.0:1787787510.387484:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503795200 00000100:00100000:1.0:1787787510.387489:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503795200 00000100:00100000:1.0:1787787510.387535:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787787510.387543:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c6c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+12:22693:x1874630503795200:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787510.387822:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c6c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+12:22693:x1874630503795200:12345-0@lo:501:mount.lustre.0 Request processed in 280us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787510.387830:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787787510.387875:0:22693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503795200:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787510.387911:0:22693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503795328:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787510.387949:0:22693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787510.387962:0:22693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e085da80 going to sleep for 11 seconds 00000100:00100000:1.0:1787787510.387975:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503795328 00000100:00100000:1.0:1787787510.387979:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503795328 00000100:00100000:1.0:1787787510.388001:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787787510.388007:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c6c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+12:22693:x1874630503795328:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787510.388081:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c6c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+12:22693:x1874630503795328:12345-0@lo:503:mount.lustre.0 Request processed in 73us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787510.388087:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787787510.388127:0:22693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503795328:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787787510.394929:0:22744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3fd2c107-7647-408e-8048-4ef16ee44cbc:22744:1874630503795456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787787510.395016:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787510.395063:0:22744:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c2ddf600 going to sleep for 11 seconds 00000100:00100000:1.0:1787787510.395122:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503795456 00000100:00100000:1.0:1787787510.395135:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503795456 00000100:00100000:1.0:1787787510.395209:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787787510.395218:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c6c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+12:22744:x1874630503795456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787510.395338:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c6c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+12:22744:x1874630503795456:12345-0@lo:502:llog_process_th.0 Request processed in 121us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787510.395346:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787787510.395649:0:22744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3fd2c107-7647-408e-8048-4ef16ee44cbc:22744:1874630503795456:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1787787510.395846:0:22744:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787787510.395861:0:22744:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9870f577cd28) 00000020:00000080:1.0:1787787510.395881:0:22744:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1787787510.395967:0:22744:0:(tgt_mount.c:153:server_get_mount()) get mount ffff986fc2938000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787787510.395972:0:22744:0:(tgt_mount.c:187:server_put_mount()) put mount ffff986fc2938000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787787510.395975:0:22744:0:(obd_mount.c:710:lustre_put_lsi()) put ffff986fc2938000 4 00010000:00080000:1.0:1787787510.396005:0:22744:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9870fc07c800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.131@tcp at head 00010000:00010000:1.0:1787787510.404782:0:22744:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1787787510.407164:0:22744:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787787510.407210:0:22744:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787787510.407225:0:22744:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x11620bc3f30aa7f9 00000100:00080000:1.0:1787787510.407236:0:22744:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787787510.407242:0:22744:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9870fc07c800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:1.0:1787787510.407281:0:22744:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc489b480 x1874630503795584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787787510.407328:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874630503795584:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787787510.407403:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787787510.407463:0:22744:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787787510.407922:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503795584 00000100:00100000:3.0:1787787510.407930:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503795584 00000100:00100000:1.0:1787787510.408115:0:22744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3fd2c107-7647-408e-8048-4ef16ee44cbc:22744:1874630503795712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787510.408188:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787510.408296:0:22744:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101faa600 going to sleep for 11 seconds 00000100:00100000:2.0:1787787510.409240:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787787510.409250:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3652:x1874630503795584:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787787510.409322:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3652:x1874630503795584:12345-0@lo:38:llog_process_th.0 Request processed in 72us (1920us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787787510.409329:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787787510.409433:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787787510.409442:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870fc07c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787787510.409452:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787787510.409457:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874630503795584:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787787510.409811:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503795712 00000100:00100000:3.0:1787787510.409817:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503795712 00000100:00100000:3.0:1787787510.409855:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787787510.409862:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+12:22744:x1874630503795712:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787787510.409988:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+12:22744:x1874630503795712:12345-0@lo:502:llog_process_th.0 Request processed in 126us (1799us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787510.409996:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787787510.410303:0:22744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3fd2c107-7647-408e-8048-4ef16ee44cbc:22744:1874630503795712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787510.410357:0:22744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3fd2c107-7647-408e-8048-4ef16ee44cbc:22744:1874630503795840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787510.410394:0:22744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787510.410420:0:22744:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101faa600 going to sleep for 11 seconds 00000100:00100000:1.0:1787787510.410434:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503795840 00000100:00100000:1.0:1787787510.410438:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503795840 00000100:00100000:1.0:1787787510.410471:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787787510.410478:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+12:22744:x1874630503795840:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787787510.410581:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+12:22744:x1874630503795840:12345-0@lo:502:llog_process_th.0 Request processed in 104us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787510.410589:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787787510.410627:0:22744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3fd2c107-7647-408e-8048-4ef16ee44cbc:22744:1874630503795840:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787787510.410644:0:22744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787787510.410748:0:22693:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787787510.410771:0:22693:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787787510.410787:0:22693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e1800/0x11620bc3f30aa7e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa7eb expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787510.410798:0:22693:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff986fc43e1800/0x11620bc3f30aa7e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa7eb expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787787510.410844:0:22693:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787787510.410846:0:22693:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787787510.410847:0:22693:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787787510.410849:0:22693:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787787510.410855:0:22693:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787787510.410856:0:22693:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787787510.410857:0:22693:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787787510.410859:0:22693:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787787510.410860:0:22693:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787787510.410861:0:22693:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787787510.410865:0:22693:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787787510.410868:0:22693:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787787510.410869:0:22693:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787787510.410870:0:22693:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787787510.410871:0:22693:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787787510.410872:0:22693:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787787510.410873:0:22693:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787787510.410873:0:22693:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787787510.410874:0:22693:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787787510.410875:0:22693:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787787510.410876:0:22693:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787787510.410888:0:22693:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787787510.410897:0:22693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503795968:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787787510.410927:0:22693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787510.410941:0:22693:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101faa600 going to sleep for 11 seconds 00000100:00100000:3.0:1787787510.411849:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503795968 00000100:00100000:3.0:1787787510.411859:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503795968 00000100:00100000:3.0:1787787510.411904:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787787510.411912:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+12:22693:x1874630503795968:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787787510.411937:0:22707:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787787510.411952:0:22707:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787787510.416701:0:22707:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787787510.417406:0:22707:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787787510.420562:0:22730:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787787510.420574:0:22730:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787787510.420596:0:22730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9870f6658600/0x11620bc3f30aa800 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787510.420738:0:22730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870f6658400/0x11620bc3f30aa7cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa7c8 expref: 12 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787510.420749:0:22730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9870f6658600/0x11620bc3f30aa800 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787510.420794:0:22730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870f6658400/0x11620bc3f30aa7cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30aa7c8 expref: 12 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787510.420810:0:22730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9870f6658400/0x11620bc3f30aa7cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30aa7c8 expref: 12 pid: 22708 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787510.420825:0:22730:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22730:1874630503796096:0@lo:104: 00000100:00100000:0.0:1787787510.420891:0:22730:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787510.421001:0:22730:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c2ddf900 going to sleep for 11 seconds 00000100:00100000:0.0:1787787510.421041:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503796096 00000100:00100000:0.0:1787787510.421047:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503796096 00000100:00100000:0.0:1787787510.421086:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787787510.421095:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3fd2c107-7647-408e-8048-4ef16ee44cbc+3:22730:x1874630503796096:12345-0@lo:104: 00010000:00010000:0.0:1787787510.421224:0:22697:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aa7c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa7cf expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787510.421278:0:22697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787787510.421289:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3fd2c107-7647-408e-8048-4ef16ee44cbc+3:22730:x1874630503796096:12345-0@lo:104: Request processed in 195us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787510.421297:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787787510.421339:0:22730:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22730:1874630503796096:0@lo:104: 00010000:00010000:0.0:1787787510.421357:0:22730:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9870f6658600/0x11620bc3f30aa800 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787510.421375:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787510.421381:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aa7c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa7cf expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787510.421389:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc43e1200 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:0.0:1787787510.421394:0:22703:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aa7c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30aa7cf expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787510.421402:0:22703:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aa7c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30aa7cf expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787510.421409:0:22703:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aa7c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30aa7cf expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787510.421414:0:22703:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787787510.421441:0:22703:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aa7c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa7cf expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787510.421448:0:22703:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787787510.421472:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aa7c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa7cf expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787510.421478:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aa7c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa7cf expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787510.421508:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1787787510.421509:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787510.421511:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787510.421512:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787510.421519:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3fd2c107-7647-408e-8048-4ef16ee44cbc:3653:1874630503796224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787510.421731:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+12:22693:x1874630503795968:12345-0@lo:253:mount.lustre.0 Request processed in 9819us (10801us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787510.421741:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787787510.421840:0:22693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:22693:1874630503795968:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787787510.421850:0:22693:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787787510.421853:0:22693:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787787510.421854:0:22693:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787787510.421856:0:22693:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787510.421858:0:22693:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787510.421859:0:22693:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787510.421860:0:22693:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787510.421862:0:22693:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787787510.421863:0:22693:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787787510.421865:0:22693:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787510.421867:0:22693:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787787510.421878:0:22693:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1787787510.423673:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787510.423765:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503796224 00000100:00100000:3.0:1787787510.423773:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503796224 00010000:00010000:3.0:1787787510.423807:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870f6658400/0x11620bc3f30aa7cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa7c8 expref: 12 pid: 22708 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787510.423837:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787787510.423845:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed9261c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2c107-7647-408e-8048-4ef16ee44cbc+12:3653:x1874630503796224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787787510.423859:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787510.423864:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870f6658400/0x11620bc3f30aa7cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa7c8 expref: 12 pid: 22708 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787510.423884:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870f6658400/0x11620bc3f30aa7cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30aa7c8 expref: 12 pid: 22708 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787510.423903:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870f6658400/0x11620bc3f30aa7cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30aa7c8 expref: 12 pid: 22708 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787510.423917:0:22699:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9870f6658600/0x11620bc3f30aa800 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787510.423927:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870f6658600/0x11620bc3f30aa800 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787787510.423943:0:22699:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003370791s 00010000:00010000:3.0:1787787510.423948:0:22699:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9870f6658600/0x11620bc3f30aa800 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787510.423955:0:22699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9870f6658600/0x11620bc3f30aa800 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787510.423962:0:22699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9870f6658600/0x11620bc3f30aa800 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787510.423969:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9870f6658600/0x11620bc3f30aa800 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787510.423976:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6658600 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787510.423981:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9870f6658600/0x11620bc3f30aa800 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787510.423989:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9870f6658600/0x11620bc3f30aa800 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787510.424010:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9870f6658600/0x11620bc3f30aa800 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787510.424021:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787510.424072:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed9261c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2c107-7647-408e-8048-4ef16ee44cbc+11:3653:x1874630503796224:12345-0@lo:103:ldlm_bl.0 Request processed in 228us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787510.424080:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787787510.424107:0:22730:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9870f6658600/0x11620bc3f30aa800 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787510.424115:0:22730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9870f6658600/0x11620bc3f30aa800 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787510.424121:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870f6658600/0x11620bc3f30aa800 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787510.424172:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3fd2c107-7647-408e-8048-4ef16ee44cbc:3653:1874630503796224:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1787787510.450792:0:22693:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:1.0:1787787510.451846:0:22693:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787787510.451877:0:22754:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:0.0:1787787510.451881:0:22754:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:1.0:1787787510.452266:0:22755:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787787510.452639:0:22693:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1787787510.452664:0:22755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787787510.454837:0:22755:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787787510.454910:0:22755:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:3.0:1787787510.456120:0:22756:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9870ed924f00 x1874630503796352/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787510.456135:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c74db600 going to sleep for 0 seconds 00000040:01000000:1.0:1787787510.459886:0:22693:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787787510.459929:0:22693:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787787510.460663:0:22693:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787787510.460673:0:22693:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787787510.460719:0:22693:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787787510.462369:0:22693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787787510.463280:0:22693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787787510.463326:0:22693:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787787510.466239:0:22693:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:1.0:1787787510.467254:0:22693:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:1.0:1787787510.469811:0:22693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1787787510.475082:0:22693:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787787510.475322:0:22693:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa62240da3988 00100000:10000000:1.0:1787787510.475331:0:22693:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787787510.476388:0:22693:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787787510.476404:0:22693:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.131@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787787510.476421:0:22693:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787787510.476440:0:22693:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1787787510.483084:0:22693:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787787510.483332:0:22693:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787787511.211815:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787511.467006:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c74db600 going to sleep for 0 seconds 00000040:00080000:2.0:1787787511.475434:0:22750:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787787511.475444:0:22750:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787787511.485714:0:22750:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787787511.485730:0:22750:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:1.0:1787787512.171772:0:22711:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787787512.171781:0:22711:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff986fc2938000 from 11 10000000:01000000:1.0:1787787512.171787:0:22711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787787512.171833:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e0400/0x11620bc3f30aa807 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787512.171846:0:22711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff986fc43e0400/0x11620bc3f30aa807 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787512.171857:0:22711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff986fc43e0400/0x11620bc3f30aa807 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787512.171896:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4898f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503796480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787787512.171961:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787512.172071:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0e56300 going to sleep for 11 seconds 00000100:00100000:2.0:1787787512.172233:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503796480 00000100:00100000:2.0:1787787512.172241:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503796480 00000100:00100000:2.0:1787787512.172342:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787787512.172352:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+11:22711:x1874630503796480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787512.172366:0:22708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787512.172380:0:22708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff987101ee2600/0x11620bc3f30aa80e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa807 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787512.172402:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff987101ee2600/0x11620bc3f30aa80e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa807 expref: 12 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787512.172412:0:22708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff987101ee2600/0x11620bc3f30aa80e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa807 expref: 12 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787512.172427:0:22708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2600, rc 0) 00000100:00100000:2.0:1787787512.172527:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+12:22711:x1874630503796480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787512.172534:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787787512.172855:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4898f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503796480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787512.173049:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff986fc43e0400/0x11620bc3f30aa807 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa80e expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787512.173070:0:22711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff986fc43e0400/0x11620bc3f30aa807 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa80e expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787512.173118:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4898f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503796608:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787787512.173227:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787512.173259:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0e56300 going to sleep for 11 seconds 00000100:00100000:2.0:1787787512.173331:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503796608 00000100:00100000:2.0:1787787512.173337:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503796608 00000100:00100000:2.0:1787787512.173371:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787787512.173378:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+12:22711:x1874630503796608:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787787512.173391:0:22708:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787787512.173406:0:22708:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787787512.173410:0:22708:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1787787512.173492:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+12:22711:x1874630503796608:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787512.173500:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787787512.173859:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4898f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503796608:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787787512.174034:0:22711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787787512.174042:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e0400/0x11620bc3f30aa807 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa80e expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787512.174052:0:22711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff986fc43e0400/0x11620bc3f30aa807 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa80e expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787512.235836:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787787512.489694:0:22750:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787787512.489703:0:22750:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787787512.489841:0:22750:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1787787512.489878:0:22750:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787787512.490090:0:22750:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:3.0:1787787512.492622:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c74db600 going to sleep for 0 seconds 00010000:00010000:1.0:1787787513.257548:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787513.513349:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c74db600 going to sleep for 0 seconds 00010000:00010000:2.0:1787787514.285214:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787787514.309888:0:22998:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg431-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787787514.537228:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c74db600 going to sleep for 0 seconds 00000020:00000004:1.0:1787787515.228089:0:23051:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787787515.228891:0:23051:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787787515.306207:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787515.566563:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c74db600 going to sleep for 0 seconds 00000100:00100000:2.0:1787787515.753386:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:3.0:1787787515.753426:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787787515.753431:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787787515.753435:0:36:0:(import.c:65:import_set_state_nolock()) ffff9870f3633000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787787515.753443:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 654 00000100:00080000:3.0:1787787515.753455:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787787515.753509:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9870f3633000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:3.0:1787787515.753533:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870ed9252c0 x1874630503796864/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787787515.753548:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787515.753552:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787787515.753555:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787515.753558:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787787515.753560:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787787515.753563:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787787515.753565:0:36:0:(import.c:65:import_set_state_nolock()) ffff9870fc07c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787787515.753569:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9870fc07c800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:3.0:1787787515.753579:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870ed926940 x1874630503796992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787787515.753824:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503796864:0@lo:38:kworker.0 00000100:00100000:0.0:1787787515.753914:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787515.753963:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed926940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874630503796992:0@lo:38:kworker.0 00000100:00100000:0.0:1787787515.754002:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787515.754132:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503796864 00000100:00100000:3.0:1787787515.754159:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503796864 00000100:00100000:3.0:1787787515.754199:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787787515.754207:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3652:x1874630503796864:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787787515.754224:0:22720:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787787515.754265:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3652:x1874630503796864:12345-0@lo:38:kworker.0 Request processed in 58us (351us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787787515.754272:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787787515.754298:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503796992 00000100:00100000:3.0:1787787515.754302:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503796992 00000100:00100000:3.0:1787787515.754332:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787787515.754336:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1874630503796992:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787787515.754352:0:22716:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 659 last 0 00000020:00000080:3.0:1787787515.754386:0:22716:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x11620bc3f30aa815 00000004:00100000:3.0:1787787515.754411:0:22716:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787787515.754540:0:22716:0:(import.c:65:import_set_state_nolock()) ffff9870c5463000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787787515.754578:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874630503796992:12345-0@lo:38:kworker.0 Request processed in 241us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787515.754586:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787787515.754912:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870f3633000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787787515.754923:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787787515.754927:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503796864:0@lo:38:kworker.0 00010000:00080000:0.0:1787787515.754942:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9870ed926940 x1874630503796992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787787525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787787515.754966:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1787787515.754973:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787787515.754978:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787787515.754980:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870fc07c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787787515.754985:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed926940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874630503796992:0@lo:38:kworker.0 00000100:00100000:2.0:1787787515.755250:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed927840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3fd2c107-7647-408e-8048-4ef16ee44cbc:3656:1874630503796736:0@lo:400:kworker.0 00000100:00100000:2.0:1787787515.755293:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787515.755676:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503796736 00000100:00100000:0.0:1787787515.755682:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503796736 00000100:00100000:0.0:1787787515.755796:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787787515.755805:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+12:3656:x1874630503796736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787515.755861:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+12:3656:x1874630503796736:12345-0@lo:400:kworker.0 Request processed in 57us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787515.755868:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787787515.755928:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed927840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3fd2c107-7647-408e-8048-4ef16ee44cbc:3656:1874630503796736:0@lo:400:kworker.0 00000020:00000004:0.0:1787787515.992493:0:23101:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787787515.992764:0:23101:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787787516.332871:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787516.585249:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c74db600 going to sleep for 0 seconds 00010000:00010000:2.0:1787787517.354242:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787517.609271:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c74db600 going to sleep for 0 seconds 00010000:00010000:1.0:1787787518.377306:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787518.637450:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c74db600 going to sleep for 0 seconds 00010000:00010000:2.0:1787787519.402061:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787519.657255:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c74db600 going to sleep for 0 seconds 00010000:00010000:1.0:1787787520.428029:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787520.683985:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c74db600 going to sleep for 0 seconds 00000100:00100000:0.0:1787787520.873271:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787787510/real 1787787510] req@ffff986fc43fa940 x1874630503793920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787520 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787520.873320:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff986fc43fa940 x1874630503793920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787520 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787520.873332:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787787510/real 1787787510] req@ffff986fc489b0c0 x1874630503793792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787520 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787520.873346:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff986fc489b0c0 x1874630503793792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787520 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787787520.873380:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870c580d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787787520.873396:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787787520.873401:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503793920:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787787520.873405:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787787520.873408:0:3652:0:(import.c:65:import_set_state_nolock()) ffff987101e32800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787787520.873412:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787787520.873416:0:36:0:(import.c:65:import_set_state_nolock()) ffff9870f3633000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787787520.873421:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 659 00000100:00080000:1.0:1787787520.873428:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787787520.873432:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00080000:1.0:1787787520.873438:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9870f3633000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:0.0:1787787520.873439:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503793792:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1787787520.873467:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc4899e00 x1874630503797248/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787787520.873481:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787787520.873484:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787787520.873486:0:36:0:(import.c:65:import_set_state_nolock()) ffff987101e32800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787787520.873490:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 654 00000100:00080000:1.0:1787787520.873500:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1787787520.873500:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4899e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503797248:0@lo:38:kworker.0 00000100:00080000:1.0:1787787520.873509:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff987101e32800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:1.0:1787787520.873526:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc4898b40 x1874630503797376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787787520.873536:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787787520.873539:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787787520.873541:0:36:0:(import.c:65:import_set_state_nolock()) ffff9870c580d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787787520.873545:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 654 00000100:00080000:1.0:1787787520.873547:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787787520.873550:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9870c580d800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:1.0:1787787520.873561:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc4899a40 x1874630503797504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787787520.873569:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787520.873612:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787787520.873623:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc48983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503797632:0@lo:400:kworker.0 00000100:00100000:0.0:1787787520.873627:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4898b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503797376:0@lo:8:kworker.0 00000100:00100000:1.0:1787787520.873659:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:0.0:1787787520.873672:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874630503797376 offset 0 length 520: 4 00000100:00100000:0.0:1787787520.873698:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4899a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503797504:0@lo:8:kworker.0 00000400:00000100:0.0:1787787520.873725:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874630503797504 offset 0 length 520: 4 00000100:00100000:2.0:1787787520.873753:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787787520.873765:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3fd2c107-7647-408e-8048-4ef16ee44cbc:3655:1874630503797120:0@lo:400:kworker.0 00000100:00100000:2.0:1787787520.873802:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787520.873901:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503797248 00000100:00100000:3.0:1787787520.873909:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503797248 00000100:00100000:3.0:1787787520.873949:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787787520.873957:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3652:x1874630503797248:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787787520.873979:0:22720:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787787520.874032:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3652:x1874630503797248:12345-0@lo:38:kworker.0 Request processed in 75us (466us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787787520.874040:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787787520.874070:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503797632 00000100:00100000:3.0:1787787520.874074:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503797632 00000100:00100000:3.0:1787787520.874102:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787787520.874108:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503797632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787520.874174:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503797632:12345-0@lo:400:kworker.0 Request processed in 65us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787520.874189:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787787520.874229:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff986fc48983c0 x1874630503797632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787520.874242:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc48983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503797632:0@lo:400:kworker.0 00000100:00080000:2.0:1787787520.874327:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870f3633000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787787520.874332:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787787520.874335:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4899e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503797248:0@lo:38:kworker.0 00000100:00100000:0.0:1787787520.874485:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503797120 00000100:00100000:0.0:1787787520.874489:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503797120 00000100:00100000:0.0:1787787520.874557:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787787520.874565:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+12:3655:x1874630503797120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787520.874610:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+12:3655:x1874630503797120:12345-0@lo:400:kworker.0 Request processed in 46us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787520.874616:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787787520.874678:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3fd2c107-7647-408e-8048-4ef16ee44cbc:3655:1874630503797120:0@lo:400:kworker.0 00010000:00010000:2.0:1787787521.449291:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787521.706218:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c74db600 going to sleep for 0 seconds 00000020:01000004:0.0:1787787521.898238:0:23446:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787787521.898242:0:23446:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787787521.898243:0:23446:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787787521.898372:0:23446:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9870f576f800 00000020:01000004:0.0:1787787521.898387:0:23446:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1787787521.898404:0:23446:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787787521.898417:0:23446:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9870fc3699b8) 00000020:00000080:0.0:1787787521.898431:0:23446:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787787521.987134:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1787787521.989292:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787787521.990447:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1787787521.990749:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1787787521.991060:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787787521.991526:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787787521.991748:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787787521.992039:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787787521.992263:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787787521.992563:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1787787521.992754:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787787521.992995:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1787787521.993364:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787787521.993950:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1787787521.994439:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1787787521.994937:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1787787521.995539:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787787521.996120:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1787787521.996623:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1787787521.997088:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1787787521.997339:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1787787521.997598:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1787787521.997796:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1787787521.998335:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1787787521.998682:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1787787521.998940:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1787787521.999240:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1787787521.999615:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1787787521.999975:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1787787522.000222:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1787787522.000469:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1787787522.001042:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1787787522.001316:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1787787522.001653:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1787787522.001929:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787787522.002352:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1787787522.002599:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1787787522.002805:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1787787522.003254:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1787787522.003526:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1787787522.003777:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1787787522.004054:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1787787522.004287:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1787787522.004653:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1787787522.004890:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1787787522.005092:0:23446:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00080000:01000000:3.0:1787787522.008011:0:23446:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787787522.008346:0:23446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1787787522.008357:0:23446:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787787522.008378:0:23446:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x11620bc3f30aa823 00000020:01000004:3.0:1787787522.008385:0:23446:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787787522.008405:0:23446:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.131@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787787522.008408:0:23446:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787787522.008414:0:23446:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1787787522.008439:0:23446:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1787787522.008443:0:23446:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.131@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1787787522.012904:0:23446:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.131@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787787522.012949:0:23446:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.131@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1787787522.012954:0:23446:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787787522.012956:0:23446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787787522.012958:0:23446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787522.012959:0:23446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787522.012960:0:23446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787522.012961:0:23446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787522.012963:0:23446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787787522.012964:0:23446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787522.012966:0:23446:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787787522.012969:0:23446:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1787787522.012971:0:23446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787787522.012972:0:23446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787787522.012974:0:23446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787522.012975:0:23446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787522.012976:0:23446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787522.012977:0:23446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787522.012978:0:23446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787787522.012980:0:23446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787522.012981:0:23446:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787787522.013010:0:23446:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1787787522.013034:0:23446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503797760:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787787522.013116:0:23446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787522.014880:0:23446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1557a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787787522.015759:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503797760 00000100:00100000:1.0:1787787522.015768:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503797760 00000100:00100000:1.0:1787787522.015868:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787787522.015879:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+12:23446:x1874630503797760:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787787522.015914:0:22706:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787787522.015918:0:22706:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1787787522.015925:0:22706:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1787787522.016408:0:23446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503797760:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787787522.016422:0:23446:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787787522.016424:0:23446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787787522.016426:0:23446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787787522.016427:0:23446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787787522.016429:0:23446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787787522.016498:0:23446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787787522.016512:0:23446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787787522.016514:0:23446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787787522.016516:0:23446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787787522.016517:0:23446:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787787522.016535:0:23446:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9870f576f800 from lustre-MDT0001 10000000:01000000:0.0:1787787522.016576:0:23446:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1787787522.016579:0:23446:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787787522.016585:0:23446:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff986fc296cd28 local copy 00010000:00010000:0.0:1787787522.016594:0:23446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e0600/0x11620bc3f30aa719 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa720 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787522.016666:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+12:23446:x1874630503797760:12345-0@lo:253:mount.lustre.0 Request processed in 787us (3548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787522.016675:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787787522.016728:0:23446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503797888:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787787522.016772:0:23446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787522.016798:0:23446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c82fd300 going to sleep for 11 seconds 00000100:00100000:2.0:1787787522.016899:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503797888 00000100:00100000:2.0:1787787522.016906:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503797888 00000100:00100000:2.0:1787787522.016942:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787787522.016950:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+12:23446:x1874630503797888:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787787522.017027:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+12:23446:x1874630503797888:12345-0@lo:501:mount.lustre.0 Request processed in 77us (255us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787787522.017034:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787787522.017336:0:23446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503797888:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787787522.017349:0:23446:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787787522.017368:0:23446:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787787522.017374:0:23446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e0600/0x11620bc3f30aa719 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa720 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787522.017383:0:23446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff986fc43e0600/0x11620bc3f30aa719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa720 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787522.017408:0:23446:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9870f576f800 10000000:01000000:0.0:1787787522.017413:0:23446:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787787522.017417:0:23446:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff986fc296cd28 10000000:01000000:0.0:1787787522.017420:0:23446:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787787522.017423:0:23446:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff986fc296cd28 from 1 10000000:01000000:0.0:1787787522.017426:0:23446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787787522.017521:0:23446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f6659c00/0x11620bc3f30aa82a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787522.017536:0:23446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870f6659c00/0x11620bc3f30aa82a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787522.017546:0:23446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870f6659c00/0x11620bc3f30aa82a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787522.017559:0:23446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503798016:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787787522.017599:0:23446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787522.017628:0:23446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c82fd300 going to sleep for 11 seconds 00000100:00100000:2.0:1787787522.017652:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503798016 00000100:00100000:2.0:1787787522.017657:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503798016 00000100:00100000:2.0:1787787522.017688:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787787522.017696:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+12:23446:x1874630503798016:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787787522.017705:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787522.017724:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff987101ee3e00/0x11620bc3f30aa831 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa82a expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.017744:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff987101ee3e00/0x11620bc3f30aa831 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa82a expref: 13 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.017754:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff987101ee3e00/0x11620bc3f30aa831 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa82a expref: 13 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.017762:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3e00, rc 0) 00000100:00100000:2.0:1787787522.017802:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+13:23446:x1874630503798016:12345-0@lo:101:mount.lustre.0 Request processed in 106us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787522.017808:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787787522.017913:0:23446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503798016:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787787522.017925:0:23446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870f6659c00/0x11620bc3f30aa82a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa831 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787522.017935:0:23446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870f6659c00/0x11620bc3f30aa82a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa831 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787522.017949:0:23446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787787522.017998:0:23446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f6659c00/0x11620bc3f30aa82a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa831 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787522.018007:0:23446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870f6659c00/0x11620bc3f30aa82a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa831 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787522.018015:0:23446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9870f576f800 10000000:01000000:0.0:1787787522.018018:0:23446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787787522.018021:0:23446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9870f576f800 from 1 10000000:01000000:0.0:1787787522.018023:0:23446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787787522.018044:0:23446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f6658e00/0x11620bc3f30aa838 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787522.018050:0:23446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870f6658e00/0x11620bc3f30aa838 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787522.018057:0:23446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870f6658e00/0x11620bc3f30aa838 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787522.018069:0:23446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503798144:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787787522.018094:0:23446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787522.018118:0:23446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c82fd300 going to sleep for 11 seconds 00000100:00100000:2.0:1787787522.018178:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503798144 00000100:00100000:2.0:1787787522.018182:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503798144 00000100:00100000:2.0:1787787522.018209:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787787522.018215:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+13:23446:x1874630503798144:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787787522.018221:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787522.018232:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff987101ee2800/0x11620bc3f30aa83f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa838 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.018245:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff987101ee2800/0x11620bc3f30aa83f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa838 expref: 14 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.018253:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff987101ee2800/0x11620bc3f30aa83f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa838 expref: 14 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.018259:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2800, rc 0) 00000100:00100000:2.0:1787787522.018311:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+14:23446:x1874630503798144:12345-0@lo:101:mount.lustre.0 Request processed in 96us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787522.018337:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787787522.018579:0:23446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503798144:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787787522.018591:0:23446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870f6658e00/0x11620bc3f30aa838 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa83f expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787522.018599:0:23446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870f6658e00/0x11620bc3f30aa838 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa83f expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787522.018609:0:23446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787787522.018765:0:23446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f6658e00/0x11620bc3f30aa838 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa83f expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787522.018774:0:23446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870f6658e00/0x11620bc3f30aa838 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa83f expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787522.018785:0:23446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787787522.018789:0:23446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787787522.018794:0:23446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9870f576f800 10000000:01000000:3.0:1787787522.018803:0:23446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787787522.018807:0:23446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1787787522.018809:0:23446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787787522.018827:0:23446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30aa846 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787522.018834:0:23446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30aa846 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787522.018841:0:23446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30aa846 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787522.018854:0:23446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed924780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503798272:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787787522.018885:0:23446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787522.018914:0:23446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f44123c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787522.018956:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503798272 00000100:00100000:2.0:1787787522.018960:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503798272 00000100:00100000:2.0:1787787522.019035:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787787522.019043:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+14:23446:x1874630503798272:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787787522.019052:0:22708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787522.019062:0:22708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff987101ee3200/0x11620bc3f30aa84d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa846 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.019077:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff987101ee3200/0x11620bc3f30aa84d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa846 expref: 15 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.019085:0:22708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff987101ee3200/0x11620bc3f30aa84d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa846 expref: 15 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.019091:0:22708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3200, rc 0) 00000100:00100000:2.0:1787787522.019128:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+15:23446:x1874630503798272:12345-0@lo:101:mount.lustre.0 Request processed in 86us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787522.019135:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787787522.019219:0:23446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed924780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503798272:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787787522.019230:0:23446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30aa846 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa84d expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787522.019238:0:23446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30aa846 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa84d expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787787522.021559:0:23446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:2.0:1787787522.022124:0:23446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787787522.027337:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1787787522.027394:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1787787522.027410:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1787787522.027422:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1787787522.027436:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1787787522.027447:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1787787522.027457:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1787787522.027467:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1787787522.027489:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1787787522.027501:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1787787522.027526:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1787787522.027540:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1787787522.027552:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1787787522.027567:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1787787522.027579:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1787787522.027594:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1787787522.027607:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1787787522.027621:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1787787522.027635:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1787787522.027650:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1787787522.027663:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1787787522.027675:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1787787522.027687:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1787787522.027699:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1787787522.027709:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1787787522.027720:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1787787522.027732:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1787787522.027743:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1787787522.027753:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1787787522.027766:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1787787522.027778:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1787787522.027789:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1787787522.027800:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1787787522.027812:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1787787522.027823:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1787787522.027834:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1787787522.027847:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1787787522.027864:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1787787522.027881:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1787787522.027893:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1787787522.027906:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1787787522.027930:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1787787522.027943:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1787787522.027955:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1787787522.027979:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1787787522.027985:0:23446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1787787522.028093:0:23446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503798400:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787787522.028196:0:23446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787522.028241:0:23446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0088180 going to sleep for 11 seconds 00000100:00100000:0.0:1787787522.028321:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503798400 00000100:00100000:0.0:1787787522.028331:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503798400 00000100:00100000:0.0:1787787522.028401:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787787522.028410:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+15:23446:x1874630503798400:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787787522.028565:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+15:23446:x1874630503798400:12345-0@lo:501:mount.lustre.0 Request processed in 156us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787522.028574:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787787522.028728:0:23446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503798400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787522.028765:0:23446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed924780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503798528:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787787522.028805:0:23446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787522.028832:0:23446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f4412780 going to sleep for 11 seconds 00000100:00100000:0.0:1787787522.028876:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503798528 00000100:00100000:0.0:1787787522.028881:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503798528 00000100:00100000:0.0:1787787522.028924:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787787522.028932:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+15:23446:x1874630503798528:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787787522.031081:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+15:23446:x1874630503798528:12345-0@lo:503:mount.lustre.0 Request processed in 2142us (2267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787522.031095:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787787522.031317:0:23446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed924780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503798528:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787787522.031763:0:23446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787787522.031862:0:23446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed924780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503798656:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787787522.031913:0:23446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787522.035224:0:23446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f44123c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787522.038098:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503798656 00000100:00100000:1.0:1787787522.038168:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503798656 00000100:00100000:1.0:1787787522.038249:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787787522.038261:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+15:23446:x1874630503798656:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787522.039625:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+15:23446:x1874630503798656:12345-0@lo:502:mount.lustre.0 Request processed in 1359us (7704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787522.039636:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787787522.039950:0:23446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed924780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503798656:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787787522.040540:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1787787522.040574:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:3.0:1787787522.040591:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:3.0:1787787522.040605:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:3.0:1787787522.040617:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:3.0:1787787522.040631:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:3.0:1787787522.040643:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:3.0:1787787522.040655:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:3.0:1787787522.040668:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:3.0:1787787522.040681:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:3.0:1787787522.040696:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:3.0:1787787522.040709:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:3.0:1787787522.040724:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:3.0:1787787522.040736:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:3.0:1787787522.040750:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:3.0:1787787522.040763:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:3.0:1787787522.040774:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:3.0:1787787522.040786:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:3.0:1787787522.040796:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:3.0:1787787522.040808:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:3.0:1787787522.040821:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:3.0:1787787522.040834:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:3.0:1787787522.040847:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:3.0:1787787522.040859:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:3.0:1787787522.040869:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:3.0:1787787522.040882:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:3.0:1787787522.040895:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:3.0:1787787522.040921:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:3.0:1787787522.040936:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:3.0:1787787522.040952:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:3.0:1787787522.040967:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:3.0:1787787522.040981:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:3.0:1787787522.040995:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:3.0:1787787522.041830:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:3.0:1787787522.041865:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:3.0:1787787522.041880:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:3.0:1787787522.041894:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:3.0:1787787522.041906:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:3.0:1787787522.041919:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:3.0:1787787522.041933:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:3.0:1787787522.041946:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:3.0:1787787522.041959:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:3.0:1787787522.041973:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:3.0:1787787522.041986:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:3.0:1787787522.042035:0:23446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed924780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503798784:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787787522.042118:0:23446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787522.042499:0:23446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f44123c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787522.042835:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503798784 00000100:00100000:0.0:1787787522.042844:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503798784 00000100:00100000:0.0:1787787522.042907:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787787522.042917:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+15:23446:x1874630503798784:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787787522.043076:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+15:23446:x1874630503798784:12345-0@lo:502:mount.lustre.0 Request processed in 160us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787522.043084:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787787522.043613:0:23446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed924780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503798784:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787787522.043690:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:3.0:1787787522.043703:0:23446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1787787522.053677:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787522.053693:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787522.053695:0:23451:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787787522.053701:0:23451:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1787787522.053704:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787787522.053718:0:23451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9870fc368000) 00000020:00000080:0.0:1787787522.053740:0:23451:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1787787522.053745:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787787522.053825:0:23451:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787787522.053833:0:23451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x11620bc3f30aa85b 00000020:00000080:0.0:1787787522.054334:0:23451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1787787522.054340:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787522.054344:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787522.054346:0:23451:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787787522.054349:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787522.054353:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787522.054354:0:23451:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1787787522.054357:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787787522.054366:0:23451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9870f55f4d28) 00000020:00000080:0.0:1787787522.054380:0:23451:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1787787522.054384:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787787522.054386:0:23451:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1787787522.054389:0:23451:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1787787522.054393:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787787522.054442:0:23451:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9870f576f800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1787787522.054454:0:23451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9870f55f0000) 00000020:00000080:0.0:1787787522.054478:0:23451:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1787787522.054560:0:23451:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787787522.054566:0:23451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x11620bc3f30aa870 00000020:00000080:0.0:1787787522.054663:0:23451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1787787522.054670:0:23451:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787787522.054675:0:23451:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x11620bc3f30aa877 00080000:01000000:0.0:1787787522.054681:0:23451:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787787522.054684:0:23451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x11620bc3f30aa87e 00010000:00010000:1.0:1787787522.134108:0:23451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1787787522.137751:0:23451:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:1.0:1787787522.138756:0:23451:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787787522.142250:0:23451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1787787522.142264:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787522.142282:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787522.142285:0:23451:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1787787522.142289:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787787522.142295:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787522.142297:0:23451:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1787787522.142300:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787787522.142306:0:23451:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.131@tcp to nid 0x20000c0a8cc83 (192.168.204.131@tcp) 00000020:00000080:2.0:1787787522.142336:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787787522.142352:0:23451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff987101db4d28) 00000020:00000080:2.0:1787787522.142379:0:23451:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1787787522.142385:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787787522.142461:0:23451:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1787787522.142468:0:23451:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787787522.142475:0:23451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x11620bc3f30aa88c 00010000:00080000:2.0:1787787522.142504:0:23451:0:(ldlm_lib.c:102:import_set_conn()) imp ffff986fc4187000@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.131@tcp at head 00010000:00010000:2.0:1787787522.148429:0:23451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1787787522.151589:0:23451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787787522.151609:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787787522.151654:0:23451:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787787522.151676:0:23451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x11620bc3f30aa893 00000100:00080000:2.0:1787787522.151687:0:23451:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787787522.151717:0:23451:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff986fc4187000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:2.0:1787787522.151756:0:23451:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc418c780 x1874630503798912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787787522.151784:0:23451:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1787787522.151889:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787522.151894:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787522.151896:0:23451:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1787787522.151900:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787787522.151903:0:23451:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787787522.151905:0:23451:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787787522.151907:0:23451:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787787522.151909:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787787522.151912:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787522.151914:0:23451:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787787522.151917:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787787522.151923:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787522.151925:0:23451:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1787787522.151929:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787787522.151961:0:23451:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787787522.151977:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787522.151981:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787522.151984:0:23451:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1787787522.151986:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787787522.151988:0:23451:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1787787522.151989:0:23451:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787787522.151991:0:23451:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787787522.151993:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787787522.151995:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787522.151997:0:23451:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787787522.151999:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787787522.152003:0:23451:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787787522.152007:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787522.152014:0:23451:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787787522.152019:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787787522.152022:0:23451:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.131@tcp to nid 0x20000c0a8cc83 (192.168.204.131@tcp) 00000020:01000000:2.0:1787787522.152046:0:23451:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787787522.152049:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787787522.152060:0:23451:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff987101db0000) 00000020:00000080:2.0:1787787522.152072:0:23451:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1787787522.152077:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787787522.152304:0:23451:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1787787522.152311:0:23451:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787787522.152317:0:23451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x11620bc3f30aa8a1 00010000:00080000:2.0:1787787522.152354:0:23451:0:(ldlm_lib.c:102:import_set_conn()) imp ffff987101cd8800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.131@tcp at head 00010000:00010000:2.0:1787787522.152551:0:23451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:3.0:1787787522.152929:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503798912:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787787522.152995:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787787522.153036:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787787522.153043:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787787522.153046:0:36:0:(import.c:65:import_set_state_nolock()) ffff9870f3633000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787787522.153052:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 665 00000100:00080000:1.0:1787787522.153057:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787787522.153063:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9870f3633000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:1.0:1787787522.153086:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc489a940 x1874630503799040/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787787522.153111:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787787522.153115:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787787522.153118:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787787522.153121:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787787522.153194:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503798912 00000100:00100000:0.0:1787787522.153203:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503798912 00000100:00100000:0.0:1787787522.153238:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787787522.153244:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4899e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503799168:0@lo:400:kworker.0 00000100:00100000:0.0:1787787522.153250:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed924780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3652:x1874630503798912:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787787522.153287:0:22720:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 666 last 0 00000100:00100000:3.0:1787787522.153295:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1787787522.153324:0:22720:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x11620bc3f30aa8a8 00000004:00100000:0.0:1787787522.153341:0:22720:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787787522.153426:0:22720:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1787787522.153444:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503799168 00000100:00100000:3.0:1787787522.153449:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503799168 00000100:00100000:3.0:1787787522.153506:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787787522.153513:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503799168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787522.153566:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503799168:12345-0@lo:400:kworker.0 Request processed in 54us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787522.153573:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787787522.153599:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503799040:0@lo:38:kworker.0 00000100:00100000:3.0:1787787522.153626:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787787522.153740:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff986fc4899e00 x1874630503799168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787522.153750:0:22719:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1787787522.153755:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4899e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503799168:0@lo:400:kworker.0 00000100:00100000:1.0:1787787522.153762:0:22719:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1787787522.156311:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503799040 00000100:00100000:0.0:1787787522.156718:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503799040 00000100:00100000:0.0:1787787522.156781:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787787522.156789:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed925a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1874630503799040:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787787522.158720:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed925a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3652:x1874630503799040:12345-0@lo:38:kworker.0 Request processed in 1921us (5082us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787787522.158735:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787787522.158886:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787787522.158895:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870f3633000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787787522.158900:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787787522.158904:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503799040:0@lo:38:kworker.0 00000040:01000000:2.0:1787787522.159752:0:23451:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787787522.160191:0:23451:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1787787522.162062:0:22720:0:(import.c:65:import_set_state_nolock()) ffff9870c47bb000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787787522.162189:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed924780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3652:x1874630503798912:12345-0@lo:38:llog_process_th.0 Request processed in 8940us (9191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787522.162207:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787787522.162442:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787787522.162451:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1787787522.162459:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787787522.162465:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787787522.162467:0:3652:0:(import.c:65:import_set_state_nolock()) ffff986fc4187000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787787522.162494:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503798912:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787787522.162725:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787787522.162740:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc48983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503799296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787522.162790:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787522.163109:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503799296 00000100:00100000:1.0:1787787522.163116:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503799296 00000100:00100000:1.0:1787787522.163180:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787787522.163190:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3656:x1874630503799296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787787522.163215:0:22719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787787522.163276:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3656:x1874630503799296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787522.163283:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787787522.163421:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc48983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503799296:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1787787522.164017:0:23451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787787522.164982:0:23451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1787787522.165123:0:23451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1787787522.165923:0:23457:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787787522.165929:0:23457:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787787522.166873:0:23451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787787522.166887:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787787522.166926:0:23451:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787787522.166950:0:23451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x11620bc3f30aa8af 00000100:00080000:2.0:1787787522.166968:0:23451:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787787522.166974:0:23451:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff987101cd8800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:2.0:1787787522.167010:0:23451:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc418c780 x1874630503799424/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787787522.167041:0:23451:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787787522.167113:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787522.167117:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787522.167119:0:23451:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787787522.167123:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000100:00080000:1.0:1787787522.167123:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:01000000:2.0:1787787522.167125:0:23451:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1787787522.167127:0:23451:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787787522.167128:0:23451:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000100:00080000:1.0:1787787522.167128:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1787787522.167130:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000100:00080000:1.0:1787787522.167131:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787787522.167133:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:2.0:1787787522.167159:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787522.167161:0:23451:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787787522.167164:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787787522.167169:0:23451:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787787522.167173:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787522.167175:0:23451:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787787522.167179:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787787522.167183:0:23451:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.131@tcp to nid 0x20000c0a8cc83 (192.168.204.131@tcp) 00000020:01000000:2.0:1787787522.167207:0:23451:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787787522.167209:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787787522.167220:0:23451:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff987101db3370) 00000020:00000080:2.0:1787787522.167232:0:23451:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1787787522.167238:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1787787522.167251:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503799424:0@lo:8:llog_process_th.0 00000004:00080000:2.0:1787787522.167311:0:23451:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1787787522.167318:0:23451:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787787522.167324:0:23451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x11620bc3f30aa8bd 00010000:00080000:2.0:1787787522.167356:0:23451:0:(ldlm_lib.c:102:import_set_conn()) imp ffff986fc43a7000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.131@tcp at head 00000400:00000100:3.0:1787787522.167372:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874630503799424 offset 0 length 520: 4 00010000:00010000:2.0:1787787522.168456:0:23451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1787787522.168540:0:23451:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787787522.168903:0:23451:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1787787522.171866:0:23451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787787522.172073:0:23451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1787787522.172420:0:23451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:2.0:1787787522.173075:0:23459:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787787522.173081:0:23459:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787787522.173872:0:23451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787787522.173885:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787787522.173922:0:23451:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787787522.173943:0:23451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x11620bc3f30aa8c4 00000100:00080000:3.0:1787787522.173954:0:23451:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787787522.173959:0:23451:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff986fc43a7000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:3.0:1787787522.173994:0:23451:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870ed926580 x1874630503799552/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787787522.174066:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed926580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503799552:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787787522.174123:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874630503799552 offset 0 length 520: 4 00000100:00080000:3.0:1787787522.174219:0:23451:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787787522.174298:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787522.174303:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787522.174305:0:23451:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787787522.174309:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787522.174312:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787522.174313:0:23451:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787787522.174330:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787787522.174332:0:23451:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787787522.174335:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787522.174337:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787522.174339:0:23451:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787787522.174341:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787522.174343:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787522.174344:0:23451:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787787522.174347:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787787522.174372:0:23451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787522.174376:0:23451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787522.174377:0:23451:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787787522.174380:0:23451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:3.0:1787787522.174432:0:23446:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1787787522.174462:0:23446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787787522.174486:0:23446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30aa846 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa84d expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787522.174497:0:23446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c13f4600/0x11620bc3f30aa846 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa84d expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787522.174517:0:23446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9870f576f800 from 1 10000000:01000000:3.0:1787787522.174520:0:23446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787787522.174548:0:23446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f4000/0x11620bc3f30aa8cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787522.174557:0:23446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c13f4000/0x11620bc3f30aa8cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787522.174573:0:23446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c13f4000/0x11620bc3f30aa8cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787522.174590:0:23446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed925680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503799680:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787787522.174630:0:23446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787522.174651:0:23446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f4412840 going to sleep for 11 seconds 00000100:00100000:1.0:1787787522.175021:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503799680 00000100:00100000:1.0:1787787522.175028:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503799680 00000100:00100000:1.0:1787787522.175081:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787787522.175091:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+15:23446:x1874630503799680:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787522.175105:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787522.175121:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc43e0000/0x11620bc3f30aa8d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa8cb expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787522.175172:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc43e0000/0x11620bc3f30aa8d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa8cb expref: 16 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787522.175184:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc43e0000/0x11620bc3f30aa8d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa8cb expref: 16 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787522.175204:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc43e0000, rc 0) 00000100:00100000:1.0:1787787522.175251:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+16:23446:x1874630503799680:12345-0@lo:101:mount.lustre.0 Request processed in 160us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787522.175258:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1787787522.175304:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787787522.175309:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787787522.175312:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787787522.175315:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787787522.175634:0:23446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed925680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503799680:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787787522.175649:0:23446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c13f4000/0x11620bc3f30aa8cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa8d2 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787522.175659:0:23446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c13f4000/0x11620bc3f30aa8cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa8d2 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787522.177720:0:23446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed925680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503799808:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787787522.177794:0:23446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787522.177839:0:23446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f4412840 going to sleep for 11 seconds 00000100:00100000:2.0:1787787522.178011:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503799808 00000100:00100000:2.0:1787787522.178020:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503799808 00000100:00100000:2.0:1787787522.178070:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787787522.178079:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+16:23446:x1874630503799808:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787787522.178098:0:22706:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787787522.178119:0:22706:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787787522.178122:0:22706:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1787787522.178243:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+16:23446:x1874630503799808:12345-0@lo:256:mount.lustre.0 Request processed in 165us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787522.178251:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787787522.178374:0:23446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed925680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503799808:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787787522.179022:0:23446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787787522.179041:0:23446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f4000/0x11620bc3f30aa8cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa8d2 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787522.179053:0:23446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c13f4000/0x11620bc3f30aa8cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa8d2 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787522.179062:0:23446:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9870f576f800 from 1 10000000:01000000:3.0:1787787522.179066:0:23446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787787522.179102:0:23446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30aa8d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787522.179110:0:23446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30aa8d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787522.179120:0:23446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30aa8d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787522.179169:0:23446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed925680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503799936:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787787522.179208:0:23446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787522.179231:0:23446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f4412840 going to sleep for 11 seconds 00000100:00100000:0.0:1787787522.179547:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503799936 00000100:00100000:0.0:1787787522.179554:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503799936 00000100:00100000:0.0:1787787522.179593:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787787522.179601:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+16:23446:x1874630503799936:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787787522.179610:0:22708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787522.179621:0:22708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870f6659800/0x11620bc3f30aa8e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa8d9 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787522.179642:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870f6659800/0x11620bc3f30aa8e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa8d9 expref: 17 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787522.179652:0:22708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870f6659800/0x11620bc3f30aa8e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa8d9 expref: 17 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787522.179660:0:22708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f6659800, rc 0) 00000100:00100000:0.0:1787787522.179772:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+17:23446:x1874630503799936:12345-0@lo:101:mount.lustre.0 Request processed in 171us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787522.179779:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787787522.180433:0:23446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed925680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503799936:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787787522.180451:0:23446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30aa8d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa8e0 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787522.180462:0:23446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30aa8d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa8e0 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787787522.181627:0:23446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:3.0:1787787522.181895:0:23446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787787522.182067:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1787787522.182093:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:3.0:1787787522.182107:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:3.0:1787787522.182121:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:3.0:1787787522.182134:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:3.0:1787787522.182187:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:3.0:1787787522.182202:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:3.0:1787787522.182216:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:3.0:1787787522.182233:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1787787522.182276:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:3.0:1787787522.182302:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:3.0:1787787522.182319:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:3.0:1787787522.183495:0:23446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:3.0:1787787522.183596:0:23446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed925680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503800064:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787522.183666:0:23446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787522.183719:0:23446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f4412000 going to sleep for 11 seconds 00000100:00100000:0.0:1787787522.183869:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503800064 00000100:00100000:0.0:1787787522.183877:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503800064 00000100:00100000:0.0:1787787522.183930:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787787522.183940:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+17:23446:x1874630503800064:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787787522.184064:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+17:23446:x1874630503800064:12345-0@lo:501:mount.lustre.0 Request processed in 125us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787522.184072:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787787522.184288:0:23446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed925680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503800064:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787522.184453:0:23446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed925680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503800192:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787787522.184492:0:23446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787522.184522:0:23446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f4412000 going to sleep for 11 seconds 00000100:00100000:2.0:1787787522.185214:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503800192 00000100:00100000:2.0:1787787522.185224:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503800192 00000100:00100000:2.0:1787787522.185328:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787787522.185338:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+17:23446:x1874630503800192:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787787522.185456:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+17:23446:x1874630503800192:12345-0@lo:503:mount.lustre.0 Request processed in 118us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787522.185463:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787787522.185574:0:23446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed925680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503800192:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787787522.186352:0:23446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787787522.186980:0:23446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed925680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503800320:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787787522.187057:0:23446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787522.187187:0:23446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f4412840 going to sleep for 11 seconds 00000100:00100000:0.0:1787787522.187251:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503800320 00000100:00100000:0.0:1787787522.187259:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503800320 00000100:00100000:0.0:1787787522.187320:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787787522.187328:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+17:23446:x1874630503800320:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787787522.187998:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+17:23446:x1874630503800320:12345-0@lo:502:mount.lustre.0 Request processed in 670us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787522.188004:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787787522.188126:0:23446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed925680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503800320:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787787522.188576:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1787787522.188608:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:3.0:1787787522.188624:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:3.0:1787787522.188638:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:3.0:1787787522.188650:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:3.0:1787787522.188664:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:3.0:1787787522.188678:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:3.0:1787787522.188691:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:3.0:1787787522.188774:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1787787522.188801:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:3.0:1787787522.188819:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:3.0:1787787522.188864:0:23446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed925680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503800448:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787787522.188917:0:23446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787522.188958:0:23446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f4412840 going to sleep for 11 seconds 00000100:00100000:2.0:1787787522.189075:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503800448 00000100:00100000:2.0:1787787522.189081:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503800448 00000100:00100000:2.0:1787787522.189127:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787787522.189164:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+17:23446:x1874630503800448:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787787522.189289:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+17:23446:x1874630503800448:12345-0@lo:502:mount.lustre.0 Request processed in 149us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787522.189303:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787787522.189341:0:23446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed925680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503800448:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787787522.189517:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:3.0:1787787522.189529:0:23446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787787522.190690:0:23461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787522.190703:0:23461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787522.190706:0:23461:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787787522.190716:0:23461:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9870f576f800 00000020:00000080:3.0:1787787522.190718:0:23461:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787787522.190726:0:23461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787522.190729:0:23461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787522.190731:0:23461:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787787522.190733:0:23461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787522.190736:0:23461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787522.190737:0:23461:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787787522.190739:0:23461:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9870f576f800 00000020:00000080:3.0:1787787522.190741:0:23461:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787787522.190846:0:23461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787522.190851:0:23461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787522.190853:0:23461:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787787522.190855:0:23461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787522.190858:0:23461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787522.190859:0:23461:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787787522.190863:0:23461:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9870f576f800 00000020:00000080:3.0:1787787522.190865:0:23461:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787787522.201530:0:23461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787522.201682:0:23461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787522.201685:0:23461:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787787522.201691:0:23461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787787522.201695:0:23461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787522.201697:0:23461:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787787522.201765:0:23461:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9870f576f800 00000020:00000080:2.0:1787787522.201768:0:23461:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787787522.201903:0:23461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787522.201906:0:23461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787522.201908:0:23461:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787787522.201912:0:23461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:3.0:1787787522.208298:0:23446:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787787522.208341:0:23446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787787522.208369:0:23446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30aa8d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa8e0 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787522.208387:0:23446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30aa8d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa8e0 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787522.208451:0:23446:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787787522.208455:0:23446:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9870f576f800 10000000:01000000:3.0:1787787522.208458:0:23446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9870f576f800 10000000:01000000:3.0:1787787522.208462:0:23446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787787522.208467:0:23446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9870f576f800 from 1 10000000:01000000:3.0:1787787522.208470:0:23446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787787522.208508:0:23446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5600/0x11620bc3f30aa8e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787522.210621:0:23446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c13f5600/0x11620bc3f30aa8e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787522.210637:0:23446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c13f5600/0x11620bc3f30aa8e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787522.210666:0:23446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed925680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503800576:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787787522.210872:0:23446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787522.210919:0:23446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f4412480 going to sleep for 11 seconds 00000100:00100000:0.0:1787787522.211596:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503800576 00000100:00100000:0.0:1787787522.211606:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503800576 00000100:00100000:0.0:1787787522.211731:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787787522.211745:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+17:23446:x1874630503800576:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787787522.211758:0:22708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787522.211775:0:22708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870f6659200/0x11620bc3f30aa8ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa8e7 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787522.211801:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870f6659200/0x11620bc3f30aa8ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa8e7 expref: 18 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787522.211812:0:22708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870f6659200/0x11620bc3f30aa8ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa8e7 expref: 18 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787522.211820:0:22708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f6659200, rc 0) 00000100:00100000:0.0:1787787522.211871:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:23446:x1874630503800576:12345-0@lo:101:mount.lustre.0 Request processed in 130us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787522.211878:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787787522.212524:0:23446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed925680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503800576:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787787522.212543:0:23446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c13f5600/0x11620bc3f30aa8e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa8ee expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787522.212553:0:23446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c13f5600/0x11620bc3f30aa8e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa8ee expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787787522.216898:0:23446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:0.0:1787787522.217216:0:23446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787787522.217638:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:0.0:1787787522.217662:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:0.0:1787787522.217683:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:0.0:1787787522.217695:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:0.0:1787787522.217709:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:0.0:1787787522.217722:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:0.0:1787787522.217734:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:0.0:1787787522.217747:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:0.0:1787787522.217761:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:0.0:1787787522.217775:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:0.0:1787787522.217787:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:0.0:1787787522.217800:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:0.0:1787787522.217815:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:0.0:1787787522.217828:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:0.0:1787787522.217841:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:0.0:1787787522.217870:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:0.0:1787787522.217884:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:0.0:1787787522.217895:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:0.0:1787787522.217907:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:0.0:1787787522.217918:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:0.0:1787787522.217929:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:0.0:1787787522.217940:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:0.0:1787787522.217950:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:0.0:1787787522.217961:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:0.0:1787787522.217971:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:0.0:1787787522.217980:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:0.0:1787787522.217992:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:0.0:1787787522.218003:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:0.0:1787787522.218013:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:0.0:1787787522.218023:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:0.0:1787787522.218033:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:0.0:1787787522.218055:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:0.0:1787787522.218068:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:0.0:1787787522.218079:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:0.0:1787787522.218090:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:0.0:1787787522.218110:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:0.0:1787787522.218123:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:0.0:1787787522.218158:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:0.0:1787787522.218176:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:0.0:1787787522.218189:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:0.0:1787787522.218202:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:0.0:1787787522.218217:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:0.0:1787787522.218229:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:0.0:1787787522.218241:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:0.0:1787787522.218255:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:0.0:1787787522.218281:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:0.0:1787787522.218298:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:0.0:1787787522.218940:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:0.0:1787787522.219087:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:0.0:1787787522.219108:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:0.0:1787787522.219126:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:0.0:1787787522.219132:0:23446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:0.0:1787787522.220791:0:23446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503800704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787787522.220881:0:23446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787522.220933:0:23446:0:(client.c:2715:ptlrpc_set_wait()) set ffff987101faa780 going to sleep for 11 seconds 00000100:00100000:3.0:1787787522.221594:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503800704 00000100:00100000:3.0:1787787522.221603:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503800704 00000100:00100000:3.0:1787787522.221648:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787787522.221659:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:23446:x1874630503800704:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787522.221824:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:23446:x1874630503800704:12345-0@lo:501:mount.lustre.0 Request processed in 167us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787522.221832:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787787522.223760:0:23446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503800704:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787522.223826:0:23446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503800832:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787522.223890:0:23446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787522.223937:0:23446:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2ad0840 going to sleep for 11 seconds 00000100:00100000:0.0:1787787522.224025:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503800832 00000100:00100000:0.0:1787787522.224032:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503800832 00000100:00100000:0.0:1787787522.224084:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787787522.224093:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:23446:x1874630503800832:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787787522.224560:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:23446:x1874630503800832:12345-0@lo:503:mount.lustre.0 Request processed in 466us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787522.224568:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787787522.226657:0:23446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503800832:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787787522.227276:0:23446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787787522.227394:0:23446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503800960:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787522.227466:0:23446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787522.227513:0:23446:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2ad0840 going to sleep for 11 seconds 00000100:00100000:0.0:1787787522.227677:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503800960 00000100:00100000:0.0:1787787522.227684:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503800960 00000100:00100000:0.0:1787787522.227736:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787787522.227756:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:23446:x1874630503800960:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787787522.227882:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:23446:x1874630503800960:12345-0@lo:502:mount.lustre.0 Request processed in 129us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787522.227890:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787787522.228651:0:23446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503800960:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787787522.228898:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:1.0:1787787522.228930:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:1.0:1787787522.228944:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:1.0:1787787522.228955:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:1.0:1787787522.228978:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:1.0:1787787522.228991:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:1.0:1787787522.229006:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:1.0:1787787522.229019:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:1.0:1787787522.229034:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:1.0:1787787522.229049:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:1.0:1787787522.229065:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:1.0:1787787522.229077:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:1.0:1787787522.229092:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:1.0:1787787522.229106:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:1.0:1787787522.229119:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:1.0:1787787522.229134:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:1.0:1787787522.229326:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:1.0:1787787522.229343:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:1.0:1787787522.229355:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:1.0:1787787522.229369:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:1.0:1787787522.229383:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:1.0:1787787522.229396:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:1.0:1787787522.229408:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:1.0:1787787522.229422:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:1.0:1787787522.229436:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:1.0:1787787522.229450:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:1.0:1787787522.229462:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:1.0:1787787522.229475:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:1.0:1787787522.229488:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:1.0:1787787522.229502:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:1.0:1787787522.229513:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:1.0:1787787522.229526:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:1.0:1787787522.229554:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:1.0:1787787522.229572:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:1.0:1787787522.229587:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:1.0:1787787522.229602:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:1.0:1787787522.229618:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:1.0:1787787522.229645:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:1.0:1787787522.229661:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:1.0:1787787522.229676:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:1.0:1787787522.229692:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:1.0:1787787522.229706:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:1.0:1787787522.229720:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:1.0:1787787522.229735:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:1.0:1787787522.229748:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:1.0:1787787522.229760:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:1.0:1787787522.229773:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:1.0:1787787522.229787:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:1.0:1787787522.231081:0:23446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503801088:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787522.231304:0:23446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787522.231393:0:23446:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2ad0840 going to sleep for 11 seconds 00000100:00100000:0.0:1787787522.232768:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503801088 00000100:00100000:0.0:1787787522.232780:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503801088 00000100:00100000:0.0:1787787522.232947:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787787522.232959:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:23446:x1874630503801088:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787787522.233117:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:23446:x1874630503801088:12345-0@lo:502:mount.lustre.0 Request processed in 160us (1813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787522.233126:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787787522.233279:0:23446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503801088:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787787522.233521:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:3.0:1787787522.233549:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:3.0:1787787522.233583:0:23446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed925680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503801216:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787787522.233627:0:23446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787522.237328:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503801216 00000100:00100000:1.0:1787787522.237343:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503801216 00000100:00100000:3.0:1787787522.237397:0:23446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f44126c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787522.237403:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787787522.237415:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:23446:x1874630503801216:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787522.238002:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:23446:x1874630503801216:12345-0@lo:502:mount.lustre.0 Request processed in 587us (4372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787522.238013:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787787522.238106:0:23446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed925680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503801216:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787787522.238224:0:23446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:3.0:1787787522.238239:0:23446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787787522.240092:0:23467:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1787787522.240108:0:23467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9870d22f0000) 00000020:00000080:3.0:1787787522.240131:0:23467:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1787787522.240273:0:23467:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9870f576f800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787787522.240278:0:23467:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9870f576f800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787787522.240280:0:23467:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9870f576f800 3 00010000:00080000:3.0:1787787522.240313:0:23467:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9870c31cf800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.131@tcp at head 00010000:00010000:3.0:1787787522.241902:0:23467:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1787787522.242107:0:23467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1787787522.242171:0:23467:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787787522.242183:0:23467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x11620bc3f30aa8fc 00000100:00080000:3.0:1787787522.242194:0:23467:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787787522.242200:0:23467:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9870c31cf800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:3.0:1787787522.242236:0:23467:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870ed925680 x1874630503801344/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787787522.242261:0:23467:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787787522.242506:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787787522.242511:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787787522.242513:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787787522.242517:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787787522.243072:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed925680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874630503801344:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787787522.243587:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787522.243648:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503801344 00000100:00100000:2.0:1787787522.243656:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503801344 00000100:00100000:2.0:1787787522.243689:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787787522.244609:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1874630503801344:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787787522.244639:0:22716:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 666 last 0 00000020:00000080:2.0:1787787522.244672:0:22716:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x11620bc3f30aa903 00000004:00100000:2.0:1787787522.244688:0:22716:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787787522.245093:0:22716:0:(import.c:65:import_set_state_nolock()) ffff986fc43a3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787522.245446:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874630503801344:12345-0@lo:38:llog_process_th.0 Request processed in 1747us (1858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787522.245456:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787787522.245576:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9870ed925680 x1874630503801344/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787787532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787522.245588:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787787522.245596:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1787787522.245604:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787787522.245610:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787787522.245613:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870c31cf800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787787522.245620:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed925680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874630503801344:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787787522.246469:0:23467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:2.0:1787787522.246634:0:23446:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787787522.246666:0:23446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787787522.246688:0:23446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5600/0x11620bc3f30aa8e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa8ee expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.246711:0:23446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c13f5600/0x11620bc3f30aa8e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa8ee expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787787522.246760:0:23446:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787787522.246774:0:23446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787787522.246775:0:23446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787787522.246777:0:23446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787787522.246779:0:23446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787787522.246780:0:23446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787787522.246781:0:23446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787787522.246790:0:23446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787787522.246792:0:23446:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787787522.246796:0:23446:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1787787522.246798:0:23446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787787522.246800:0:23446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787787522.246801:0:23446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787787522.246802:0:23446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787787522.246803:0:23446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787787522.246804:0:23446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787787522.246805:0:23446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787787522.246807:0:23446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787787522.246808:0:23446:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787787522.246839:0:23446:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787787522.247321:0:23446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503801472:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787787522.247377:0:23446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787522.247416:0:23446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f5852000 going to sleep for 11 seconds 00000100:00100000:0.0:1787787522.247651:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503801472 00000100:00100000:0.0:1787787522.247658:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503801472 00000100:00100000:0.0:1787787522.247783:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787787522.247793:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f03e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:23446:x1874630503801472:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787787522.247885:0:22708:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787787522.247908:0:22708:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1787787522.259686:0:22694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1787787522.259873:0:22708:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787787522.259888:0:22708:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1787787522.260469:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f03e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:23446:x1874630503801472:12345-0@lo:253:mount.lustre.0 Request processed in 12344us (12757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787522.260501:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787787522.263350:0:23446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:23446:1874630503801472:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787787522.263371:0:23446:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787787522.263374:0:23446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787787522.263376:0:23446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787787522.263377:0:23446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787787522.263378:0:23446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787787522.263379:0:23446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787787522.263395:0:23446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787787522.263397:0:23446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787787522.263399:0:23446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787787522.263400:0:23446:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787787522.263415:0:23446:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1787787522.266345:0:22730:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787787522.266352:0:22730:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787787522.266372:0:22730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9870c13f5200/0x11620bc3f30aa90a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787522.266391:0:22730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff987101ee2600/0x11620bc3f30aa80e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa807 expref: 17 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787522.266399:0:22730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff986fc43e0000/0x11620bc3f30aa8d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa8cb expref: 17 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787522.266406:0:22730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9870c13f5200/0x11620bc3f30aa90a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787522.266444:0:22730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff986fc43e0000/0x11620bc3f30aa8d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30aa8cb expref: 17 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787522.266460:0:22730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff986fc43e0000/0x11620bc3f30aa8d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30aa8cb expref: 17 pid: 22707 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787522.266475:0:22730:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed927480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22730:1874630503801600:0@lo:104: 00000100:00100000:3.0:1787787522.266539:0:22730:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787787522.266596:0:22730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff987101ee2600/0x11620bc3f30aa80e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30aa807 expref: 17 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787522.266612:0:22730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff987101ee2600/0x11620bc3f30aa80e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30aa807 expref: 17 pid: 22708 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787522.266621:0:22730:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9243c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22730:1874630503801728:0@lo:104: 00000100:00100000:3.0:1787787522.266647:0:22730:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787522.266665:0:22730:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f4412840 going to sleep for 11 seconds 00000100:00100000:3.0:1787787522.266688:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503801600 00000100:00100000:3.0:1787787522.266694:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503801600 00000100:00100000:3.0:1787787522.266975:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503801728 00000100:00100000:3.0:1787787522.266979:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503801728 00000100:00100000:3.0:1787787522.266994:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787787522.267002:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed927c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3fd2c107-7647-408e-8048-4ef16ee44cbc+4:22730:x1874630503801600:12345-0@lo:104: 00010000:00010000:3.0:1787787522.267015:0:22697:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870c13f4000/0x11620bc3f30aa8cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa8d2 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787522.267080:0:22697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787787522.267086:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed927c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3fd2c107-7647-408e-8048-4ef16ee44cbc+4:22730:x1874630503801600:12345-0@lo:104: Request processed in 84us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787522.267093:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787787522.267111:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787787522.267118:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed924b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3fd2c107-7647-408e-8048-4ef16ee44cbc+3:22730:x1874630503801728:12345-0@lo:104: 00010000:00010000:3.0:1787787522.267126:0:22697:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff986fc43e0400/0x11620bc3f30aa807 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa80e expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787522.267203:0:22730:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed927480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22730:1874630503801600:0@lo:104: 00000100:00100000:2.0:1787787522.267213:0:22730:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9243c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22730:1874630503801728:0@lo:104: 00010000:00010000:2.0:1787787522.267232:0:22730:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9870c13f5200/0x11620bc3f30aa90a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787522.267492:0:22697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787787522.267499:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed924b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3fd2c107-7647-408e-8048-4ef16ee44cbc+3:22730:x1874630503801728:12345-0@lo:104: Request processed in 381us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787522.267524:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1787787522.268190:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787787522.268198:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c13f4000/0x11620bc3f30aa8cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa8d2 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.268209:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f4000 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787522.268214:0:22702:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f4000/0x11620bc3f30aa8cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30aa8d2 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.268223:0:22702:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c13f4000/0x11620bc3f30aa8cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30aa8d2 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787522.268232:0:22702:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f4000/0x11620bc3f30aa8cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30aa8d2 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787522.268237:0:22702:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787787522.268285:0:22702:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c13f4000/0x11620bc3f30aa8cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa8d2 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.268291:0:22702:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787522.268312:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c13f4000/0x11620bc3f30aa8cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa8d2 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.268331:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c13f4000/0x11620bc3f30aa8cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa8d2 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.268342:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787522.268345:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff986fc43e0400/0x11620bc3f30aa807 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa80e expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.268350:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc43e0400 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787522.268352:0:22702:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff986fc43e0400/0x11620bc3f30aa807 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30aa80e expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.268360:0:22702:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff986fc43e0400/0x11620bc3f30aa807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30aa80e expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787522.268366:0:22702:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff986fc43e0400/0x11620bc3f30aa807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30aa80e expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787522.268370:0:22702:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787787522.268383:0:22702:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff986fc43e0400/0x11620bc3f30aa807 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa80e expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.268389:0:22702:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787522.268403:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff986fc43e0400/0x11620bc3f30aa807 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa80e expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.268410:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff986fc43e0400/0x11620bc3f30aa807 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa80e expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.268423:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787522.268429:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787522.268431:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787522.268438:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787522.268457:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3fd2c107-7647-408e-8048-4ef16ee44cbc:3656:1874630503801856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787522.268504:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787522.268543:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787787522.268551:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3fd2c107-7647-408e-8048-4ef16ee44cbc:3654:1874630503801984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787522.268574:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787522.268872:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503801856 00000100:00100000:3.0:1787787522.268880:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503801856 00010000:00010000:3.0:1787787522.268908:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff986fc43e0000/0x11620bc3f30aa8d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa8cb expref: 18 pid: 22707 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787522.268942:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503801984 00000100:00100000:3.0:1787787522.268945:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503801984 00010000:00010000:3.0:1787787522.268958:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff987101ee2600/0x11620bc3f30aa80e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa807 expref: 19 pid: 22708 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787522.268977:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787787522.268985:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2c107-7647-408e-8048-4ef16ee44cbc+19:3656:x1874630503801856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787787522.268997:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787522.269002:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff986fc43e0000/0x11620bc3f30aa8d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa8cb expref: 19 pid: 22707 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787522.269014:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff986fc43e0000/0x11620bc3f30aa8d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30aa8cb expref: 19 pid: 22707 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787522.269030:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc43e0000/0x11620bc3f30aa8d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30aa8cb expref: 19 pid: 22707 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787522.269044:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787522.269084:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:3656:x1874630503801856:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787522.269210:0:22700:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787787522.269218:0:22700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000040:01000000:1.0:1787787522.269410:0:23446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1787787522.269501:0:23472:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1787787522.269505:0:23472:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:2.0:1787787522.270061:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787787522.270074:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:3654:x1874630503801984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787522.270086:0:22701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787522.270093:0:22701:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff987101ee2600/0x11620bc3f30aa80e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa807 expref: 18 pid: 22708 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.270104:0:22701:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff987101ee2600/0x11620bc3f30aa80e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30aa807 expref: 18 pid: 22708 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.270117:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff987101ee2600/0x11620bc3f30aa80e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30aa807 expref: 18 pid: 22708 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.270129:0:22701:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9870c13f5200/0x11620bc3f30aa90a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.270152:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c13f5200/0x11620bc3f30aa90a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787787522.270168:0:22701:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003816554s 00010000:00010000:2.0:1787787522.270173:0:22701:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9870c13f5200/0x11620bc3f30aa90a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.270190:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9870c13f5200/0x11620bc3f30aa90a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.270197:0:22701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9870c13f5200/0x11620bc3f30aa90a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.270203:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9870c13f5200/0x11620bc3f30aa90a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.270209:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f5200 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787522.270213:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9870c13f5200/0x11620bc3f30aa90a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.270221:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9870c13f5200/0x11620bc3f30aa90a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.270237:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9870c13f5200/0x11620bc3f30aa90a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.270247:0:22701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787522.270303:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2c107-7647-408e-8048-4ef16ee44cbc+17:3654:x1874630503801984:12345-0@lo:103:ldlm_bl.0 Request processed in 233us (1729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787522.270311:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787787522.273114:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787787522.273118:0:22730:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9870c13f5200/0x11620bc3f30aa90a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.273133:0:22730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9870c13f5200/0x11620bc3f30aa90a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787522.273161:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870c13f5200/0x11620bc3f30aa90a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787522.273209:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3fd2c107-7647-408e-8048-4ef16ee44cbc:3656:1874630503801856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787522.273219:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3fd2c107-7647-408e-8048-4ef16ee44cbc:3654:1874630503801984:0@lo:103:ldlm_bl.0 00000040:01000000:2.0:1787787522.273348:0:23474:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1787787522.274022:0:23474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1787787522.274071:0:23446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1787787522.275077:0:23475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed926d00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23475:1874630503802112:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1787787522.275409:0:23446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1787787522.275465:0:23446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787787522.276252:0:23474:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787787522.276339:0:23474:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00000080:1.0:1787787522.276877:0:23446:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787787522.276890:0:23446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1787787522.276968:0:23446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787787522.277292:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787522.277352:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503802112 00000100:00100000:0.0:1787787522.277362:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503802112 00000100:00100000:0.0:1787787522.277408:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787787522.277418:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed9243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23475:x1874630503802112:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787787522.277521:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed9243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23475:x1874630503802112:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 104us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787522.277529:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787787522.277734:0:23475:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f4412a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787787522.277764:0:23475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed926d00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23475:1874630503802112:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1787787522.277801:0:23475:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787787522.277854:0:23475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418e580 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23475:1874630503802240:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787787522.277896:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787522.277920:0:23475:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c81e6480 going to sleep for 11 seconds 00000100:00100000:0.0:1787787522.277969:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503802240 00000100:00100000:0.0:1787787522.277974:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503802240 00000100:00100000:0.0:1787787522.278006:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787787522.278014:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23475:x1874630503802240:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787787522.278199:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23475:x1874630503802240:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 185us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787522.278207:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787787522.278532:0:23475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418e580 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23475:1874630503802240:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787787522.278598:0:23475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed927480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23475:1874630503802368:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787787522.278634:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787522.278659:0:23475:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c2c09240 going to sleep for 11 seconds 00000100:00100000:0.0:1787787522.278823:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503802368 00000100:00100000:0.0:1787787522.278828:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503802368 00000100:00100000:0.0:1787787522.278866:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787787522.278874:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed925680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23475:x1874630503802368:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787787522.278926:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed925680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23475:x1874630503802368:12345-0@lo:900:lod0001_rec0000.0 Request processed in 52us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787522.278932:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787787522.281132:0:23475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9870ed927480 x1874630503802368/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787787538 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787522.281170:0:23475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed927480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23475:1874630503802368:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787787522.281253:0:23475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed927480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23475:1874630503802496:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1787787522.281254:0:23446:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1787787522.281341:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787522.281377:0:23475:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c2c09480 going to sleep for 11 seconds 00000100:00100000:0.0:1787787522.281398:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503802496 00000100:00100000:0.0:1787787522.281405:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503802496 00000100:00100000:0.0:1787787522.281452:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787787522.281469:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed926940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23475:x1874630503802496:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787787522.281543:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed926940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23475:x1874630503802496:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 76us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787522.281551:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787787522.281700:0:23475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed927480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23475:1874630503802496:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1787787522.281739:0:23475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787787522.281857:0:23446:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787787522.281883:0:23446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1787787522.284822:0:23446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787787522.284899:0:23475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787787522.284972:0:23475:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787787522.284976:0:23475:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00080000:10000000:0.0:1787787522.285852:0:23446:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:1.0:1787787522.291277:0:23446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1787787522.294965:0:23446:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787787522.295011:0:23446:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa62241553988 00100000:10000000:1.0:1787787522.295020:0:23446:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1787787522.295794:0:23446:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787787522.295821:0:23446:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.131@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787787522.295838:0:23446:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787787522.295864:0:23446:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1787787522.296722:0:23446:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787787522.296967:0:23446:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787787522.477526:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787522.730248:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c74db600 going to sleep for 0 seconds 00000040:00080000:1.0:1787787522.730909:0:22750:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1787787523.306597:0:23468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1787787523.369268:0:22711:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787787523.369277:0:22711:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9870f576f800 from 12 10000000:01000000:1.0:1787787523.369283:0:22711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787787523.369329:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e0200/0x11620bc3f30aa911 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787523.369341:0:22711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff986fc43e0200/0x11620bc3f30aa911 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787523.369352:0:22711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff986fc43e0200/0x11620bc3f30aa911 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787523.369377:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc48992c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503802624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787787523.369457:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787523.369496:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d2379b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787787523.369728:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503802624 00000100:00100000:0.0:1787787523.369736:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503802624 00000100:00100000:0.0:1787787523.369791:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787787523.369801:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f03e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+16:22711:x1874630503802624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787523.369814:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787523.369828:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870f6658000/0x11620bc3f30aa918 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa911 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787523.369856:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870f6658000/0x11620bc3f30aa918 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa911 expref: 17 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787523.369866:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870f6658000/0x11620bc3f30aa918 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa911 expref: 17 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787523.369876:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f6658000, rc 0) 00000100:00100000:0.0:1787787523.369931:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f03e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+17:22711:x1874630503802624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787523.369938:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787787523.370722:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc48992c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503802624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787523.370741:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff986fc43e0200/0x11620bc3f30aa911 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa918 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787523.370762:0:22711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff986fc43e0200/0x11620bc3f30aa911 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa918 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787523.370821:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9252c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503802752:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787787523.370865:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787523.370905:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c2c09300 going to sleep for 11 seconds 00000100:00100000:0.0:1787787523.370965:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503802752 00000100:00100000:0.0:1787787523.370971:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503802752 00000100:00100000:0.0:1787787523.371011:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787787523.371019:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f03e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+17:22711:x1874630503802752:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787787523.371042:0:22708:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787787523.371058:0:22708:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787787523.371061:0:22708:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1787787523.371173:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f03e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+17:22711:x1874630503802752:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 155us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787523.371180:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787787523.371260:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9252c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503802752:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787787523.371306:0:22711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787787523.371313:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e0200/0x11620bc3f30aa911 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa918 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787523.371322:0:22711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff986fc43e0200/0x11620bc3f30aa911 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa918 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787523.371332:0:22711:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787787523.371334:0:22711:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff986fc2938000 from 12 10000000:01000000:3.0:1787787523.371337:0:22711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787787523.371355:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30aa91f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787523.371361:0:22711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30aa91f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787523.371368:0:22711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30aa91f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787523.371380:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9252c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503802880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787787523.371415:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787523.371442:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c2c09300 going to sleep for 11 seconds 00000100:00100000:2.0:1787787523.371900:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503802880 00000100:00100000:2.0:1787787523.371906:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503802880 00000100:00100000:2.0:1787787523.371944:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787787523.371952:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f03e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+17:22711:x1874630503802880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787523.371961:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787523.371973:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aa926 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa91f expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787523.371992:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aa926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa91f expref: 18 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787523.372002:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aa926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa91f expref: 18 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787523.372010:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2a00, rc 0) 00000100:00100000:2.0:1787787523.372061:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f03e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:22711:x1874630503802880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787523.372068:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787787523.372183:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9252c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503802880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787523.372199:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30aa91f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa926 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787523.372208:0:22711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30aa91f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa926 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787523.372264:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9252c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503803008:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787787523.372295:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787523.372316:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c2c09300 going to sleep for 11 seconds 00000100:00100000:2.0:1787787523.372394:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503803008 00000100:00100000:2.0:1787787523.372399:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503803008 00000100:00100000:2.0:1787787523.372429:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787787523.372435:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f03e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:22711:x1874630503803008:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787787523.372447:0:22707:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787787523.372459:0:22707:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787787523.372462:0:22707:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1787787523.372536:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f03e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:22711:x1874630503803008:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 99us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787523.372545:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787787523.372558:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9252c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503803008:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787787523.372664:0:22711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787787523.372671:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30aa91f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa926 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787523.372678:0:22711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30aa91f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa926 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787523.498211:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787523.754196:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c74db600 going to sleep for 0 seconds 00000040:00080000:3.0:1787787524.330316:0:23468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787787524.522438:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787524.777449:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c74db600 going to sleep for 0 seconds 00010000:00010000:2.0:1787787525.546901:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787525.802937:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c74db600 going to sleep for 0 seconds 00000001:02000400:2.0:1787787526.266593:0:23717:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg431-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787787526.573368:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787526.825419:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c74db600 going to sleep for 0 seconds 00000020:00000004:2.0:1787787527.138615:0:23769:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787787527.138864:0:23769:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787787527.529692:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787787527.529717:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503803136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787527.529836:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787527.529934:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503803136 00000100:00100000:0.0:1787787527.529942:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503803136 00000100:00100000:0.0:1787787527.529986:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787787527.529995:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503803136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787787527.530026:0:22719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787787527.530073:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503803136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787527.530081:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787787527.530157:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503803136:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1787787527.531044:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787787527.531049:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787787527.531066:0:36:0:(import.c:65:import_set_state_nolock()) ffff9870f3633000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787787527.531101:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9870f3633000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:3.0:1787787527.531126:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870ed925e00 x1874630503803392/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787787527.531179:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787527.531183:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787787527.531186:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787527.531189:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787787527.531202:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787527.531205:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787787527.531207:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787527.531209:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787787527.531420:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503803520:0@lo:400:kworker.0 00000100:00100000:1.0:1787787527.531481:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787527.531511:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787787527.531517:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3fd2c107-7647-408e-8048-4ef16ee44cbc:3656:1874630503803264:0@lo:400:kworker.0 00000100:00100000:1.0:1787787527.531544:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787527.531582:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503803520 00000100:00100000:1.0:1787787527.531587:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503803520 00000100:00100000:1.0:1787787527.531624:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787787527.531645:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503803520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787527.531701:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503803520:12345-0@lo:400:kworker.0 Request processed in 70us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787527.531707:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787787527.532092:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9870ed9270c0 x1874630503803520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787527.532105:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503803520:0@lo:400:kworker.0 00000100:00100000:0.0:1787787527.532835:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503803264 00000100:00100000:0.0:1787787527.532843:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503803264 00000100:00100000:0.0:1787787527.532931:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787787527.532941:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f03e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:3656:x1874630503803264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787527.533012:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f03e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:3656:x1874630503803264:12345-0@lo:400:kworker.0 Request processed in 73us (1467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787527.533020:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787787527.533091:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3fd2c107-7647-408e-8048-4ef16ee44cbc:3656:1874630503803264:0@lo:400:kworker.0 00000100:00100000:1.0:1787787527.533132:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503803648:0@lo:400:kworker.0 00000100:00100000:1.0:1787787527.533198:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787527.533260:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503803648 00000100:00100000:1.0:1787787527.533263:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503803648 00000100:00100000:1.0:1787787527.533297:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787787527.533304:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503803648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787527.533354:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503803648:12345-0@lo:400:kworker.0 Request processed in 50us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787527.533360:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787787527.533402:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9870ed927480 x1874630503803648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787527.533413:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503803648:0@lo:400:kworker.0 00000100:00100000:3.0:1787787527.533520:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed925e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503803392:0@lo:38:kworker.0 00000100:00100000:3.0:1787787527.533554:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787527.533759:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503803392 00000100:00100000:1.0:1787787527.533764:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503803392 00000100:00100000:1.0:1787787527.533795:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787787527.533800:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed927840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3652:x1874630503803392:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787787527.533827:0:22720:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 671 last 0 00000020:00000080:1.0:1787787527.533858:0:22720:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x11620bc3f30aa92d 00000004:00100000:1.0:1787787527.533871:0:22720:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1787787527.533878:0:22720:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:1.0:1787787527.549712:0:22720:0:(import.c:65:import_set_state_nolock()) ffff9870c7f35800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787787527.550711:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed927840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1874630503803392:12345-0@lo:38:kworker.0 Request processed in 16902us (17148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787527.550750:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1787787527.550866:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787787527.550875:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787787527.550881:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787787527.550884:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870f3633000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1787787527.550908:0:3652:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000003b87562c): req@ffff9870ed924f00 x1874630503796352/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787527.550935:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed925e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503803392:0@lo:38:kworker.0 00000100:00100000:2.0:1787787527.551173:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787527.551177:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787527.551195:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503803776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787787527.551208:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c74db600 going to sleep for 11 seconds 00000100:00100000:1.0:1787787527.551235:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787527.551264:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503796352 00000100:00100000:2.0:1787787527.551282:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503796352 00000100:00100000:2.0:1787787527.551321:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503803776 00000100:00100000:2.0:1787787527.551324:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503803776 00000100:00100000:2.0:1787787527.551340:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787787527.551347:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22756:x1874630503796352:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787787527.551353:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787787527.551376:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3653:x1874630503803776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787787527.551401:0:22720:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787787527.551445:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22756:x1874630503796352:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 86us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787527.551452:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787787527.551491:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3653:x1874630503803776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787527.551500:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed924f00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22756:1874630503796352:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787787527.551501:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787787527.551546:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503803776:0@lo:41:osp-pre-1-0.0 00000040:01000000:2.0:1787787527.551551:0:22756:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787787527.551585:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418d680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22756:1874630503803904:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787787527.551619:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787527.551644:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c5392b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787527.551673:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503803904 00000100:00100000:1.0:1787787527.551678:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503803904 00000100:00100000:1.0:1787787527.551709:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787787527.551715:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22756:x1874630503803904:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787787527.551837:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22756:x1874630503803904:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 122us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787527.551844:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787787527.551968:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418d680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22756:1874630503803904:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787787527.552044:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed925e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22756:1874630503804032:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787787527.552072:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787527.552094:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1557900 going to sleep for 11 seconds 00000100:00100000:1.0:1787787527.552183:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503804032 00000100:00100000:1.0:1787787527.552187:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503804032 00000100:00100000:1.0:1787787527.552207:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787787527.552213:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed926d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22756:x1874630503804032:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787787527.552268:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed926d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22756:x1874630503804032:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 54us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787527.552274:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787787527.552386:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed925e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22756:1874630503804032:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1787787527.552430:0:22756:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787787527.555615:0:22756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787787527.555714:0:22756:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 17, retries 0 00000004:00080000:3.0:1787787527.555719:0:22756:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1787787527.593668:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787787528.053789:0:23819:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787787528.054020:0:23819:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787787528.620298:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787787529.072972:0:23867:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcbfc2eb30 20000000:00000080:2.0:1787787529.072991:0:23867:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9870c7045000 uarg=0000000000000000 20000000:01000000:2.0:1787787529.073033:0:23867:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787787529.073041:0:23867:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787787529.073045:0:23867:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787787529.074914:0:23869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1787787529.075082:0:23867:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787787529.082691:0:23867:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787787529.082723:0:23867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff987101ee2600/0x11620bc3f30aa934 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787529.082742:0:23867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870f6659600/0x11620bc3f30aa7dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa7d6 expref: 17 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787529.082751:0:23867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870f6659800/0x11620bc3f30aa8e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa8d9 expref: 17 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787529.082758:0:23867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff987101ee2600/0x11620bc3f30aa934 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787529.082802:0:23867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870f6659800/0x11620bc3f30aa8e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30aa8d9 expref: 17 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787529.082817:0:23867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9870f6659800/0x11620bc3f30aa8e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30aa8d9 expref: 17 pid: 22708 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787529.082847:0:23867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23867:1874630503804160:0@lo:104: 00000100:00100000:2.0:1787787529.082915:0:23867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787787529.083001:0:23867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870f6659600/0x11620bc3f30aa7dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30aa7d6 expref: 17 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787529.083011:0:23867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9870f6659600/0x11620bc3f30aa7dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30aa7d6 expref: 17 pid: 22706 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787529.083020:0:23867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23867:1874630503804288:0@lo:104: 00000100:00100000:2.0:1787787529.083041:0:23867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787529.083169:0:23867:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c5392600 going to sleep for 11 seconds 00000100:00100000:3.0:1787787529.083689:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503804160 00000100:00100000:3.0:1787787529.083697:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503804160 00000100:00100000:3.0:1787787529.083736:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503804288 00000100:00100000:3.0:1787787529.083740:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503804288 00000100:00100000:3.0:1787787529.083755:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787787529.083763:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3fd2c107-7647-408e-8048-4ef16ee44cbc+4:23867:x1874630503804160:12345-0@lo:104: 00010000:00010000:3.0:1787787529.083777:0:22697:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30aa8d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa8e0 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787529.083849:0:22697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787787529.083855:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3fd2c107-7647-408e-8048-4ef16ee44cbc+4:23867:x1874630503804160:12345-0@lo:104: Request processed in 93us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787529.083862:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787787529.083877:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787787529.083884:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3fd2c107-7647-408e-8048-4ef16ee44cbc+3:23867:x1874630503804288:12345-0@lo:104: 00010000:00010000:3.0:1787787529.083892:0:22697:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff987101ee2e00/0x11620bc3f30aa7d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa7dd expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787529.083939:0:22697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787787529.083944:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3fd2c107-7647-408e-8048-4ef16ee44cbc+3:23867:x1874630503804288:12345-0@lo:104: Request processed in 62us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787529.083951:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787787529.083969:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787787529.083975:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30aa8d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa8e0 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787529.083984:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f5000 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:3.0:1787787529.083988:0:22702:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30aa8d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30aa8e0 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787529.083997:0:22702:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30aa8d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30aa8e0 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787529.084005:0:22702:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30aa8d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30aa8e0 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787529.084011:0:22702:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787787529.084040:0:22702:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30aa8d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa8e0 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787529.084047:0:22702:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787787529.084066:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30aa8d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa8e0 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787529.084073:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30aa8d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa8e0 expref: -99 pid: 23446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787529.084097:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787529.084101:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff987101ee2e00/0x11620bc3f30aa7d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa7dd expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787529.084106:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2e00 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:3.0:1787787529.084109:0:22702:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff987101ee2e00/0x11620bc3f30aa7d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30aa7dd expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787529.084116:0:22702:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff987101ee2e00/0x11620bc3f30aa7d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30aa7dd expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787529.084122:0:22702:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff987101ee2e00/0x11620bc3f30aa7d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30aa7dd expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787529.084127:0:22702:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787787529.084170:0:22702:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff987101ee2e00/0x11620bc3f30aa7d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa7dd expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787529.084177:0:22702:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787787529.084404:0:23867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23867:1874630503804160:0@lo:104: 00000100:00100000:2.0:1787787529.084414:0:23867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23867:1874630503804288:0@lo:104: 00010000:00010000:2.0:1787787529.084437:0:23867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff987101ee2600/0x11620bc3f30aa934 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787529.084482:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff987101ee2e00/0x11620bc3f30aa7d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa7dd expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787529.084489:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff987101ee2e00/0x11620bc3f30aa7d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa7dd expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787529.084503:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787529.084504:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787529.084505:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787529.084525:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed924f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3fd2c107-7647-408e-8048-4ef16ee44cbc:3655:1874630503804416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787787529.084565:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787529.084610:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787787529.084616:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3fd2c107-7647-408e-8048-4ef16ee44cbc:3655:1874630503804544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787787529.084636:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787529.084668:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503804416 00000100:00100000:3.0:1787787529.084671:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503804416 00010000:00010000:3.0:1787787529.084690:0:22700:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870f6659800/0x11620bc3f30aa8e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa8d9 expref: 18 pid: 22708 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787529.084709:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503804544 00000100:00100000:3.0:1787787529.084712:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503804544 00010000:00010000:3.0:1787787529.084724:0:22700:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870f6659600/0x11620bc3f30aa7dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa7d6 expref: 19 pid: 22706 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787529.084742:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787787529.084749:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed9252c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2c107-7647-408e-8048-4ef16ee44cbc+19:3655:x1874630503804416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787787529.084760:0:22700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787529.084765:0:22700:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870f6659800/0x11620bc3f30aa8e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa8d9 expref: 19 pid: 22708 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787529.084775:0:22700:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870f6659800/0x11620bc3f30aa8e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30aa8d9 expref: 19 pid: 22708 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787529.084788:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870f6659800/0x11620bc3f30aa8e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30aa8d9 expref: 19 pid: 22708 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787529.084799:0:22700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787529.084824:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed9252c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:3655:x1874630503804416:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787529.084831:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787787529.084851:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787787529.084857:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed9270c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2c107-7647-408e-8048-4ef16ee44cbc+17:3655:x1874630503804544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787787529.084877:0:22700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787529.084884:0:22700:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870f6659600/0x11620bc3f30aa7dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa7d6 expref: 17 pid: 22706 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787529.084892:0:22700:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870f6659600/0x11620bc3f30aa7dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30aa7d6 expref: 17 pid: 22706 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787529.084902:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870f6659600/0x11620bc3f30aa7dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30aa7d6 expref: 17 pid: 22706 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787529.084912:0:22700:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff987101ee2600/0x11620bc3f30aa934 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787529.084920:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff987101ee2600/0x11620bc3f30aa934 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787529.084933:0:22700:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff987101ee2600/0x11620bc3f30aa934 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787529.084940:0:22700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff987101ee2600/0x11620bc3f30aa934 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787529.084946:0:22700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff987101ee2600/0x11620bc3f30aa934 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787529.084952:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff987101ee2600/0x11620bc3f30aa934 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787529.084957:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2600 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787529.084967:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff987101ee2600/0x11620bc3f30aa934 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787529.084974:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff987101ee2600/0x11620bc3f30aa934 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787529.084985:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff987101ee2600/0x11620bc3f30aa934 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787529.084993:0:22700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787529.085016:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed9270c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3fd2c107-7647-408e-8048-4ef16ee44cbc+16:3655:x1874630503804544:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787529.085022:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787787529.085051:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3fd2c107-7647-408e-8048-4ef16ee44cbc:3655:1874630503804544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787787529.085058:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed924f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3fd2c107-7647-408e-8048-4ef16ee44cbc:3655:1874630503804416:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787787529.085129:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787529.085493:0:23867:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff987101ee2600/0x11620bc3f30aa934 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787529.085502:0:23867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff987101ee2600/0x11620bc3f30aa934 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787529.085509:0:23867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff987101ee2600/0x11620bc3f30aa934 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787529.642103:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787530.672632:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787787530.992603:0:22711:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787787530.992614:0:22711:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9870f576f800 from 13 10000000:01000000:0.0:1787787530.992622:0:22711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787787530.992687:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f6658800/0x11620bc3f30aa93b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787530.992702:0:22711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870f6658800/0x11620bc3f30aa93b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787530.992716:0:22711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870f6658800/0x11620bc3f30aa93b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787530.992751:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503804672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787787530.992846:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787530.992912:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f36b4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787787530.993372:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503804672 00000100:00100000:2.0:1787787530.993384:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503804672 00000100:00100000:2.0:1787787530.993456:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787787530.993476:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f03e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+16:22711:x1874630503804672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787530.993494:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787530.993511:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff987101ee3800/0x11620bc3f30aa942 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa93b expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787530.993539:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff987101ee3800/0x11620bc3f30aa942 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa93b expref: 17 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787530.993551:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff987101ee3800/0x11620bc3f30aa942 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa93b expref: 17 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787530.993561:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3800, rc 0) 00000100:00100000:2.0:1787787530.993627:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f03e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+17:22711:x1874630503804672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787530.993634:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787787530.993828:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503804672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787530.993850:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870f6658800/0x11620bc3f30aa93b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa942 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787530.993861:0:22711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870f6658800/0x11620bc3f30aa93b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa942 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787530.993963:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed924f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503804800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787530.993998:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787530.994036:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2a5ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787530.994117:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503804800 00000100:00100000:0.0:1787787530.994122:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503804800 00000100:00100000:0.0:1787787530.994184:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787787530.994193:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f03e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+17:22711:x1874630503804800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787530.994664:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f03e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+17:22711:x1874630503804800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 471us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787530.994673:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787787530.995805:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed924f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503804800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787530.995887:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed924f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503804928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787530.996011:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787530.996109:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2a5ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1787787530.996298:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503804928 00000100:00100000:2.0:1787787530.996306:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503804928 00000100:00100000:2.0:1787787530.996398:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787787530.996408:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f03e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+17:22711:x1874630503804928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787530.996547:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f03e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+17:22711:x1874630503804928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787530.996555:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787787530.996629:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed924f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503804928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787787530.997394:0:23956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787787530.997472:0:22711:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787787530.997500:0:22711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787787530.997513:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f6658800/0x11620bc3f30aa93b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa942 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787530.997526:0:22711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870f6658800/0x11620bc3f30aa93b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa942 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787530.997539:0:22711:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787787530.997543:0:22711:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff986fc2938000 from 13 10000000:01000000:3.0:1787787530.997546:0:22711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787787530.997585:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30aa949 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787530.997592:0:22711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30aa949 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787530.997602:0:22711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30aa949 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787530.997621:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed924f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503805056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787787530.997675:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787530.998388:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2a5e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787530.998553:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503805056 00000100:00100000:0.0:1787787530.998562:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503805056 00000100:00100000:0.0:1787787530.998609:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787787530.998620:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f03e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+17:22711:x1874630503805056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787530.998635:0:22708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787530.998660:0:22708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870f6658a00/0x11620bc3f30aa950 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa949 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787530.998692:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870f6658a00/0x11620bc3f30aa950 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa949 expref: 18 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787530.998705:0:22708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870f6658a00/0x11620bc3f30aa950 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa949 expref: 18 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787530.998716:0:22708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f6658a00, rc 0) 00000100:00100000:0.0:1787787530.998821:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f03e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:22711:x1874630503805056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 203us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787530.998828:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787787530.999033:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed924f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503805056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787530.999052:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30aa949 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa950 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787530.999062:0:22711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30aa949 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa950 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787530.999327:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed924f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503805184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787530.999364:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787530.999430:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2a5e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787530.999463:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503805184 00000100:00100000:0.0:1787787530.999468:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503805184 00000100:00100000:0.0:1787787530.999543:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787787530.999552:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f03e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:22711:x1874630503805184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787530.999690:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f03e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:22711:x1874630503805184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787530.999697:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787787530.999751:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed924f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503805184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787530.999781:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed924f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503805312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787530.999819:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787530.999908:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2a5e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787530.999958:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503805312 00000100:00100000:2.0:1787787530.999963:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503805312 00000100:00100000:2.0:1787787530.999987:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787787530.999994:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f03e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:22711:x1874630503805312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787531.000089:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f03e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:22711:x1874630503805312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787531.000113:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787787531.000177:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed924f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503805312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787787531.000926:0:23957:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787787531.000999:0:22711:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787787531.001031:0:22711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787787531.001043:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30aa949 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa950 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787531.001054:0:22711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30aa949 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa950 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787531.689587:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787532.652482:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787787522/real 1787787522] req@ffff9870ed926580 x1874630503799552/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787532 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787532.652516:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9870ed926580 x1874630503799552/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787532 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787532.652527:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787787522/real 1787787522] req@ffff986fc418c780 x1874630503799424/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787532 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787532.652539:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff986fc418c780 x1874630503799424/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787532 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787787532.652560:0:3652:0:(import.c:65:import_set_state_nolock()) ffff986fc43a7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787787532.652568:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787787532.652581:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed926580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503799552:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787787532.652587:0:3652:0:(import.c:65:import_set_state_nolock()) ffff987101cd8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787787532.652592:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787787532.652594:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503799424:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787787532.652730:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787532.652736:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787787532.652739:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787532.652742:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787787532.652767:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787532.652770:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787787532.652773:0:36:0:(import.c:65:import_set_state_nolock()) ffff987101cd8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787787532.652778:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 666 00000100:00080000:2.0:1787787532.652784:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787787532.652791:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff987101cd8800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:2.0:1787787532.652812:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc418c780 x1874630503805952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787787532.652825:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787532.652835:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787787532.652837:0:36:0:(import.c:65:import_set_state_nolock()) ffff986fc43a7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787787532.652840:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 666 00000100:00080000:2.0:1787787532.652843:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787787532.652847:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff986fc43a7000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:2.0:1787787532.652859:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc418cf00 x1874630503806080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787787532.652892:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503805568:0@lo:400:kworker.0 00000100:00100000:2.0:1787787532.652959:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787532.653009:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787787532.653015:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3fd2c107-7647-408e-8048-4ef16ee44cbc:3654:1874630503805440:0@lo:400:kworker.0 00000100:00100000:2.0:1787787532.653042:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787532.653071:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503806208:0@lo:400:kworker.0 00000100:00100000:2.0:1787787532.653096:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787532.653118:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503805696:0@lo:400:kworker.0 00000100:00100000:2.0:1787787532.653556:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787532.653581:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787787532.653587:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503805824:0@lo:400:kworker.0 00000100:00100000:2.0:1787787532.653610:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787532.653644:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503805440 00000100:00100000:2.0:1787787532.653651:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503805440 00000100:00100000:2.0:1787787532.653758:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787787532.653768:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f03e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:3654:x1874630503805440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787532.653822:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f03e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:3654:x1874630503805440:12345-0@lo:400:kworker.0 Request processed in 56us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787532.653840:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787787532.653875:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503805568 00000100:00100000:2.0:1787787532.653879:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503805568 00000100:00100000:2.0:1787787532.653904:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503805824 00000100:00100000:2.0:1787787532.653906:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503805824 00000100:00100000:2.0:1787787532.653918:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787787532.653923:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3654:x1874630503805568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787532.653957:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3654:x1874630503805568:12345-0@lo:400:kworker.0 Request processed in 33us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787532.653963:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787787532.653975:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787787532.653980:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc24b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503805824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787532.654011:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc24b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503805824:12345-0@lo:400:kworker.0 Request processed in 31us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787532.654016:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787787532.654040:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503805952:0@lo:8:kworker.0 00000400:00000100:2.0:1787787532.654074:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874630503805952 offset 0 length 520: 4 00000100:00100000:2.0:1787787532.654088:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503806080:0@lo:8:kworker.0 00000400:00000100:2.0:1787787532.654103:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874630503806080 offset 0 length 520: 4 00000100:00100000:2.0:1787787532.654396:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503805824:0@lo:400:kworker.0 00000100:00100000:2.0:1787787532.654426:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3fd2c107-7647-408e-8048-4ef16ee44cbc:3654:1874630503805440:0@lo:400:kworker.0 00000100:00100000:2.0:1787787532.654436:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503805568:0@lo:400:kworker.0 00000100:00100000:2.0:1787787532.655219:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503806208 00000100:00100000:2.0:1787787532.655232:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503806208 00000100:00100000:2.0:1787787532.655267:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503805696 00000100:00100000:2.0:1787787532.655270:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503805696 00000100:00100000:2.0:1787787532.655284:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787787532.655291:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc24b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503806208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787532.655344:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc24b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503806208:12345-0@lo:400:kworker.0 Request processed in 53us (2247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787532.655351:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787787532.655364:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787787532.655370:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc24b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503805696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787532.655402:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc24b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503805696:12345-0@lo:400:kworker.0 Request processed in 32us (1847us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787532.655408:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787787532.655447:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff986fc418e940 x1874630503805696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787532.655473:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503805696:0@lo:400:kworker.0 00010000:00080000:2.0:1787787532.655501:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff986fc418c000 x1874630503806208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787532.655511:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503806208:0@lo:400:kworker.0 00000100:00100000:1.0:1787787532.656478:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787532.656494:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503806336:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787787532.656549:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787532.656589:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503806336 00000100:00100000:1.0:1787787532.656594:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503806336 00000100:00100000:1.0:1787787532.656632:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787787532.656640:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc48992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503806336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787787532.656667:0:22720:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787787532.656718:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc48992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503806336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787532.656734:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787787532.656773:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503806336:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787787532.658245:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787787532.658262:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503806464:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787787532.658315:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787532.660281:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503806464 00000100:00100000:1.0:1787787532.660295:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503806464 00000100:00100000:1.0:1787787532.660342:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787787532.660351:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc24b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3656:x1874630503806464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787787532.660384:0:22719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787787532.660448:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc24b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3656:x1874630503806464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (2133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787532.660455:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787787532.661209:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503806464:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787787532.718781:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787787532.975176:0:22750:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:3.0:1787787533.678467:0:23448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1787787533.741488:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787787534.573467:0:23468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787787534.765974:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787787535.377713:0:24215:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787787535.377717:0:24215:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787787535.377719:0:24215:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787787535.377832:0:24215:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9870c3570000 00000020:01000004:1.0:1787787535.377849:0:24215:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787787535.377864:0:24215:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787787535.377878:0:24215:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9870f57799b8) 00000020:00000080:1.0:1787787535.377894:0:24215:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787787535.509758:0:24215:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787787535.513711:0:24215:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1787787535.514352:0:24215:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1787787535.514758:0:24215:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787787535.514961:0:24215:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1787787535.515247:0:24215:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1787787535.515430:0:24215:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1787787535.516430:0:24215:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787787535.516851:0:24215:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787787535.516874:0:24215:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787787535.516889:0:24215:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x11620bc3f30aa95e 00000020:01000004:0.0:1787787535.516896:0:24215:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1787787535.516920:0:24215:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.131@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787787535.516923:0:24215:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787787535.516930:0:24215:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787787535.516935:0:24215:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1787787535.516946:0:24215:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9870f55f19b8) 00000020:00000080:0.0:1787787535.516958:0:24215:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1787787535.518261:0:24215:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787787535.518420:0:24215:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787787535.518425:0:24215:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787787535.519960:0:24215:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787787535.519969:0:24215:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787787535.520687:0:24215:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787787535.520695:0:24215:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787787535.525259:0:24215:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787787535.525434:0:24215:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787787535.525441:0:24215:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787787535.530895:0:24215:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787787535.530908:0:24215:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787787535.554871:0:24215:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787787535.555268:0:24215:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787787535.555276:0:24215:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787787535.557128:0:24215:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787787535.557205:0:24215:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787787535.559043:0:24215:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787787535.559135:0:24215:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787787535.562765:0:24215:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787787535.562968:0:24215:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787787535.562981:0:24215:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787787535.564314:0:24215:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787787535.564324:0:24215:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787787535.637127:0:24215:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787787535.637500:0:24215:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787787535.637798:0:24215:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787787535.639358:0:24215:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787787535.639371:0:24215:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787787535.640058:0:24215:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787787535.640091:0:24215:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1787787535.640097:0:24215:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.131@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787787535.669847:0:24215:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.131@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787787535.669894:0:24215:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.131@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1787787535.669898:0:24215:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787787535.669900:0:24215:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787787535.669901:0:24215:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787535.669903:0:24215:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787535.669904:0:24215:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787535.669906:0:24215:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787535.669907:0:24215:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787787535.669908:0:24215:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787535.669910:0:24215:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787787535.669914:0:24215:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1787787535.669916:0:24215:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787787535.669917:0:24215:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787787535.669918:0:24215:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787535.669919:0:24215:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787535.669920:0:24215:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787535.669928:0:24215:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787535.669929:0:24215:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787787535.669930:0:24215:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787535.669931:0:24215:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787787535.669959:0:24215:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787787535.669978:0:24215:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed926580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503806592:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787787535.670080:0:24215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787535.670226:0:24215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d154ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787787535.675269:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503806592 00000100:00100000:2.0:1787787535.675392:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503806592 00000100:00100000:2.0:1787787535.675515:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787787535.675533:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f03e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:24215:x1874630503806592:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787787535.675594:0:22706:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787787535.675598:0:22706:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787787535.675601:0:22706:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787787535.676257:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f03e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:24215:x1874630503806592:12345-0@lo:253:mount.lustre.0 Request processed in 730us (6174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787535.676266:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787787535.677542:0:24215:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed926580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503806592:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787787535.677562:0:24215:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787787535.677566:0:24215:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787787535.677567:0:24215:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787787535.677569:0:24215:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787535.677570:0:24215:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787535.677572:0:24215:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787535.677573:0:24215:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787535.677575:0:24215:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787787535.677577:0:24215:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787535.677578:0:24215:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787787535.677610:0:24215:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9870c3570000 from lustre-OST0000 10000000:01000000:3.0:1787787535.677638:0:24215:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787787535.677641:0:24215:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787787535.677648:0:24215:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff986fc296cd28 local copy 00010000:00010000:3.0:1787787535.677659:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e0600/0x11620bc3f30aa719 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa720 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787535.677766:0:24215:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed926580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503806720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787535.677815:0:24215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787535.678519:0:24215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d154e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787535.678779:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503806720 00000100:00100000:0.0:1787787535.678787:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503806720 00000100:00100000:0.0:1787787535.678836:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787787535.678845:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f521f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:24215:x1874630503806720:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787787535.678944:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f521f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:24215:x1874630503806720:12345-0@lo:501:mount.lustre.0 Request processed in 99us (1127us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787787535.678951:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787787535.679041:0:24215:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed926580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503806720:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787787535.679069:0:24215:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787787535.679090:0:24215:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787787535.679109:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e0600/0x11620bc3f30aa719 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa720 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787535.679119:0:24215:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff986fc43e0600/0x11620bc3f30aa719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa720 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787535.679182:0:24215:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9870c3570000 10000000:01000000:3.0:1787787535.679187:0:24215:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787787535.679193:0:24215:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787787535.679196:0:24215:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787787535.679200:0:24215:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787787535.679203:0:24215:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787787535.679229:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30aa96c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787535.679237:0:24215:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30aa96c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787535.679248:0:24215:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30aa96c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787535.679263:0:24215:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed926580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503806848:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787787535.679304:0:24215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787535.679323:0:24215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d154e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787535.679374:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503806848 00000100:00100000:0.0:1787787535.679379:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503806848 00000100:00100000:0.0:1787787535.679397:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787787535.679404:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f521f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+18:24215:x1874630503806848:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787787535.679419:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787535.679432:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870f6659600/0x11620bc3f30aa973 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa96c expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787535.679453:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870f6659600/0x11620bc3f30aa973 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa96c expref: 19 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787535.679464:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870f6659600/0x11620bc3f30aa973 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa96c expref: 19 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787535.679472:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f6659600, rc 0) 00000100:00100000:0.0:1787787535.679520:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f521f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+19:24215:x1874630503806848:12345-0@lo:101:mount.lustre.0 Request processed in 116us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787535.679535:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787787535.679949:0:24215:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed926580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503806848:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787787535.679963:0:24215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30aa96c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa973 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787535.679972:0:24215:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30aa96c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa973 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787787535.681513:0:24215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:3.0:1787787535.682441:0:24215:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787787535.685890:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1787787535.685953:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1787787535.685971:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1787787535.685986:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1787787535.686001:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1787787535.686026:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1787787535.686041:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1787787535.686054:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1787787535.686326:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1787787535.686341:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1787787535.686353:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1787787535.686367:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1787787535.686393:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1787787535.686399:0:24215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1787787535.686520:0:24215:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed926580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503806976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787535.686601:0:24215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787535.686762:0:24215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d154e900 going to sleep for 11 seconds 00000100:00100000:0.0:1787787535.686976:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503806976 00000100:00100000:0.0:1787787535.686985:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503806976 00000100:00100000:1.0:1787787535.687067:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787787535.687079:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f521c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+19:24215:x1874630503806976:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787535.687294:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f521c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+19:24215:x1874630503806976:12345-0@lo:501:mount.lustre.0 Request processed in 217us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787535.687302:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787787535.687463:0:24215:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed926580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503806976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787787535.687515:0:24215:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503807104:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787787535.687581:0:24215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787535.687772:0:24215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e08320c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787535.687840:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503807104 00000100:00100000:1.0:1787787535.687845:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503807104 00000100:00100000:1.0:1787787535.687882:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787787535.687889:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f521d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+19:24215:x1874630503807104:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787535.689052:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f521d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+19:24215:x1874630503807104:12345-0@lo:503:mount.lustre.0 Request processed in 1157us (1465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787535.689071:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787787535.689311:0:24215:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503807104:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787787535.689991:0:24215:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787787535.690188:0:24215:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed925e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503807232:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787787535.690415:0:24215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787535.690542:0:24215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d154e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787535.690793:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503807232 00000100:00100000:0.0:1787787535.690800:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503807232 00000100:00100000:0.0:1787787535.690832:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787787535.690840:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+19:24215:x1874630503807232:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787787535.691469:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+19:24215:x1874630503807232:12345-0@lo:502:mount.lustre.0 Request processed in 627us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787535.691478:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787787535.691743:0:24215:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed925e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503807232:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787787535.691946:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1787787535.691976:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1787787535.691998:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1787787535.692026:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1787787535.692040:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1787787535.692051:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1787787535.692074:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1787787535.692090:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1787787535.692103:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1787787535.692117:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1787787535.692129:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1787787535.692182:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1787787535.692213:0:24215:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed925e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503807360:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787787535.692257:0:24215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787535.692346:0:24215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d154e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787535.692721:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503807360 00000100:00100000:1.0:1787787535.692728:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503807360 00000100:00100000:1.0:1787787535.692777:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787787535.692788:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+19:24215:x1874630503807360:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787535.692900:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+19:24215:x1874630503807360:12345-0@lo:502:mount.lustre.0 Request processed in 113us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787535.692907:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787787535.693068:0:24215:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed925e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503807360:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787787535.693120:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1787787535.693130:0:24215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1787787535.694482:0:24232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787787535.694494:0:24232:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1787787535.694501:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787535.694672:0:24232:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787787535.694682:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787787535.694697:0:24232:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9870f55f3370) 00000020:00000080:0.0:1787787535.694731:0:24232:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787787535.694739:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787787535.694813:0:24232:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9870c3570000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787787535.694822:0:24232:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787787535.694830:0:24232:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x11620bc3f30aa981 00010000:00010000:0.0:1787787535.703243:0:24232:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1787787535.703807:0:24232:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:0.0:1787787535.705757:0:24232:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1787787535.709500:0:24232:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787787535.709536:0:24232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787535.709545:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787535.709547:0:24232:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787787535.709551:0:24232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787787535.709554:0:24232:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1787787535.709555:0:24232:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787787535.709557:0:24232:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787787535.709559:0:24232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787787535.709562:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787535.709563:0:24232:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787787535.709566:0:24232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787535.709569:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787535.709570:0:24232:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787787535.709574:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787787535.709576:0:24232:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787787535.709579:0:24232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787535.709581:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787535.709582:0:24232:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787787535.709585:0:24232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787787535.709587:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787535.709588:0:24232:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787787535.709591:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787787535.709698:0:24232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787787535.709702:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787787535.709704:0:24232:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787787535.709716:0:24232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1787787535.710897:0:24215:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1787787535.710936:0:24215:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787787535.710961:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30aa96c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa973 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787535.710974:0:24215:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c13f5200/0x11620bc3f30aa96c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa973 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787535.710983:0:24215:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9870c3570000 from 1 10000000:01000000:0.0:1787787535.710985:0:24215:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787787535.711036:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f6659800/0x11620bc3f30aa988 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787535.711044:0:24215:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870f6659800/0x11620bc3f30aa988 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787535.711067:0:24215:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870f6659800/0x11620bc3f30aa988 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787535.711092:0:24215:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503807488:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787787535.711175:0:24215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787535.711221:0:24215:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc10cac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787787535.711886:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503807488 00000100:00100000:1.0:1787787535.711895:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503807488 00000100:00100000:1.0:1787787535.711944:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787787535.711954:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+19:24215:x1874630503807488:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787535.711967:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787535.711984:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc43e0a00/0x11620bc3f30aa98f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa988 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787535.712030:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc43e0a00/0x11620bc3f30aa98f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa988 expref: 20 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787535.712041:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc43e0a00/0x11620bc3f30aa98f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa988 expref: 20 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787535.712061:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc43e0a00, rc 0) 00000100:00100000:1.0:1787787535.712106:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+20:24215:x1874630503807488:12345-0@lo:101:mount.lustre.0 Request processed in 153us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787535.712113:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787787535.713191:0:24215:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503807488:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787787535.713212:0:24215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870f6659800/0x11620bc3f30aa988 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa98f expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787535.713222:0:24215:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870f6659800/0x11620bc3f30aa988 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa98f expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787787535.716373:0:24215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1787787535.717422:0:24215:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787787535.718267:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1787787535.718507:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1787787535.718963:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1787787535.718982:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1787787535.718994:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1787787535.719023:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1787787535.719042:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1787787535.719126:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1787787535.719412:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1787787535.719429:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1787787535.719444:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1787787535.719467:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1787787535.719472:0:24215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1787787535.720414:0:24215:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4898780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503807616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787535.720487:0:24215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787535.720748:0:24215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870fc2f03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787535.720831:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503807616 00000100:00100000:3.0:1787787535.720838:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503807616 00000100:00100000:3.0:1787787535.720886:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787787535.720895:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+20:24215:x1874630503807616:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787535.721037:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+20:24215:x1874630503807616:12345-0@lo:501:mount.lustre.0 Request processed in 142us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787535.721044:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787787535.721267:0:24215:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4898780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503807616:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787787535.721423:0:24215:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503807744:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787787535.721473:0:24215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787535.721505:0:24215:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc10cae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787535.721691:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503807744 00000100:00100000:1.0:1787787535.721703:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503807744 00000100:00100000:1.0:1787787535.721739:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787787535.721748:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+20:24215:x1874630503807744:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787535.721831:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+20:24215:x1874630503807744:12345-0@lo:503:mount.lustre.0 Request processed in 84us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787535.721838:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787787535.722399:0:24215:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503807744:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787787535.723050:0:24215:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787787535.723166:0:24215:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503807872:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787787535.723224:0:24215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787535.723255:0:24215:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc10cac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787787535.723393:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787787520/real 1787787520] req@ffff986fc4898b40 x1874630503797376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787535 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787535.723413:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff986fc4898b40 x1874630503797376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787535 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787535.723423:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787787520/real 1787787520] req@ffff986fc4899a40 x1874630503797504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787535 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787535.723442:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff986fc4899a40 x1874630503797504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787535 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787787535.723459:0:3652:0:(import.c:65:import_set_state_nolock()) ffff987101e32800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787787535.723472:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787787535.723476:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4898b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503797376:0@lo:8:kworker.0 00000100:00080000:3.0:1787787535.723481:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870c580d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787787535.723485:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787787535.723488:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4899a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503797504:0@lo:8:kworker.0 00000100:00080000:3.0:1787787535.723674:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787535.723679:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787787535.723681:0:36:0:(import.c:65:import_set_state_nolock()) ffff987101e32800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787787535.723686:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 665 00000100:00080000:3.0:1787787535.723690:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787787535.723696:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff987101e32800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:3.0:1787787535.723718:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870ed926580 x1874630503808128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787787535.723733:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787535.723736:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787787535.723738:0:36:0:(import.c:65:import_set_state_nolock()) ffff9870c580d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787787535.723740:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 665 00000100:00080000:3.0:1787787535.723743:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787787535.723746:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9870c580d800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:3.0:1787787535.723757:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870ed927480 x1874630503808256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787787535.723800:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787535.723803:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787787535.723805:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787535.723808:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787787535.723835:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed925e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503808000:0@lo:400:kworker.0 00000100:00100000:3.0:1787787535.723868:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787535.723891:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787787535.723895:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874630503808640:0@lo:400:kworker.0 00000100:00100000:3.0:1787787535.723918:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787535.723952:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed924f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503808384:0@lo:400:kworker.0 00000100:00100000:3.0:1787787535.723975:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787535.723993:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787787535.723998:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503808512:0@lo:400:kworker.0 00000100:00100000:3.0:1787787535.724031:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787535.724066:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503808000 00000100:00100000:3.0:1787787535.724072:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503808000 00000100:00100000:3.0:1787787535.724106:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503808512 00000100:00100000:3.0:1787787535.724108:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503808512 00000100:00100000:3.0:1787787535.724123:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787787535.724131:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503808000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787535.724199:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503808000:12345-0@lo:400:kworker.0 Request processed in 68us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787535.724206:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787787535.724219:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787787535.724233:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503808512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787535.724266:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503808512:12345-0@lo:400:kworker.0 Request processed in 34us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787535.724271:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787787535.725425:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503807872 00000100:00100000:1.0:1787787535.725435:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503807872 00000100:00100000:1.0:1787787535.725480:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787787535.725489:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+20:24215:x1874630503807872:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787535.725642:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+20:24215:x1874630503807872:12345-0@lo:502:mount.lustre.0 Request processed in 153us (2418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787535.725650:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787787535.725861:0:24215:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503807872:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787787535.726084:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1787787535.726115:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1787787535.726131:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1787787535.726176:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1787787535.726191:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1787787535.726206:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1787787535.726219:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1787787535.726231:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1787787535.726259:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000100:00100000:3.0:1787787535.726395:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503808640 00000100:00100000:3.0:1787787535.726400:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503808640 00000100:00100000:3.0:1787787535.726422:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503808384 00000100:00100000:3.0:1787787535.726425:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503808384 00000100:00100000:3.0:1787787535.726439:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787787535.726446:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874630503808640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787535.726488:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874630503808640:12345-0@lo:400:kworker.0 Request processed in 43us (2569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787535.726495:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787787535.726507:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787787535.726513:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503808384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787535.726777:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503808384:12345-0@lo:400:kworker.0 Request processed in 264us (2800us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787535.726784:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787787535.726831:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503808512:0@lo:400:kworker.0 00010000:00080000:3.0:1787787535.726845:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9870ed924f00 x1874630503808384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787535.726856:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed924f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503808384:0@lo:400:kworker.0 00010000:00080000:3.0:1787787535.726887:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff986fc36eb0c0 x1874630503808640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787535.726897:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874630503808640:0@lo:400:kworker.0 00000100:00100000:3.0:1787787535.726920:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed925e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503808000:0@lo:400:kworker.0 00000100:00100000:3.0:1787787535.726944:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed926580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503808128:0@lo:8:kworker.0 00000100:00100000:3.0:1787787535.726977:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787535.727029:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503808256:0@lo:8:kworker.0 00000100:00100000:2.0:1787787535.727176:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503808128 00000100:00100000:2.0:1787787535.727181:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503808128 00000100:00100000:2.0:1787787535.727203:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787787535.727209:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3652:x1874630503808128:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787787535.727255:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3652:x1874630503808128:12345-0@lo:8:kworker.0 Request processed in 45us (277us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787787535.727261:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:0.0:1787787535.727389:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1787787535.727422:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1787787535.727453:0:24215:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503808768:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787787535.727497:0:24215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787535.727518:0:24215:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc10cac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787787535.727628:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503808768 00000100:00100000:1.0:1787787535.727632:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503808768 00000100:00100000:1.0:1787787535.727663:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787787535.727670:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+20:24215:x1874630503808768:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787535.727755:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+20:24215:x1874630503808768:12345-0@lo:502:mount.lustre.0 Request processed in 85us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787535.727762:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787787535.728168:0:24215:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f9680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503808768:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787787535.728223:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1787787535.728233:0:24215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000100:00100000:3.0:1787787535.728368:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787535.728416:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787787535.728423:0:3652:0:(import.c:65:import_set_state_nolock()) ffff987101e32800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787787535.728427:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787787535.728431:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed926580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503808128:0@lo:8:kworker.0 00000100:00100000:2.0:1787787535.728791:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503808256 00000100:00100000:2.0:1787787535.728798:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503808256 00000100:00100000:2.0:1787787535.729402:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787787535.729410:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3652:x1874630503808256:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787787535.729440:0:24221:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:01000000:3.0:1787787535.734896:0:24236:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787535.734909:0:24236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787535.734911:0:24236:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787787535.734919:0:24236:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9870c3570000 00000020:00000080:3.0:1787787535.734923:0:24236:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787787535.734930:0:24236:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787535.734933:0:24236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787535.734934:0:24236:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787787535.734937:0:24236:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787535.734939:0:24236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787535.734941:0:24236:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787787535.734945:0:24236:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9870c3570000 00000020:00000080:3.0:1787787535.734947:0:24236:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787787535.735014:0:24236:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787535.736607:0:24236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787535.736614:0:24236:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787787535.736622:0:24236:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787535.736627:0:24236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787535.736628:0:24236:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787787535.736633:0:24236:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9870c3570000 00000020:00000080:3.0:1787787535.736642:0:24236:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787787535.736684:0:24236:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787535.747662:0:24236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787535.747669:0:24236:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787787535.747681:0:24236:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787535.747688:0:24236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787535.747689:0:24236:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787787535.747694:0:24236:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9870c3570000 00000020:00000080:3.0:1787787535.747697:0:24236:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787787535.747777:0:24236:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787535.747780:0:24236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787535.747782:0:24236:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787787535.747785:0:24236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1787787535.751040:0:24215:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787787535.751092:0:24215:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787787535.751115:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f6659800/0x11620bc3f30aa988 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa98f expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787535.751129:0:24215:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870f6659800/0x11620bc3f30aa988 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa98f expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787535.751259:0:24215:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787787535.751263:0:24215:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9870c3570000 10000000:01000000:1.0:1787787535.751266:0:24215:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9870c3570000 10000000:01000000:1.0:1787787535.751271:0:24215:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787787535.751276:0:24215:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9870c3570000 from 1 10000000:01000000:1.0:1787787535.751279:0:24215:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787787535.751320:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e0e00/0x11620bc3f30aa996 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787535.751327:0:24215:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff986fc43e0e00/0x11620bc3f30aa996 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787535.751338:0:24215:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff986fc43e0e00/0x11620bc3f30aa996 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787535.751371:0:24215:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503808896:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787787535.751577:0:24215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787535.751613:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503808896 00000100:00100000:1.0:1787787535.751620:0:24215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0e566c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787535.751621:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503808896 00000100:00100000:0.0:1787787535.751671:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787787535.751680:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+20:24215:x1874630503808896:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787787535.751693:0:22708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787535.756810:0:22708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870f6659a00/0x11620bc3f30aa99d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa996 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787535.756863:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870f6659a00/0x11620bc3f30aa99d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa996 expref: 21 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787535.756878:0:22708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870f6659a00/0x11620bc3f30aa99d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa996 expref: 21 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787535.756888:0:22708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f6659a00, rc 0) 00000100:00100000:1.0:1787787535.757816:0:24215:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503808896:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787787535.757817:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:24215:x1874630503808896:12345-0@lo:101:mount.lustre.0 Request processed in 6132us (6236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787535.757833:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:1.0:1787787535.758070:0:24215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff986fc43e0e00/0x11620bc3f30aa996 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa99d expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787535.758082:0:24215:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff986fc43e0e00/0x11620bc3f30aa996 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa99d expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787787535.763503:0:24215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1787787535.763790:0:24215:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787787535.766181:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1787787535.766236:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1787787535.766255:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1787787535.766271:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1787787535.766285:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1787787535.766297:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1787787535.766309:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1787787535.766321:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1787787535.766335:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1787787535.766350:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1787787535.766366:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1787787535.766380:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1787787535.766392:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1787787535.766406:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1787787535.766420:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1787787535.766435:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1787787535.766467:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1787787535.766488:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1787787535.766502:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1787787535.766515:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1787787535.766530:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1787787535.766546:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1787787535.766565:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1787787535.766580:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1787787535.766599:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1787787535.766615:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1787787535.766631:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1787787535.766648:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1787787535.766666:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1787787535.766688:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1787787535.766705:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1787787535.766717:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1787787535.766744:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1787787535.766769:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1787787535.766796:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1787787535.766812:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1787787535.766829:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1787787535.767124:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1787787535.767167:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1787787535.767181:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1787787535.767194:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1787787535.767206:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1787787535.767220:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1787787535.767232:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1787787535.767245:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1787787535.767260:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1787787535.767279:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1787787535.767294:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1787787535.767468:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1787787535.767490:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1787787535.767511:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1787787535.767517:0:24215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1787787535.767637:0:24215:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503809024:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787535.767706:0:24215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787535.767760:0:24215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d4cf9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787787535.767761:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503809024 00000100:00100000:0.0:1787787535.767770:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503809024 00000100:00100000:0.0:1787787535.767824:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787787535.767833:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:24215:x1874630503809024:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787787535.767959:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:24215:x1874630503809024:12345-0@lo:501:mount.lustre.0 Request processed in 127us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787535.767967:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787787535.768737:0:24215:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503809024:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787535.768779:0:24215:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503809152:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787535.769311:0:24215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787535.769368:0:24215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d4cf9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787787535.770359:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503809152 00000100:00100000:1.0:1787787535.770372:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503809152 00000100:00100000:1.0:1787787535.770435:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787787535.770444:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:24215:x1874630503809152:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787535.770599:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:24215:x1874630503809152:12345-0@lo:503:mount.lustre.0 Request processed in 155us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787535.770607:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787787535.770664:0:24215:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503809152:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787787535.771134:0:24215:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787787535.771228:0:24215:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503809280:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787535.771277:0:24215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787535.771307:0:24215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0bd2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787535.771489:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503809280 00000100:00100000:0.0:1787787535.771502:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503809280 00000100:00100000:0.0:1787787535.771541:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787787535.771550:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:24215:x1874630503809280:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787787535.771795:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:24215:x1874630503809280:12345-0@lo:502:mount.lustre.0 Request processed in 245us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787535.771802:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787787535.771931:0:24215:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503809280:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787787535.772158:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1787787535.772191:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1787787535.772207:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1787787535.772222:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1787787535.772235:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1787787535.772253:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1787787535.772269:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1787787535.772285:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1787787535.772299:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1787787535.772314:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1787787535.772345:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1787787535.772364:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1787787535.772380:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1787787535.772394:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1787787535.772939:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1787787535.772972:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1787787535.772994:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1787787535.773027:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000100:00100000:2.0:1787787535.773030:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3652:x1874630503808256:12345-0@lo:8:kworker.0 Request processed in 43616us (45973us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787787535.773042:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000040:00080000:1.0:1787787535.773570:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1787787535.773605:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1787787535.773621:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1787787535.773636:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1787787535.773653:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1787787535.773670:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000100:00080000:2.0:1787787535.773676:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870c580d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787787535.773684:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787787535.773689:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503808256:0@lo:8:kworker.0 00000040:00080000:1.0:1787787535.773690:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1787787535.773706:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1787787535.773736:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1787787535.773754:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1787787535.773773:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1787787535.773794:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1787787535.773810:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1787787535.773829:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1787787535.774526:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1787787535.774545:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1787787535.774560:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1787787535.774579:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1787787535.774598:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1787787535.774613:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1787787535.774625:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1787787535.774639:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1787787535.774652:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1787787535.774666:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1787787535.774698:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1787787535.774715:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1787787535.774729:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1787787535.774746:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1787787535.774765:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1787787535.774787:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1787787535.775516:0:24215:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503809408:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787535.775601:0:24215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787535.775699:0:24215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0bd2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787787535.778950:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503809408 00000100:00100000:0.0:1787787535.778964:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503809408 00000100:00100000:0.0:1787787535.779069:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787787535.779080:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:24215:x1874630503809408:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787787535.779268:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:24215:x1874630503809408:12345-0@lo:502:mount.lustre.0 Request processed in 189us (3666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787535.779277:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787787535.779379:0:24215:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503809408:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787787535.779859:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1787787535.779893:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1787787535.779932:0:24215:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503809536:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787787535.779984:0:24215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787535.783856:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503809536 00000100:00100000:1.0:1787787535.783873:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503809536 00000100:00100000:1.0:1787787535.783936:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787787535.783947:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:24215:x1874630503809536:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787535.784647:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:24215:x1874630503809536:12345-0@lo:502:mount.lustre.0 Request processed in 223us (4184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787535.784659:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787787535.784829:0:24215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e08320c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787535.784854:0:24215:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503809536:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787787535.784938:0:24215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1787787535.784953:0:24215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787787535.787047:0:24242:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787787535.787066:0:24242:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9870d15599b8) 00000020:00000080:0.0:1787787535.787089:0:24242:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1787787535.787215:0:24242:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9870c3570000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787787535.787220:0:24242:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9870c3570000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787787535.787223:0:24242:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9870c3570000 3 00010000:00010000:2.0:1787787535.787244:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1787787535.787258:0:24242:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9870d4e00800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.131@tcp at head 00010000:00010000:1.0:1787787535.795384:0:24242:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1787787535.795623:0:24242:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787787535.795668:0:24242:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787787535.795680:0:24242:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x11620bc3f30aa9ab 00000100:00080000:1.0:1787787535.795692:0:24242:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787787535.795699:0:24242:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9870d4e00800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:1.0:1787787535.795735:0:24242:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc48983c0 x1874630503809664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787787535.795765:0:24242:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787787535.795817:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc48983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1874630503809664:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787787535.795907:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787787535.796075:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787535.796080:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787787535.796083:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787535.796085:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:2.0:1787787535.796264:0:24242:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787787535.796288:0:24242:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff986fc10c3370) 00000020:00000080:2.0:1787787535.796306:0:24242:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1787787535.796431:0:24242:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9870c3570000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787787535.796436:0:24242:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9870c3570000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787787535.796439:0:24242:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9870c3570000 3 00010000:00080000:2.0:1787787535.796480:0:24242:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9870d2370800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.131@tcp at head 00000100:00100000:3.0:1787787535.801243:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503809664 00000100:00100000:3.0:1787787535.801259:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503809664 00000100:00100000:3.0:1787787535.801307:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787787535.801316:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc24b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3652:x1874630503809664:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787787535.801346:0:22715:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 679 last 0 00000020:00000080:3.0:1787787535.801382:0:22715:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x11620bc3f30aa9b9 00000004:00100000:3.0:1787787535.801411:0:22715:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787787535.801455:0:22715:0:(import.c:65:import_set_state_nolock()) ffff986fc3a41800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787787535.801691:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc24b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1874630503809664:12345-0@lo:38:llog_process_th.0 Request processed in 249us (5658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787535.801700:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787787535.802823:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc48983c0 x1874630503809664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787787545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787535.802837:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787787535.802847:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1787787535.802857:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787787535.802864:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787787535.802867:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870d4e00800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787787535.802882:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc48983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3652:1874630503809664:0@lo:38:llog_process_th.0 00010000:00010000:3.0:1787787535.804043:0:24242:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1787787535.804694:0:24242:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1787787535.804744:0:24242:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787787535.804757:0:24242:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x11620bc3f30aa9c0 00000100:00080000:2.0:1787787535.804766:0:24242:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787787535.804772:0:24242:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9870d2370800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:2.0:1787787535.804811:0:24242:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc24b4b40 x1874630503809792/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787787535.805499:0:24242:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1787787535.806222:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3652:1874630503809792:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787787535.806299:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787535.808222:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503809792 00000100:00100000:2.0:1787787535.808236:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503809792 00000100:00100000:2.0:1787787535.808279:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787787535.808286:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3652:x1874630503809792:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787787535.808317:0:22714:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 679 last 0 00000020:00000080:2.0:1787787535.808351:0:22714:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x11620bc3f30aa9c7 00000004:00100000:2.0:1787787535.808366:0:22714:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787787535.808398:0:22714:0:(import.c:65:import_set_state_nolock()) ffff9870d2373800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787535.808486:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874630503809792:12345-0@lo:38:llog_process_th.0 Request processed in 199us (2188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787535.808493:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787787535.808568:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc24b4b40 x1874630503809792/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787787545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787535.808580:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787787535.808589:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1787787535.808597:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787787535.808601:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787787535.808604:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870d2370800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787787535.808609:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3652:1874630503809792:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787787535.809512:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787535.809520:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787787535.809523:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787535.809526:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1787787535.809788:0:24242:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1787787535.809986:0:24215:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787787535.810033:0:24215:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787787535.810051:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e0e00/0x11620bc3f30aa996 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa99d expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787535.810063:0:24215:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff986fc43e0e00/0x11620bc3f30aa996 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa99d expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787787535.810113:0:24215:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787787535.810115:0:24215:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787787535.810117:0:24215:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787787535.810118:0:24215:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787787535.810120:0:24215:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787787535.810121:0:24215:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787787535.810123:0:24215:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787787535.810125:0:24215:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787787535.810126:0:24215:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787787535.810130:0:24215:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1787787535.810133:0:24215:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787787535.810134:0:24215:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787787535.810135:0:24215:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787787535.810155:0:24215:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787787535.810156:0:24215:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787787535.810157:0:24215:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787787535.810158:0:24215:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787787535.810159:0:24215:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787787535.810160:0:24215:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787787535.810184:0:24215:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787787535.810202:0:24215:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503809920:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787787535.810264:0:24215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787535.810307:0:24215:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0832000 going to sleep for 11 seconds 00000100:00100000:0.0:1787787535.812050:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503809920 00000100:00100000:0.0:1787787535.812063:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503809920 00000100:00100000:0.0:1787787535.812120:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787787535.812129:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:24215:x1874630503809920:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787787535.812174:0:22706:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787787535.812187:0:22706:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787787535.824272:0:22706:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787787535.824296:0:22706:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787787535.824348:0:22730:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787787535.824354:0:22730:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787787535.824376:0:22730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff986fc43e1000/0x11620bc3f30aa9ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787535.824396:0:22730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870f6658000/0x11620bc3f30aa918 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa911 expref: 21 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787535.824405:0:22730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aa926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa91f expref: 21 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787535.824413:0:22730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff986fc43e1000/0x11620bc3f30aa9ce lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787535.824470:0:22730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aa926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30aa91f expref: 21 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787535.824485:0:22730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aa926 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30aa91f expref: 21 pid: 22706 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787535.824500:0:22730:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489a940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22730:1874630503810048:0@lo:104: 00000100:00100000:1.0:1787787535.824584:0:22730:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787787535.824642:0:22730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870f6658000/0x11620bc3f30aa918 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30aa911 expref: 21 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787535.824650:0:22730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9870f6658000/0x11620bc3f30aa918 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30aa911 expref: 21 pid: 22707 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787535.824659:0:22730:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc48983c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22730:1874630503810176:0@lo:104: 00000100:00100000:0.0:1787787535.826321:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:24215:x1874630503809920:12345-0@lo:253:mount.lustre.0 Request processed in 14184us (16048us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787535.826334:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787787535.826395:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503810048 00000100:00100000:0.0:1787787535.826403:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503810048 00000100:00100000:0.0:1787787535.826441:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787787535.826449:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4899e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3fd2c107-7647-408e-8048-4ef16ee44cbc+3:22730:x1874630503810048:12345-0@lo:104: 00010000:00010000:0.0:1787787535.826778:0:22698:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30aa91f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa926 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787535.826846:0:22698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787787535.826853:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4899e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3fd2c107-7647-408e-8048-4ef16ee44cbc+3:22730:x1874630503810048:12345-0@lo:104: Request processed in 405us (2270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787535.826859:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787787535.826965:0:24215:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:24215:1874630503809920:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787787535.826979:0:24215:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787787535.826983:0:24215:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787787535.826984:0:24215:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787787535.826986:0:24215:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787535.826987:0:24215:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787535.826989:0:24215:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787535.826990:0:24215:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787535.826991:0:24215:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787787535.826994:0:24215:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787535.826995:0:24215:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787787535.827025:0:24215:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1787787535.831200:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787535.831215:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30aa91f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa926 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787535.831227:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f4800 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:3.0:1787787535.831232:0:22703:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30aa91f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30aa926 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787535.831242:0:22703:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30aa91f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30aa926 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787535.831248:0:22703:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30aa91f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30aa926 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787535.831254:0:22703:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787787535.831314:0:22703:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30aa91f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa926 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787535.831321:0:22703:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787787535.831352:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30aa91f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa926 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787535.831359:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30aa91f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa926 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787535.831372:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787535.831374:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787535.831376:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787535.831504:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3fd2c107-7647-408e-8048-4ef16ee44cbc:3656:1874630503810304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787787535.831574:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787535.831648:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503810304 00000100:00100000:3.0:1787787535.831657:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503810304 00010000:00010000:3.0:1787787535.831685:0:22701:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aa926 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa91f expref: 21 pid: 22706 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787535.831716:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787787535.831727:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:3656:x1874630503810304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787787535.831740:0:22701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787535.831746:0:22701:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aa926 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa91f expref: 21 pid: 22706 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787535.831759:0:22701:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aa926 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30aa91f expref: 21 pid: 22706 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787535.831778:0:22701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787535.832012:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:3656:x1874630503810304:12345-0@lo:103:ldlm_bl.0 Request processed in 276us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787535.832021:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787787535.832070:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3fd2c107-7647-408e-8048-4ef16ee44cbc:3656:1874630503810304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787535.833510:0:22730:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787535.834393:0:22730:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e0920cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1787787535.834423:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aa926 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30aa91f expref: 20 pid: 22706 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787535.834437:0:22730:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489a940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22730:1874630503810048:0@lo:104: 00000001:00000004:3.0:1787787535.835066:0:24215:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:0.0:1787787535.835110:0:22698:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787787535.835127:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503810176 00000100:00100000:0.0:1787787535.835134:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503810176 00000100:00100000:0.0:1787787535.835192:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787787535.835203:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6602c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3fd2c107-7647-408e-8048-4ef16ee44cbc+3:22730:x1874630503810176:12345-0@lo:104: 00010000:00010000:0.0:1787787535.835219:0:22698:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff986fc43e0200/0x11620bc3f30aa911 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa918 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787535.835345:0:22698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787787535.835352:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6602c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3fd2c107-7647-408e-8048-4ef16ee44cbc+3:22730:x1874630503810176:12345-0@lo:104: Request processed in 152us (1846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787535.835361:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787787535.835483:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787535.835489:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff986fc43e0200/0x11620bc3f30aa911 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa918 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787535.835499:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc43e0200 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:3.0:1787787535.835503:0:22702:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff986fc43e0200/0x11620bc3f30aa911 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30aa918 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787535.835512:0:22702:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff986fc43e0200/0x11620bc3f30aa911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30aa918 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787535.835518:0:22702:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff986fc43e0200/0x11620bc3f30aa911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30aa918 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787535.835524:0:22702:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787787535.835567:0:22702:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff986fc43e0200/0x11620bc3f30aa911 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa918 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787535.835574:0:22702:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787787535.835595:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff986fc43e0200/0x11620bc3f30aa911 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa918 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787535.835602:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff986fc43e0200/0x11620bc3f30aa911 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa918 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787535.835619:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787535.835620:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787535.835622:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787535.835635:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3fd2c107-7647-408e-8048-4ef16ee44cbc:3653:1874630503810432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787787535.835682:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787535.835733:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503810432 00000100:00100000:3.0:1787787535.835737:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503810432 00010000:00010000:3.0:1787787535.835755:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870f6658000/0x11620bc3f30aa918 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa911 expref: 20 pid: 22707 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787535.835778:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787787535.835784:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13f4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2c107-7647-408e-8048-4ef16ee44cbc+20:3653:x1874630503810432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787787535.835809:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787535.835815:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870f6658000/0x11620bc3f30aa918 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa911 expref: 20 pid: 22707 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787535.835826:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870f6658000/0x11620bc3f30aa918 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30aa911 expref: 20 pid: 22707 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787535.836092:0:22699:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff986fc43e1000/0x11620bc3f30aa9ce lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787535.836104:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc43e1000/0x11620bc3f30aa9ce lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787787535.836122:0:22699:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011767675s 00010000:00010000:3.0:1787787535.836127:0:22699:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff986fc43e1000/0x11620bc3f30aa9ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787535.836135:0:22699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff986fc43e1000/0x11620bc3f30aa9ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787535.836182:0:22699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff986fc43e1000/0x11620bc3f30aa9ce lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787535.836200:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff986fc43e1000/0x11620bc3f30aa9ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787535.836207:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc43e1000 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787535.836211:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff986fc43e1000/0x11620bc3f30aa9ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787535.836219:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff986fc43e1000/0x11620bc3f30aa9ce lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787535.836231:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff986fc43e1000/0x11620bc3f30aa9ce lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787535.836244:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787535.836286:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13f4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2c107-7647-408e-8048-4ef16ee44cbc+20:3653:x1874630503810432:12345-0@lo:103:ldlm_bl.0 Request processed in 502us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787535.836294:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787787535.836365:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3fd2c107-7647-408e-8048-4ef16ee44cbc:3653:1874630503810432:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787535.838860:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870f6658000/0x11620bc3f30aa918 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30aa911 expref: 19 pid: 22707 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787535.838885:0:22730:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc48983c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22730:1874630503810176:0@lo:104: 00010000:00010000:2.0:1787787535.838912:0:22730:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff986fc43e1000/0x11620bc3f30aa9ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787535.838955:0:22730:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff986fc43e1000/0x11620bc3f30aa9ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787535.838962:0:22730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff986fc43e1000/0x11620bc3f30aa9ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787535.838968:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc43e1000/0x11620bc3f30aa9ce lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1787787535.839554:0:24215:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787787535.839560:0:24215:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787787535.839598:0:24215:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787787535.839637:0:24215:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.131@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787787535.839656:0:24215:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787787535.839675:0:24215:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1787787535.840511:0:24215:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787787535.840775:0:24215:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1787787536.708132:0:24297:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787787536.708503:0:24297:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787787536.813875:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787787537.001903:0:22711:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787787537.001913:0:22711:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9870f576f800 from 13 10000000:01000000:0.0:1787787537.001918:0:22711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787787537.001973:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f6658600/0x11620bc3f30aa9d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787537.001994:0:22711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870f6658600/0x11620bc3f30aa9d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787537.002006:0:22711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870f6658600/0x11620bc3f30aa9d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787537.002049:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fa1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503810560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787787537.002127:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787537.002212:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d16f19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787537.003214:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503810560 00000100:00100000:2.0:1787787537.003225:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503810560 00000100:00100000:2.0:1787787537.003279:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787787537.003290:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c6c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+19:22711:x1874630503810560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787537.003304:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787537.003322:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff987101ee3000/0x11620bc3f30aa9dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa9d5 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787537.003348:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff987101ee3000/0x11620bc3f30aa9dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa9d5 expref: 20 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787537.003358:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff987101ee3000/0x11620bc3f30aa9dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa9d5 expref: 20 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787537.003384:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3000, rc 0) 00000100:00100000:2.0:1787787537.003451:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c6c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+20:22711:x1874630503810560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787537.003458:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787787537.003842:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fa1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503810560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787537.003861:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870f6658600/0x11620bc3f30aa9d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa9dc expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787537.003871:0:22711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870f6658600/0x11620bc3f30aa9d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa9dc expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787537.003932:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fa1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503810688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787787537.003972:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787537.004016:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d16f19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787537.004072:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503810688 00000100:00100000:1.0:1787787537.004078:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503810688 00000100:00100000:1.0:1787787537.004113:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787787537.004120:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c6c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+20:22711:x1874630503810688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787787537.004134:0:22706:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787787537.004190:0:22706:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787787537.004193:0:22706:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1787787537.004267:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c6c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+20:22711:x1874630503810688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 146us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787537.004274:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787787537.004421:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fa1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503810688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787787537.004479:0:22711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787787537.004486:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f6658600/0x11620bc3f30aa9d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa9dc expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787537.004495:0:22711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870f6658600/0x11620bc3f30aa9d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa9dc expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787537.004505:0:22711:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787787537.004508:0:22711:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff986fc2938000 from 13 10000000:01000000:0.0:1787787537.004510:0:22711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787787537.004530:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f6659000/0x11620bc3f30aa9e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787537.004546:0:22711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870f6659000/0x11620bc3f30aa9e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787537.004555:0:22711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870f6659000/0x11620bc3f30aa9e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787537.004568:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fa1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503810816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787787537.004595:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787537.004621:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d16f19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787537.004837:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503810816 00000100:00100000:2.0:1787787537.004843:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503810816 00000100:00100000:2.0:1787787537.004880:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787787537.004888:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c6c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+20:22711:x1874630503810816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787537.004896:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787537.004907:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aa9ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aa9e3 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787537.004924:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aa9ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aa9e3 expref: 21 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787537.004933:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aa9ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa9e3 expref: 21 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787537.004940:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2a00, rc 0) 00000100:00100000:2.0:1787787537.004991:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c6c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:22711:x1874630503810816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787537.004998:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787787537.005041:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fa1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503810816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787537.005053:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870f6659000/0x11620bc3f30aa9e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa9ea expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787537.005060:0:22711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870f6659000/0x11620bc3f30aa9e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aa9ea expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787537.005254:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503810944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787787537.005294:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787537.005310:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c3eaf780 going to sleep for 11 seconds 00000100:00100000:2.0:1787787537.005488:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503810944 00000100:00100000:2.0:1787787537.005493:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503810944 00000100:00100000:2.0:1787787537.005523:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787787537.005531:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:22711:x1874630503810944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787787537.005543:0:22707:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787787537.005564:0:22707:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787787537.005567:0:22707:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1787787537.005646:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:22711:x1874630503810944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787537.005653:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787787537.005847:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503810944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787787537.005898:0:22711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787787537.005905:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870f6659000/0x11620bc3f30aa9e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa9ea expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787537.005913:0:22711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870f6659000/0x11620bc3f30aa9e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa9ea expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787537.769472:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787537.770222:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4898b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503811200:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787787537.770289:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787537.770350:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503811200 00000100:00100000:1.0:1787787537.770357:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503811200 00000100:00100000:1.0:1787787537.770403:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787787537.770411:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4898780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503811200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787787537.770444:0:23456:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787787537.770486:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4898780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503811200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787537.770492:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787787537.770536:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4898b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503811200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787787537.771011:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4899a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503811072:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787537.771051:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787537.777380:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503811072 00000100:00100000:3.0:1787787537.777393:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503811072 00000100:00100000:3.0:1787787537.777439:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787787537.777449:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503811072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787787537.777484:0:22720:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787787537.777567:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503811072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (6515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787537.777574:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787787537.777633:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4899a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503811072:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787787537.835363:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787538.859757:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787539.882161:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787787540.841623:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787540.841630:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787787540.841634:0:8:0:(import.c:65:import_set_state_nolock()) ffff987101e32800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787787540.841647:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff987101e32800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:2.0:1787787540.841669:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc24b5e00 x1874630503811584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787787540.841685:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787540.841688:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787787540.841690:0:8:0:(import.c:65:import_set_state_nolock()) ffff9870c580d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787787540.841694:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 679 00000100:00080000:2.0:1787787540.841698:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787787540.841701:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9870c580d800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:2.0:1787787540.841712:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc24b6580 x1874630503811712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787787540.841733:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787540.841736:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787787540.841739:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787540.841742:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787787540.841784:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503811456:0@lo:400:kworker.0 00000100:00100000:2.0:1787787540.841872:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787540.841933:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503812224:0@lo:400:kworker.0 00000100:00100000:2.0:1787787540.841961:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787540.841988:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787787540.841994:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503811840:0@lo:400:kworker.0 00000100:00100000:2.0:1787787540.842014:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787540.842028:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503812352:0@lo:400:kworker.0 00000100:00100000:2.0:1787787540.842051:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787540.842085:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503812224 00000100:00100000:2.0:1787787540.842091:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503812224 00000100:00100000:2.0:1787787540.842163:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503811840 00000100:00100000:2.0:1787787540.842167:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503811840 00000100:00100000:2.0:1787787540.842179:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503812352 00000100:00100000:2.0:1787787540.842181:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503812352 00000100:00100000:2.0:1787787540.842199:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787787540.842207:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874630503812224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787540.842252:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874630503812224:12345-0@lo:400:kworker.0 Request processed in 46us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787540.842260:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787787540.842276:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787787540.842283:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503811840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787540.842307:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503811840:12345-0@lo:400:kworker.0 Request processed in 26us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787540.842313:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787787540.842324:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787787540.842329:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503812352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787540.842336:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503811968:0@lo:400:kworker.0 00000100:00100000:0.0:1787787540.842363:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787540.842364:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503812352:12345-0@lo:400:kworker.0 Request processed in 36us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787540.842370:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787787540.842383:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787787540.842389:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3fd2c107-7647-408e-8048-4ef16ee44cbc:3655:1874630503811328:0@lo:400:kworker.0 00010000:00080000:2.0:1787787540.842405:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc24b52c0 x1874630503811840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787540.842413:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787540.842418:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503811840:0@lo:400:kworker.0 00010000:00080000:2.0:1787787540.842428:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc24b6940 x1874630503812352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787540.842433:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503812096:0@lo:400:kworker.0 00000100:00100000:2.0:1787787540.842436:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503812352:0@lo:400:kworker.0 00010000:00080000:2.0:1787787540.842445:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc24b70c0 x1874630503812224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787540.842452:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787540.842453:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503812224:0@lo:400:kworker.0 00000100:00100000:0.0:1787787540.842476:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503811584:0@lo:8:kworker.0 00000100:00100000:0.0:1787787540.842498:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787540.842527:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503811712:0@lo:8:kworker.0 00000100:00100000:0.0:1787787540.842546:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787540.842577:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503812096 00000100:00100000:0.0:1787787540.842581:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503812096 00000100:00100000:0.0:1787787540.842613:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787787540.842618:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503812096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787540.842652:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503812096:12345-0@lo:400:kworker.0 Request processed in 34us (199us total) trans 0 rc 0/0 00000100:00080000:3.0:1787787540.842654:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787787540.842658:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787540.842658:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787787540.842675:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503811456 00000100:00100000:0.0:1787787540.842678:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503811456 00000100:00100000:0.0:1787787540.842698:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503811968 00000100:00100000:0.0:1787787540.842709:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503811968 00000100:00100000:0.0:1787787540.842722:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787787540.842728:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc24b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503811456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787540.842762:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc24b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503811456:12345-0@lo:400:kworker.0 Request processed in 34us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787540.842768:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787787540.842779:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787787540.842784:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503811968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787540.842807:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503811968:12345-0@lo:400:kworker.0 Request processed in 23us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787540.842813:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787787540.842828:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503811328 00000100:00100000:0.0:1787787540.842831:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503811328 00000100:00100000:0.0:1787787540.842852:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787787540.842858:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:3655:x1874630503811328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787540.842882:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:3655:x1874630503811328:12345-0@lo:400:kworker.0 Request processed in 24us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787540.842887:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787787540.842924:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503811584 00000100:00100000:0.0:1787787540.842932:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503811584 00000100:00100000:0.0:1787787540.842951:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503811712 00000100:00100000:0.0:1787787540.842953:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503811712 00000100:00100000:0.0:1787787540.842962:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787787540.842966:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3652:x1874630503811584:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787787540.842988:0:24219:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 685 last 0 00000020:00000080:0.0:1787787540.843014:0:24219:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x11620bc3f30aa9f1 00002000:00100000:0.0:1787787540.843027:0:24219:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff986fc43bc000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113934 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787787540.843032:0:24219:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787787540.843034:0:24219:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787787540.843215:0:24219:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787787540.843237:0:24219:0:(import.c:65:import_set_state_nolock()) ffff986fc43bb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787787540.843274:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3652:x1874630503811584:12345-0@lo:8:kworker.0 Request processed in 306us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787540.843280:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787787540.843293:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787787540.843297:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3652:x1874630503811712:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787787540.843308:0:24219:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787787540.843329:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3652:x1874630503811712:12345-0@lo:8:kworker.0 Request processed in 31us (782us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787787540.843335:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787787540.843371:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc24b5e00 x1874630503811584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787787560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787787540.843384:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1787787540.843391:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787787540.843396:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787787540.843404:0:3652:0:(import.c:65:import_set_state_nolock()) ffff987101e32800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787787540.843415:0:3652:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787787540.843420:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503811584:0@lo:8:kworker.0 00000100:00080000:0.0:1787787540.843432:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870c580d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787787540.843436:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787787540.843439:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503811712:0@lo:8:kworker.0 00000004:00080000:0.0:1787787540.843460:0:22738:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787787540.843520:0:22738:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 685025381177ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787787540.843526:0:22738:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1787787540.843555:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3fd2c107-7647-408e-8048-4ef16ee44cbc:3655:1874630503811328:0@lo:400:kworker.0 00010000:00080000:0.0:1787787540.843566:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc24b4b40 x1874630503812096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787540.843575:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503812096:0@lo:400:kworker.0 00000100:00100000:0.0:1787787540.843587:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503811968:0@lo:400:kworker.0 00000100:00100000:0.0:1787787540.843640:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503811456:0@lo:400:kworker.0 00000004:00080000:2.0:1787787540.844325:0:22739:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:2.0:1787787540.844347:0:22739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418cb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22739:1874630503812608:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787787540.844391:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787540.844411:0:22739:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2ad0900 going to sleep for 11 seconds 00000100:00100000:0.0:1787787540.844757:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503812608 00000100:00100000:0.0:1787787540.844764:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503812608 00000100:00100000:0.0:1787787540.844809:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787787540.844817:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22739:x1874630503812608:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:0.0:1787787540.845009:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787540.845090:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787787540.845103:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503812480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787540.845173:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787540.846304:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503812480 00000100:00100000:2.0:1787787540.846314:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503812480 00000100:00100000:2.0:1787787540.846366:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787787540.846376:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4898b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3656:x1874630503812480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787787540.846402:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1787787540.846470:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4898b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3656:x1874630503812480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787540.846477:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787787540.846664:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc418de00 x1874630503812480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787540.846686:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503812480:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1787787540.848479:0:22694:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:1.0:1787787540.862123:0:24219:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1787787540.862151:0:24219:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1787787540.862160:0:24219:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00002000:00010000:0.0:1787787540.879648:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787540.879663:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052d6ab6f/0x11620bc3f30aa9f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.879685:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1787787540.879706:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787540.879713:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052d6ab6f/0x11620bc3f30aa9f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.879733:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052d6ab6f/0x11620bc3f30aa9f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.879744:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052d6ab6f/0x11620bc3f30aa9f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.879753:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052d6ab6f/0x11620bc3f30aa9f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.879777:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787787540.880380:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787540.880388:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006960dd8/0x11620bc3f30aa9ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.880400:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1787787540.880404:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787540.880409:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006960dd8/0x11620bc3f30aa9ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.880420:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006960dd8/0x11620bc3f30aa9ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.880428:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006960dd8/0x11620bc3f30aa9ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.880443:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006960dd8/0x11620bc3f30aa9ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.880462:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787787540.880474:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787787540.880480:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052d6ab6f/0x11620bc3f30aa9f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.880488:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6658400 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787540.880493:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052d6ab6f/0x11620bc3f30aa9f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.880503:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052d6ab6f/0x11620bc3f30aa9f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.880520:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052d6ab6f/0x11620bc3f30aa9f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.880528:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052d6ab6f/0x11620bc3f30aa9f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.880547:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787540.880551:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006960dd8/0x11620bc3f30aa9ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.880570:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6658200 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787540.880574:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006960dd8/0x11620bc3f30aa9ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.880582:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006960dd8/0x11620bc3f30aa9ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.880593:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006960dd8/0x11620bc3f30aa9ff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.880601:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006960dd8/0x11620bc3f30aa9ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.880613:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787540.880615:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787540.880617:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787540.880865:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787540.881271:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787540.881278:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000011cbd2c/0x11620bc3f30aaa06 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.881288:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1787787540.881292:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787540.881297:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000011cbd2c/0x11620bc3f30aaa06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.881306:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000011cbd2c/0x11620bc3f30aaa06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.881319:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000011cbd2c/0x11620bc3f30aaa06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.881325:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000011cbd2c/0x11620bc3f30aaa06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.881347:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787787540.881728:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787540.881735:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013c90ad3/0x11620bc3f30aaa0d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.881744:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1787787540.881747:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787540.881751:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013c90ad3/0x11620bc3f30aaa0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.881760:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013c90ad3/0x11620bc3f30aaa0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.881768:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013c90ad3/0x11620bc3f30aaa0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.881775:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013c90ad3/0x11620bc3f30aaa0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.881809:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787787540.882054:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787787540.882062:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000011cbd2c/0x11620bc3f30aaa06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.882100:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6659e00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787540.882104:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000011cbd2c/0x11620bc3f30aaa06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.882113:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000011cbd2c/0x11620bc3f30aaa06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.882130:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000011cbd2c/0x11620bc3f30aaa06 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.882155:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000011cbd2c/0x11620bc3f30aaa06 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.882174:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787540.882178:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013c90ad3/0x11620bc3f30aaa0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.882185:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6658000 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787540.882188:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013c90ad3/0x11620bc3f30aaa0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.882196:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013c90ad3/0x11620bc3f30aaa0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.882207:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013c90ad3/0x11620bc3f30aaa0d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.882220:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013c90ad3/0x11620bc3f30aaa0d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.882236:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787540.882238:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787540.882240:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787540.882413:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787540.882420:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000498d4af5/0x11620bc3f30aaa14 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.882429:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1787787540.882433:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787540.882438:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000498d4af5/0x11620bc3f30aaa14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.882448:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000498d4af5/0x11620bc3f30aaa14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.882456:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000498d4af5/0x11620bc3f30aaa14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.882463:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000498d4af5/0x11620bc3f30aaa14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.882485:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787787540.883046:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787540.883053:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000498d4af5/0x11620bc3f30aaa14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.883062:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6659400 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787540.883066:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000498d4af5/0x11620bc3f30aaa14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.883075:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000498d4af5/0x11620bc3f30aaa14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.883098:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000498d4af5/0x11620bc3f30aaa14 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.883105:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000498d4af5/0x11620bc3f30aaa14 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.883122:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787540.883124:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787540.883126:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787540.883264:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787540.883270:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e104546f/0x11620bc3f30aaa1b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.883279:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1787787540.883288:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787540.883293:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e104546f/0x11620bc3f30aaa1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.883303:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e104546f/0x11620bc3f30aaa1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.883311:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e104546f/0x11620bc3f30aaa1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.883319:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e104546f/0x11620bc3f30aaa1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.883338:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787540.883366:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787540.883373:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e104546f/0x11620bc3f30aaa1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787540.883387:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6658c00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787540.883390:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e104546f/0x11620bc3f30aaa1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787540.883398:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e104546f/0x11620bc3f30aaa1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787540.883410:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e104546f/0x11620bc3f30aaa1b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787540.883417:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e104546f/0x11620bc3f30aaa1b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787540.883432:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787540.883434:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787540.883436:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787540.883635:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787540.883700:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787540.883706:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b7f9a4c/0x11620bc3f30aaa22 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.883715:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1787787540.883718:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787540.883722:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b7f9a4c/0x11620bc3f30aaa22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.883731:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b7f9a4c/0x11620bc3f30aaa22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.883740:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b7f9a4c/0x11620bc3f30aaa22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.883754:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b7f9a4c/0x11620bc3f30aaa22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.883773:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787540.883811:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787540.883816:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b7f9a4c/0x11620bc3f30aaa22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787540.883824:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15800 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787540.883827:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b7f9a4c/0x11620bc3f30aaa22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787540.883836:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b7f9a4c/0x11620bc3f30aaa22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787540.883853:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b7f9a4c/0x11620bc3f30aaa22 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787540.883861:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b7f9a4c/0x11620bc3f30aaa22 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787540.883875:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787540.883877:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787540.883878:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787540.884224:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787540.884231:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa7a6457/0x11620bc3f30aaa29 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.884239:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1787787540.884243:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787540.884246:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa7a6457/0x11620bc3f30aaa29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.884255:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa7a6457/0x11620bc3f30aaa29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.884264:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa7a6457/0x11620bc3f30aaa29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.884270:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa7a6457/0x11620bc3f30aaa29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.884321:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787787540.887172:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787540.887186:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5ec3388/0x11620bc3f30aaa30 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.887212:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1787787540.887216:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787540.887222:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5ec3388/0x11620bc3f30aaa30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.887236:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5ec3388/0x11620bc3f30aaa30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.887248:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5ec3388/0x11620bc3f30aaa30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.887254:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5ec3388/0x11620bc3f30aaa30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.893489:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787787540.893515:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa7a6457/0x11620bc3f30aaa29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.893530:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15600 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787540.893535:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa7a6457/0x11620bc3f30aaa29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.893545:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa7a6457/0x11620bc3f30aaa29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.893567:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa7a6457/0x11620bc3f30aaa29 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.893574:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa7a6457/0x11620bc3f30aaa29 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.893603:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787540.893607:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5ec3388/0x11620bc3f30aaa30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.893613:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14e00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787540.893616:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5ec3388/0x11620bc3f30aaa30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.893623:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5ec3388/0x11620bc3f30aaa30 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.893650:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5ec3388/0x11620bc3f30aaa30 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.893657:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787540.893659:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787540.893661:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787540.899619:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787787540.899633:0:24219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5ec3388/0x11620bc3f30aaa30 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.900028:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787540.900365:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787540.900373:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007029aee2/0x11620bc3f30aaa37 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.900387:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1787787540.900392:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787540.900397:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007029aee2/0x11620bc3f30aaa37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.900424:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007029aee2/0x11620bc3f30aaa37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.900433:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007029aee2/0x11620bc3f30aaa37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.900441:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007029aee2/0x11620bc3f30aaa37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.900457:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787787540.900466:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787540.900470:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007029aee2/0x11620bc3f30aaa37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.900477:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14600 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787540.900482:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007029aee2/0x11620bc3f30aaa37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.900491:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007029aee2/0x11620bc3f30aaa37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.901273:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007029aee2/0x11620bc3f30aaa37 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.901284:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007029aee2/0x11620bc3f30aaa37 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.901309:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787540.901312:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787540.901314:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787540.901839:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787540.901846:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e856778a/0x11620bc3f30aaa3e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.901856:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1787787540.901861:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787540.901865:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e856778a/0x11620bc3f30aaa3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.901875:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e856778a/0x11620bc3f30aaa3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.901882:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e856778a/0x11620bc3f30aaa3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.901888:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e856778a/0x11620bc3f30aaa3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.901920:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787787540.902014:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787540.902021:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e856778a/0x11620bc3f30aaa3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.902028:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15000 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787540.902032:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e856778a/0x11620bc3f30aaa3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.902041:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e856778a/0x11620bc3f30aaa3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.902052:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e856778a/0x11620bc3f30aaa3e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.902058:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e856778a/0x11620bc3f30aaa3e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.902072:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787540.902074:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787540.902097:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787540.902618:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787540.902625:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000566542d5/0x11620bc3f30aaa45 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.902645:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1787787540.902649:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787540.902654:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000566542d5/0x11620bc3f30aaa45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.902664:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000566542d5/0x11620bc3f30aaa45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.902672:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000566542d5/0x11620bc3f30aaa45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.902679:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000566542d5/0x11620bc3f30aaa45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.902701:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787787540.902822:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787540.902827:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000566542d5/0x11620bc3f30aaa45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.902835:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14000 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787540.902839:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000566542d5/0x11620bc3f30aaa45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.902846:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000566542d5/0x11620bc3f30aaa45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.902857:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000566542d5/0x11620bc3f30aaa45 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.902864:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000566542d5/0x11620bc3f30aaa45 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.902880:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787540.902881:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787540.902883:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787540.903312:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787540.903318:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ae514c3/0x11620bc3f30aaa4c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.903327:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1787787540.903330:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787540.903334:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ae514c3/0x11620bc3f30aaa4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.903343:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ae514c3/0x11620bc3f30aaa4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.903363:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ae514c3/0x11620bc3f30aaa4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.903369:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ae514c3/0x11620bc3f30aaa4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.903976:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787787540.906355:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787540.906371:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6ff0916/0x11620bc3f30aaa53 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.906387:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1787787540.906392:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787540.906399:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6ff0916/0x11620bc3f30aaa53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.906413:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6ff0916/0x11620bc3f30aaa53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.906423:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6ff0916/0x11620bc3f30aaa53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.906430:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6ff0916/0x11620bc3f30aaa53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.907441:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787787540.907453:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ae514c3/0x11620bc3f30aaa4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.907463:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14200 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787540.907468:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ae514c3/0x11620bc3f30aaa4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.907491:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ae514c3/0x11620bc3f30aaa4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.907760:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ae514c3/0x11620bc3f30aaa4c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.907769:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ae514c3/0x11620bc3f30aaa4c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.908032:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787787540.908046:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787540.908050:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6ff0916/0x11620bc3f30aaa53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.908058:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15a00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787540.908062:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6ff0916/0x11620bc3f30aaa53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.908070:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6ff0916/0x11620bc3f30aaa53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.908341:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6ff0916/0x11620bc3f30aaa53 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.908351:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6ff0916/0x11620bc3f30aaa53 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.908366:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787540.908368:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787540.908370:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787540.910638:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787540.910725:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787540.910736:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5ec3388/0x11620bc3f30aaa5a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.910764:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1787787540.910769:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787540.910776:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5ec3388/0x11620bc3f30aaa5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.910789:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5ec3388/0x11620bc3f30aaa5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.910799:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5ec3388/0x11620bc3f30aaa5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.910806:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5ec3388/0x11620bc3f30aaa5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.910827:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787540.910924:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787540.910931:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5ec3388/0x11620bc3f30aaa5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787540.910939:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14e00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787540.910943:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5ec3388/0x11620bc3f30aaa5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787540.910952:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5ec3388/0x11620bc3f30aaa5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787540.910967:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5ec3388/0x11620bc3f30aaa5a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787540.910974:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5ec3388/0x11620bc3f30aaa5a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787540.911003:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787540.911004:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787540.911006:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787540.911438:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787540.911445:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c847afe1/0x11620bc3f30aaa61 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.911455:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1787787540.911458:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787540.911462:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c847afe1/0x11620bc3f30aaa61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.911471:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c847afe1/0x11620bc3f30aaa61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.911492:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c847afe1/0x11620bc3f30aaa61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.911512:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c847afe1/0x11620bc3f30aaa61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.911531:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787540.911610:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787540.911616:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c847afe1/0x11620bc3f30aaa61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787540.911624:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15400 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787540.911627:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c847afe1/0x11620bc3f30aaa61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787540.911636:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c847afe1/0x11620bc3f30aaa61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787540.911647:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c847afe1/0x11620bc3f30aaa61 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787540.911653:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c847afe1/0x11620bc3f30aaa61 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787540.911668:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787540.911669:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787540.911671:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787540.912066:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787540.912073:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001623d64d/0x11620bc3f30aaa68 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.912095:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1787787540.912099:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787540.912103:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001623d64d/0x11620bc3f30aaa68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.912112:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001623d64d/0x11620bc3f30aaa68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.912119:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001623d64d/0x11620bc3f30aaa68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.912126:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001623d64d/0x11620bc3f30aaa68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.912168:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787787540.912176:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787540.912179:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001623d64d/0x11620bc3f30aaa68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.912186:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14800 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787540.912190:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001623d64d/0x11620bc3f30aaa68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.912198:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001623d64d/0x11620bc3f30aaa68 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.912208:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001623d64d/0x11620bc3f30aaa68 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.912216:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001623d64d/0x11620bc3f30aaa68 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.912230:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787540.912232:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787540.912233:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787540.915378:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787540.915393:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017c7ed00/0x11620bc3f30aaa6f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.915412:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1787787540.915428:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787540.915435:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017c7ed00/0x11620bc3f30aaa6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.915450:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017c7ed00/0x11620bc3f30aaa6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.915462:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017c7ed00/0x11620bc3f30aaa6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.915469:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017c7ed00/0x11620bc3f30aaa6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.915495:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787787540.916234:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787540.916242:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004bc24a2/0x11620bc3f30aaa76 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.916253:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1787787540.916257:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787540.916261:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004bc24a2/0x11620bc3f30aaa76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.916270:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004bc24a2/0x11620bc3f30aaa76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.916278:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004bc24a2/0x11620bc3f30aaa76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.916292:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004bc24a2/0x11620bc3f30aaa76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.916300:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787787540.916744:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787787540.916753:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017c7ed00/0x11620bc3f30aaa6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787540.916774:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14c00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787540.916780:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017c7ed00/0x11620bc3f30aaa6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787540.916791:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017c7ed00/0x11620bc3f30aaa6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787540.916809:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017c7ed00/0x11620bc3f30aaa6f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787540.916817:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017c7ed00/0x11620bc3f30aaa6f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787540.916840:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787540.916844:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004bc24a2/0x11620bc3f30aaa76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787540.916851:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14400 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787540.916854:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004bc24a2/0x11620bc3f30aaa76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787540.916862:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004bc24a2/0x11620bc3f30aaa76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787540.916872:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004bc24a2/0x11620bc3f30aaa76 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787540.916884:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004bc24a2/0x11620bc3f30aaa76 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787540.916897:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787540.916899:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787540.916901:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787540.918948:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787540.918966:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039650035/0x11620bc3f30aaa7d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.918983:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1787787540.918989:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787540.918995:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039650035/0x11620bc3f30aaa7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.919010:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039650035/0x11620bc3f30aaa7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.919020:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039650035/0x11620bc3f30aaa7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.919028:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039650035/0x11620bc3f30aaa7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.919047:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787787540.919058:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787540.919064:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039650035/0x11620bc3f30aaa7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.919091:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14a00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787540.919096:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039650035/0x11620bc3f30aaa7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.919105:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039650035/0x11620bc3f30aaa7d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.919121:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039650035/0x11620bc3f30aaa7d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.919129:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039650035/0x11620bc3f30aaa7d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.919163:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787540.919165:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787540.919167:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787540.919212:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787540.919777:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787540.919783:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077dc3a04/0x11620bc3f30aaa84 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.919794:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1787787540.919798:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787540.919803:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077dc3a04/0x11620bc3f30aaa84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.919812:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077dc3a04/0x11620bc3f30aaa84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.919827:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077dc3a04/0x11620bc3f30aaa84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.919834:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077dc3a04/0x11620bc3f30aaa84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.919858:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787787540.920300:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787540.920307:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077dc3a04/0x11620bc3f30aaa84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.920314:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15c00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787540.920318:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077dc3a04/0x11620bc3f30aaa84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.920327:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077dc3a04/0x11620bc3f30aaa84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.920340:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077dc3a04/0x11620bc3f30aaa84 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.920347:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077dc3a04/0x11620bc3f30aaa84 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.920371:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787540.920373:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787540.920375:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787540.920468:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787540.920474:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007029aee2/0x11620bc3f30aaa8b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.920482:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1787787540.920485:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787540.920489:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007029aee2/0x11620bc3f30aaa8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.921023:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007029aee2/0x11620bc3f30aaa8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.921037:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007029aee2/0x11620bc3f30aaa8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.921045:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007029aee2/0x11620bc3f30aaa8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.921186:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787787540.921484:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787540.921490:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007029aee2/0x11620bc3f30aaa8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787787540.921621:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787540.921627:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aaa92 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.921637:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1787787540.921641:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787540.921646:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aaa92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.921656:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aaa92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.921665:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aaa92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.921672:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aaa92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.921687:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787787540.921695:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787540.923251:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14600 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787540.923258:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007029aee2/0x11620bc3f30aaa8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.923270:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007029aee2/0x11620bc3f30aaa8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.923291:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007029aee2/0x11620bc3f30aaa8b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.923300:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007029aee2/0x11620bc3f30aaa8b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.923329:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787540.923331:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787540.923334:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787540.923584:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787540.923591:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028ec4075/0x11620bc3f30aaa99 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.923601:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1787787540.923613:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787540.923619:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028ec4075/0x11620bc3f30aaa99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.923628:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028ec4075/0x11620bc3f30aaa99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.923636:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028ec4075/0x11620bc3f30aaa99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.923642:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028ec4075/0x11620bc3f30aaa99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.923657:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787787540.923665:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787540.923669:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028ec4075/0x11620bc3f30aaa99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.923676:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15200 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787540.923679:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028ec4075/0x11620bc3f30aaa99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.923687:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028ec4075/0x11620bc3f30aaa99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.923697:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028ec4075/0x11620bc3f30aaa99 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.923934:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787540.923937:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787540.923938:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787540.924060:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028ec4075/0x11620bc3f30aaa99 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.924074:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787540.924758:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787540.924766:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002956a671/0x11620bc3f30aaaa0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.924777:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=685s v=(0 0) 00010000:00010000:1.0:1787787540.924781:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787540.924786:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002956a671/0x11620bc3f30aaaa0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.924797:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002956a671/0x11620bc3f30aaaa0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.924805:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002956a671/0x11620bc3f30aaaa0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.924812:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002956a671/0x11620bc3f30aaaa0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.924828:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787787540.924995:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787540.925000:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787540.925005:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002956a671/0x11620bc3f30aaaa0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.925014:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc43e0000 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787540.925018:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002956a671/0x11620bc3f30aaaa0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.925027:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002956a671/0x11620bc3f30aaaa0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.925040:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002956a671/0x11620bc3f30aaaa0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.925046:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002956a671/0x11620bc3f30aaaa0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.925059:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787540.925061:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787540.925062:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787540.925074:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aaa92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.925608:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787540.925674:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15e00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787540.925678:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aaa92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.925688:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aaa92 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.925701:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aaa92 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.925709:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aaa92 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.925725:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787540.925727:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787540.925729:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787540.926231:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787540.926239:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30aaaa7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.926252:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=685s v=(0 0) 00010000:00010000:1.0:1787787540.926256:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787540.926262:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30aaaa7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.926284:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30aaaa7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.926293:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30aaaa7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.926301:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30aaaa7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.926584:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787787540.926594:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787540.926599:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30aaaa7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.926608:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc43e0200 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787540.926612:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30aaaa7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.926629:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30aaaa7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.926642:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30aaaa7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.926650:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab7fddac/0x11620bc3f30aaaa7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.926666:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787540.926668:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787540.926669:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787540.927458:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787540.927466:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039650035/0x11620bc3f30aaaae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.927477:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1787787540.927481:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787540.927486:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039650035/0x11620bc3f30aaaae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.927997:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039650035/0x11620bc3f30aaaae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.928010:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039650035/0x11620bc3f30aaaae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.928026:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039650035/0x11620bc3f30aaaae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.928258:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787787540.928661:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787540.928667:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001623d64d/0x11620bc3f30aaab5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.928679:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1787787540.928683:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787540.928687:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001623d64d/0x11620bc3f30aaab5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.928697:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001623d64d/0x11620bc3f30aaab5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.928705:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001623d64d/0x11620bc3f30aaab5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.928712:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001623d64d/0x11620bc3f30aaab5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.929159:0:24527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787787540.929167:0:24527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039650035/0x11620bc3f30aaaae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.929177:0:24527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14a00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787540.929182:0:24527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039650035/0x11620bc3f30aaaae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.929192:0:24527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039650035/0x11620bc3f30aaaae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.929209:0:24527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039650035/0x11620bc3f30aaaae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.929218:0:24527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039650035/0x11620bc3f30aaaae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.929249:0:24527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787540.929254:0:24527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001623d64d/0x11620bc3f30aaab5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.929260:0:24527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14800 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787540.929262:0:24527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001623d64d/0x11620bc3f30aaab5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.929269:0:24527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001623d64d/0x11620bc3f30aaab5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.929279:0:24527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001623d64d/0x11620bc3f30aaab5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.929287:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787540.929288:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787540.929290:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787540.929391:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787787540.929396:0:24219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001623d64d/0x11620bc3f30aaab5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787787540.930187:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787540.930195:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028ec4075/0x11620bc3f30aaabc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.930208:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1787787540.930213:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787540.930218:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028ec4075/0x11620bc3f30aaabc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.930230:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028ec4075/0x11620bc3f30aaabc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.930238:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028ec4075/0x11620bc3f30aaabc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.930247:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028ec4075/0x11620bc3f30aaabc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.934392:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787540.934407:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028ec4075/0x11620bc3f30aaabc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.934422:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15200 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787540.934427:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028ec4075/0x11620bc3f30aaabc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.934468:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028ec4075/0x11620bc3f30aaabc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.934491:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028ec4075/0x11620bc3f30aaabc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.935222:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787540.935224:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787540.935226:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787540.935607:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787787540.935616:0:24219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028ec4075/0x11620bc3f30aaabc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.936286:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787540.936750:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787540.936760:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aaac3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.936789:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1787787540.936794:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787540.936800:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aaac3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.936812:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aaac3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.936821:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aaac3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.936828:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aaac3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.936851:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787787540.937325:0:24527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787540.937332:0:24527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aaac3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.937340:0:24527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15e00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787540.937344:0:24527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aaac3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.937353:0:24527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aaac3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.937370:0:24527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aaac3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.937377:0:24527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efa2a8da/0x11620bc3f30aaac3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.937406:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787540.937408:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787540.937411:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787540.938460:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787540.938471:0:24219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6ff0916/0x11620bc3f30aaaca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.938484:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1787787540.938488:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787540.938493:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6ff0916/0x11620bc3f30aaaca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.938616:0:24219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6ff0916/0x11620bc3f30aaaca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.938641:0:24219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6ff0916/0x11620bc3f30aaaca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.938648:0:24219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6ff0916/0x11620bc3f30aaaca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.938704:0:24219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1787787540.938769:0:24219:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:0.0:1787787540.938870:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22739:x1874630503812608:12345-0@lo:5:osp-pre-0-0.0 Request processed in 94049us (94474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787540.938879:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787787540.940818:0:22739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418cb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22739:1874630503812608:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787787540.940837:0:22739:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:2.0:1787787540.940887:0:22739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418cb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22739:1874630503812736:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787787540.940949:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787540.940984:0:22739:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc2ad0900 going to sleep for 11 seconds 00000100:00100000:2.0:1787787540.941008:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503812736 00000100:00100000:2.0:1787787540.941013:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503812736 00000100:00100000:2.0:1787787540.941054:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787787540.941062:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22739:x1874630503812736:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787787540.941113:0:24220:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:1.0:1787787540.944438:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787540.944451:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6ff0916/0x11620bc3f30aaaca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.944466:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15a00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787540.944471:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6ff0916/0x11620bc3f30aaaca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.944483:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6ff0916/0x11620bc3f30aaaca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.944519:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6ff0916/0x11620bc3f30aaaca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787540.944527:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6ff0916/0x11620bc3f30aaaca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787540.948960:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787540.948968:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787540.948972:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787787540.954271:0:24216:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:2.0:1787787540.954320:0:24216:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787787540.954996:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22739:x1874630503812736:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13929us (14041us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1787787540.955013:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787787540.955060:0:22739:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1787787540.955069:0:22739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418cb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22739:1874630503812736:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787787540.955190:0:22739:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:1.0:1787787541.932543:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787787541.976797:0:24589:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg431-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:0.0:1787787542.191414:0:22750:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1787787542.828672:0:24641:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787787542.828941:0:24641:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787787542.892028:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787787542.896559:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503812864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787787542.896650:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787542.896706:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503812864 00000100:00100000:3.0:1787787542.896716:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503812864 00000100:00100000:3.0:1787787542.896764:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787787542.896773:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503812864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787787542.896820:0:22720:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787787542.896891:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503812864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787542.896898:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787787542.896947:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503812864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787787542.897956:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503812992:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787787542.898012:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787542.898100:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503812992 00000100:00100000:0.0:1787787542.898106:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503812992 00000100:00100000:2.0:1787787542.898221:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787787542.898234:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503812992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787787542.898260:0:22720:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787787542.898456:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503812992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 225us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787542.898463:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787787542.898951:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503812992:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787787542.959958:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787787543.657744:0:24692:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787787543.658471:0:24692:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787787543.979901:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787787544.817120:0:23468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787787545.002304:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787545.962269:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787787545.962288:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503813120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787545.962368:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787545.962647:0:24224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503813120 00000100:00100000:1.0:1787787545.962655:0:24224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503813120 00000100:00100000:1.0:1787787545.962720:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787787545.962728:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503813120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787787545.962755:0:24224:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1787787545.962803:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503813120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787545.962823:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787787545.962845:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787545.962881:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503813120:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787787545.962934:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787787545.962939:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787787545.962943:0:8:0:(import.c:65:import_set_state_nolock()) ffff9870c580d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787787545.962948:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 685 00000100:00080000:1.0:1787787545.962953:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787787545.962957:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9870c580d800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:1.0:1787787545.962979:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc489a1c0 x1874630503813504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787787545.963008:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787787545.963012:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787787545.963015:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787787545.963018:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787787545.963048:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3fd2c107-7647-408e-8048-4ef16ee44cbc:3655:1874630503813248:0@lo:400:kworker.0 00000100:00100000:1.0:1787787545.963081:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787545.963104:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4899680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503813888:0@lo:400:kworker.0 00000100:00100000:1.0:1787787545.963160:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787545.963181:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787787545.963186:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4898f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503813376:0@lo:400:kworker.0 00000100:00100000:1.0:1787787545.963208:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787545.963224:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc48983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503814016:0@lo:400:kworker.0 00000100:00100000:1.0:1787787545.963244:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787545.963272:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503813248 00000100:00100000:1.0:1787787545.963276:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503813248 00000100:00100000:1.0:1787787545.963303:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787787545.963309:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:3655:x1874630503813248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787545.963753:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:3655:x1874630503813248:12345-0@lo:400:kworker.0 Request processed in 443us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787545.963760:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787787545.963793:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503813888 00000100:00100000:1.0:1787787545.963797:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503813888 00000100:00100000:1.0:1787787545.963831:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503814016 00000100:00100000:1.0:1787787545.963834:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503814016 00000100:00100000:1.0:1787787545.963858:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787787545.963864:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4899e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503813888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787545.963897:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4899e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503813888:12345-0@lo:400:kworker.0 Request processed in 33us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787545.963903:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787787545.963915:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787787545.963920:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503814016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787545.963946:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503814016:12345-0@lo:400:kworker.0 Request processed in 25us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787545.963962:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787787545.963982:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503813376 00000100:00100000:1.0:1787787545.963986:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503813376 00000100:00100000:1.0:1787787545.964011:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787787545.964018:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503813376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787545.964051:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503813376:12345-0@lo:400:kworker.0 Request processed in 34us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787545.964057:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787787545.964090:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503813504:0@lo:8:kworker.0 00000100:00100000:1.0:1787787545.964120:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787787545.964173:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787787545.964184:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4899a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503813632:0@lo:400:kworker.0 00000100:00100000:1.0:1787787545.964208:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787545.964225:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503814144:0@lo:400:kworker.0 00000100:00100000:1.0:1787787545.964247:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787545.964262:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787545.964268:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503813760:0@lo:400:kworker.0 00000100:00100000:1.0:1787787545.964286:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787545.964309:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503813760 00000100:00100000:1.0:1787787545.964312:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503813760 00000100:00100000:0.0:1787787545.964482:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503813504 00000100:00100000:0.0:1787787545.964486:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503813504 00000100:00100000:0.0:1787787545.964510:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787787545.964515:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3652:x1874630503813504:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787787545.964533:0:24219:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787787545.964580:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3652:x1874630503813504:12345-0@lo:8:kworker.0 Request processed in 64us (460us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787787545.964595:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787787545.964720:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787787545.964727:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503813760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787545.964763:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503813760:12345-0@lo:400:kworker.0 Request processed in 37us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787545.964769:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787787545.964794:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503813632 00000100:00100000:1.0:1787787545.964798:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503813632 00000100:00100000:1.0:1787787545.964842:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503814144 00000100:00100000:1.0:1787787545.964846:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503814144 00000100:00100000:1.0:1787787545.964869:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787787545.964875:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503813632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787545.964902:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503813632:12345-0@lo:400:kworker.0 Request processed in 28us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787545.964908:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787787545.964919:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787787545.964924:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503814144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787545.964946:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503814144:12345-0@lo:400:kworker.0 Request processed in 22us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787545.964951:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1787787545.964966:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787787545.964986:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870c580d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787787545.964991:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787787545.964995:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503813504:0@lo:8:kworker.0 00000100:00100000:1.0:1787787545.965024:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503813760:0@lo:400:kworker.0 00010000:00080000:1.0:1787787545.965036:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc4899a40 x1874630503813632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787545.965044:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4899a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503813632:0@lo:400:kworker.0 00010000:00080000:1.0:1787787545.965052:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc489a940 x1874630503814144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787545.965059:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503814144:0@lo:400:kworker.0 00000100:00100000:2.0:1787787545.966755:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3fd2c107-7647-408e-8048-4ef16ee44cbc:3655:1874630503813248:0@lo:400:kworker.0 00010000:00080000:2.0:1787787545.966789:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc4899680 x1874630503813888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787545.966801:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4899680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503813888:0@lo:400:kworker.0 00000100:00100000:2.0:1787787545.966837:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4898f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503813376:0@lo:400:kworker.0 00010000:00080000:2.0:1787787545.966848:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc48983c0 x1874630503814016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787545.966856:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc48983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503814016:0@lo:400:kworker.0 00010000:00010000:3.0:1787787546.025253:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787547.053481:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787548.009686:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787787532/real 1787787532] req@ffff986fc418c780 x1874630503805952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787547 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787548.009716:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff986fc418c780 x1874630503805952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787547 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787548.009726:0:3652:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787787532/real 1787787532] req@ffff986fc418cf00 x1874630503806080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787547 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787548.009736:0:3652:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff986fc418cf00 x1874630503806080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787787547 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787787548.009755:0:3652:0:(import.c:65:import_set_state_nolock()) ffff987101cd8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787787548.009787:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787787548.009792:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503805952:0@lo:8:kworker.0 00000100:00080000:3.0:1787787548.009798:0:3652:0:(import.c:65:import_set_state_nolock()) ffff986fc43a7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787787548.009803:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787787548.009807:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503806080:0@lo:8:kworker.0 00000100:00080000:2.0:1787787548.009969:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787548.009974:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787787548.009977:0:36:0:(import.c:65:import_set_state_nolock()) ffff9870c580d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787787548.009983:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 690 00000100:00080000:2.0:1787787548.009987:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787787548.009993:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9870c580d800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:2.0:1787787548.010015:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc24b4000 x1874630503814784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787787548.010041:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787548.010044:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787787548.010046:0:36:0:(import.c:65:import_set_state_nolock()) ffff987101cd8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787787548.010049:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 676 00000100:00080000:2.0:1787787548.010061:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787787548.010065:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff987101cd8800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:2.0:1787787548.010078:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc24b43c0 x1874630503815168/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787787548.010087:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787548.010090:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787787548.010091:0:36:0:(import.c:65:import_set_state_nolock()) ffff986fc43a7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787787548.010094:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 676 00000100:00080000:2.0:1787787548.010096:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787787548.010099:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff986fc43a7000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:2.0:1787787548.010108:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc24b4b40 x1874630503815296/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787787548.010172:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503814528:0@lo:400:kworker.0 00000100:00100000:2.0:1787787548.010248:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787548.010281:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874630503815424:0@lo:400:kworker.0 00000100:00100000:2.0:1787787548.010306:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787548.010327:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787787548.010333:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3fd2c107-7647-408e-8048-4ef16ee44cbc:3656:1874630503814400:0@lo:400:kworker.0 00000100:00100000:2.0:1787787548.010359:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787548.010384:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503815040:0@lo:400:kworker.0 00000100:00100000:2.0:1787787548.010405:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787548.010434:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503814528 00000100:00100000:2.0:1787787548.010441:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503814528 00000100:00100000:2.0:1787787548.010480:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503815040 00000100:00100000:2.0:1787787548.010484:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503815040 00000100:00100000:2.0:1787787548.010510:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787787548.010519:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc24b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503814528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787548.010572:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc24b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503814528:12345-0@lo:400:kworker.0 Request processed in 55us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787548.010580:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787787548.010597:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787787548.010603:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc24b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503815040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787548.010631:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc24b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503815040:12345-0@lo:400:kworker.0 Request processed in 29us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787548.010637:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787787548.010655:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503815424 00000100:00100000:2.0:1787787548.010659:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503815424 00000100:00100000:2.0:1787787548.010683:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787787548.010689:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc24b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874630503815424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787548.010732:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc24b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874630503815424:12345-0@lo:400:kworker.0 Request processed in 43us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787548.010738:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787787548.010756:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503814400 00000100:00100000:2.0:1787787548.010760:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503814400 00000100:00100000:2.0:1787787548.010797:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787787548.010804:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:3656:x1874630503814400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787548.011051:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503814272:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787787548.011299:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503814784:0@lo:8:kworker.0 00000100:00100000:1.0:1787787548.011417:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503814656:0@lo:400:kworker.0 00000100:00100000:0.0:1787787548.011737:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787548.011764:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503814912:0@lo:400:kworker.0 00000100:00100000:0.0:1787787548.011798:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787548.011813:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874630503815680:0@lo:400:kworker.0 00000100:00100000:2.0:1787787548.011911:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:3656:x1874630503814400:12345-0@lo:400:kworker.0 Request processed in 1107us (1550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787548.011920:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787787548.011960:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503814912 00000100:00100000:2.0:1787787548.012022:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503814912 00000100:00100000:2.0:1787787548.012050:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787787548.012066:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503814912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787548.012101:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503814912:12345-0@lo:400:kworker.0 Request processed in 36us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787548.012107:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787787548.012157:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3fd2c107-7647-408e-8048-4ef16ee44cbc:3656:1874630503814400:0@lo:400:kworker.0 00000100:00100000:2.0:1787787548.012171:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503815040:0@lo:400:kworker.0 00000100:00100000:2.0:1787787548.012180:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503814528:0@lo:400:kworker.0 00010000:00080000:2.0:1787787548.012192:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc24b61c0 x1874630503815424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787787548.012322:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874630503815424:0@lo:400:kworker.0 00000100:00100000:2.0:1787787548.012349:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787787548.012356:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503815808:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787787548.012380:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787548.012409:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503814272 00000100:00100000:2.0:1787787548.012412:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503814272 00000100:00100000:2.0:1787787548.012434:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503815808 00000100:00100000:2.0:1787787548.012436:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503815808 00000100:00100000:2.0:1787787548.012448:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787787548.012454:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503814272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787787548.012479:0:23456:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787787548.012512:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503814272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787548.012518:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787787548.012530:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787787548.012535:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc24b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503815808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787787548.012557:0:23456:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787787548.012593:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc24b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503815808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787548.012599:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787787548.012631:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503815808:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787787548.012815:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787548.012908:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503815168:0@lo:8:kworker.0 00000100:00100000:3.0:1787787548.012932:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787548.012958:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503815296:0@lo:8:kworker.0 00000100:00100000:3.0:1787787548.013049:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787548.013079:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503814784 00000100:00100000:3.0:1787787548.013083:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503814784 00000100:00100000:3.0:1787787548.013098:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503815168 00000100:00100000:3.0:1787787548.013101:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503815168 00000100:00100000:3.0:1787787548.013107:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503815296 00000100:00100000:3.0:1787787548.013110:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503815296 00000100:00100000:3.0:1787787548.013119:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787787548.013125:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3652:x1874630503814784:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787787548.013165:0:24221:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787787548.013199:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3652:x1874630503814784:12345-0@lo:8:kworker.0 Request processed in 73us (384us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787787548.013279:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787787548.013293:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787787548.013297:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3652:x1874630503815168:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787787548.013316:0:24221:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 692 last 0 00000020:00000080:3.0:1787787548.013343:0:24221:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x11620bc3f30aaad1 00002000:00100000:3.0:1787787548.013356:0:24221:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9870f662e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113934 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1787787548.013360:0:24221:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1787787548.013363:0:24221:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787787548.013436:0:24221:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1787787548.013459:0:24221:0:(import.c:65:import_set_state_nolock()) ffff9870f662d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787787548.013493:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3652:x1874630503815168:12345-0@lo:8:kworker.0 Request processed in 194us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787548.013500:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787787548.013512:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787787548.013515:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3652:x1874630503815296:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787787548.013531:0:24221:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787787548.013556:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3652:x1874630503815296:12345-0@lo:8:kworker.0 Request processed in 38us (507us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787787548.013561:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1787787548.013594:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870c580d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787787548.013599:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787787548.013602:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503814784:0@lo:8:kworker.0 00000100:00100000:3.0:1787787548.013613:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787787548.013619:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1787787548.013626:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787787548.013631:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787787548.013633:0:3652:0:(import.c:65:import_set_state_nolock()) ffff987101cd8800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787787548.013648:0:3652:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787787548.013652:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503815168:0@lo:8:kworker.0 00000100:00080000:3.0:1787787548.013662:0:3652:0:(import.c:65:import_set_state_nolock()) ffff986fc43a7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787787548.013665:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787787548.013667:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503815296:0@lo:8:kworker.0 00000100:00100000:0.0:1787787548.013857:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787548.013892:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503814272:0@lo:41:osp-pre-0-1.0 00010000:00080000:0.0:1787787548.013905:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc24b5a40 x1874630503814912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787548.013915:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503814912:0@lo:400:kworker.0 00000004:00080000:0.0:1787787548.014285:0:23458:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787787548.014305:0:23458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fa580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23458:1874630503816064:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1787787548.014337:0:23458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787548.014354:0:23458:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c5392b40 going to sleep for 11 seconds 00000004:00080000:0.0:1787787548.014369:0:23457:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787787548.014435:0:23457:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 692196295419ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787787548.014441:0:23457:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787787548.014731:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503815680 00000100:00100000:3.0:1787787548.014736:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503815680 00000100:00100000:2.0:1787787548.014893:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503816064 00000100:00100000:2.0:1787787548.014898:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503816064 00000100:00100000:2.0:1787787548.014934:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787787548.014943:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23458:x1874630503816064:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1787787548.015390:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787787548.015399:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874630503815680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787548.015457:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874630503815680:12345-0@lo:400:kworker.0 Request processed in 60us (1600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787548.015464:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1787787548.017021:0:23448:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00010000:00080000:0.0:1787787548.017091:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc24b5e00 x1874630503815680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787548.017107:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874630503815680:0@lo:400:kworker.0 00000100:00100000:0.0:1787787548.017188:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00002000:00080000:2.0:1787787548.017703:0:24219:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1787787548.017711:0:24219:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1787787548.017806:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23458:x1874630503816064:12345-0@lo:7:osp-pre-0-1.0 Request processed in 2863us (3467us total) trans 0 rc 0/0 00000100:00080000:1.0:1787787548.018004:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787787548.018011:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787787548.018054:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787548.018100:0:24221:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787787548.018108:0:24221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787787548.018911:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503815936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787787548.018962:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787548.019012:0:24224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503815936 00000100:00100000:0.0:1787787548.019021:0:24224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503815936 00000100:00100000:0.0:1787787548.019070:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787787548.019079:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3655:x1874630503815936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787787548.019106:0:24224:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787787548.019162:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3655:x1874630503815936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787548.019169:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787787548.019298:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787787548.019318:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503814656 00000100:00100000:2.0:1787787548.019322:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503814656 00000100:00100000:2.0:1787787548.019354:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787787548.019360:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503814656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787548.019396:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503814656:12345-0@lo:400:kworker.0 Request processed in 36us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787548.019402:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787787548.019757:0:23458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fa580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23458:1874630503816064:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1787787548.019780:0:23458:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:1.0:1787787548.019931:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503815552:0@lo:400:kworker.0 00000100:00100000:1.0:1787787548.019967:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787548.020005:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503814656:0@lo:400:kworker.0 00000100:00100000:2.0:1787787548.020989:0:23458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b5680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23458:1874630503816192:0@lo:5:osp-pre-0-1.0 00000100:00080000:1.0:1787787548.021117:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787548.021151:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503815552 00000100:00100000:1.0:1787787548.021157:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503815552 00000100:00100000:1.0:1787787548.021222:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787787548.021232:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874630503815552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787548.021297:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874630503815552:12345-0@lo:400:kworker.0 Request processed in 68us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787548.021304:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1787787548.021321:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787787548.021346:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc24b6580 x1874630503815552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787548.021357:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503815552:0@lo:400:kworker.0 00000100:00100000:0.0:1787787548.021964:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503815936:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787787548.023017:0:23458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787548.023064:0:23458:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c538f300 going to sleep for 11 seconds 00000100:00100000:3.0:1787787548.023121:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503816192 00000100:00100000:3.0:1787787548.023133:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503816192 00000100:00100000:3.0:1787787548.023198:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787787548.023281:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc24b6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23458:x1874630503816192:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787787548.023309:0:24219:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1787787548.023354:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc24b6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23458:x1874630503816192:12345-0@lo:5:osp-pre-0-1.0 Request processed in 77us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787548.023361:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787787548.023487:0:23458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b5680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23458:1874630503816192:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1787787548.023500:0:23458:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1787787548.023540:0:23458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b5680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23458:1874630503816320:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1787787548.023563:0:23458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787548.025332:0:23458:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c538f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787787548.027324:0:24939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503816320 00000100:00100000:1.0:1787787548.027336:0:24939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503816320 00000100:00100000:1.0:1787787548.027435:0:24939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787787548.027446:0:24939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc24b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23458:x1874630503816320:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1787787548.027497:0:24939:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:1.0:1787787548.046392:0:24216:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:1.0:1787787548.046412:0:24216:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787787548.047160:0:24939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc24b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23458:x1874630503816320:12345-0@lo:5:osp-pre-0-1.0 Request processed in 19690us (23570us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1787787548.047173:0:24939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787787548.048049:0:23458:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1787787548.048060:0:23458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b5680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23458:1874630503816320:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1787787548.048076:0:23458:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:2.0:1787787548.048125:0:23458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b5680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23458:1874630503816448:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1787787548.048190:0:23458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787548.048359:0:23458:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c538f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787787548.048456:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503816448 00000100:00100000:0.0:1787787548.048462:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503816448 00000100:00100000:0.0:1787787548.048614:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787787548.048624:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc24b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23458:x1874630503816448:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1787787548.048691:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc24b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23458:x1874630503816448:12345-0@lo:900:osp-pre-0-1.0 Request processed in 68us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787548.048699:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787787548.048814:0:23458:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff986fc24b5680 x1874630503816448/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787787564 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787548.048838:0:23458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b5680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23458:1874630503816448:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1787787548.074019:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787549.097370:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787787549.900880:0:25037:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787787549.900884:0:25037:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787787549.900886:0:25037:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787787549.901975:0:25037:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9870fc318800 00000020:01000004:2.0:1787787549.903305:0:25037:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787787549.903325:0:25037:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787787549.903345:0:25037:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff986fc10c0000) 00000020:00000080:2.0:1787787549.903365:0:25037:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787787549.983414:0:25037:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787787549.985579:0:25037:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1787787549.986007:0:25037:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787787549.986208:0:25037:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787787549.986554:0:25037:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787787549.986868:0:25037:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787787549.987169:0:25037:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:1.0:1787787549.990390:0:25037:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787787549.990609:0:25037:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787787549.990622:0:25037:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787787549.990633:0:25037:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x11620bc3f30aaadf 00000020:01000004:1.0:1787787549.990652:0:25037:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787787549.990676:0:25037:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.131@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787787549.990680:0:25037:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787787549.990686:0:25037:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787787549.990721:0:25037:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1787787549.990725:0:25037:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.131@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787787550.009344:0:25037:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.131@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787787550.009390:0:25037:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.131@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1787787550.009395:0:25037:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787787550.009396:0:25037:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787787550.009398:0:25037:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787787550.009399:0:25037:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787787550.009401:0:25037:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787787550.009402:0:25037:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787787550.009403:0:25037:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787787550.009409:0:25037:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787787550.009410:0:25037:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787787550.009413:0:25037:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1787787550.009416:0:25037:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787787550.009417:0:25037:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787787550.009418:0:25037:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787787550.009419:0:25037:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787787550.009420:0:25037:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787787550.009422:0:25037:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787787550.009423:0:25037:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787787550.009424:0:25037:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787787550.009425:0:25037:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787787550.009450:0:25037:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787787550.009470:0:25037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ef840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503816576:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787787550.009542:0:25037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787550.009579:0:25037:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f36b4540 going to sleep for 11 seconds 00000100:00100000:0.0:1787787550.009656:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503816576 00000100:00100000:0.0:1787787550.009664:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503816576 00000100:00100000:0.0:1787787550.009719:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787787550.009827:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:25037:x1874630503816576:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787787550.009874:0:22706:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787787550.009877:0:22706:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787787550.009882:0:22706:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787787550.010227:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:25037:x1874630503816576:12345-0@lo:253:mount.lustre.0 Request processed in 499us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787550.010236:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787787550.010530:0:25037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ef840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503816576:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787787550.010542:0:25037:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787787550.010545:0:25037:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787787550.010547:0:25037:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787787550.010548:0:25037:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787787550.010549:0:25037:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787787550.010551:0:25037:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787787550.010552:0:25037:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787787550.010553:0:25037:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787787550.010555:0:25037:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787787550.010556:0:25037:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787787550.010578:0:25037:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9870fc318800 from lustre-OST0001 10000000:01000000:1.0:1787787550.010606:0:25037:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787787550.010610:0:25037:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787787550.010619:0:25037:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff986fc296cd28 local copy 00010000:00010000:1.0:1787787550.010630:0:25037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e0600/0x11620bc3f30aa719 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa720 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787550.010715:0:25037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ef840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503816704:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787550.010767:0:25037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787550.010896:0:25037:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f36b4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787787550.011334:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503816704 00000100:00100000:2.0:1787787550.011340:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503816704 00000100:00100000:3.0:1787787550.011537:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787787550.011548:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:25037:x1874630503816704:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787550.011688:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:25037:x1874630503816704:12345-0@lo:501:mount.lustre.0 Request processed in 142us (920us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787787550.011695:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787787550.011960:0:25037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ef840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503816704:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787787550.011980:0:25037:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787787550.012006:0:25037:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787787550.012014:0:25037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e0600/0x11620bc3f30aa719 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa720 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.012026:0:25037:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff986fc43e0600/0x11620bc3f30aa719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aa720 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787550.012055:0:25037:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9870fc318800 10000000:01000000:1.0:1787787550.012060:0:25037:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787787550.012065:0:25037:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787787550.012067:0:25037:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787787550.012072:0:25037:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787787550.012075:0:25037:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787787550.012101:0:25037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e0800/0x11620bc3f30aaae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.012109:0:25037:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff986fc43e0800/0x11620bc3f30aaae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.012119:0:25037:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff986fc43e0800/0x11620bc3f30aaae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787550.012134:0:25037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ef840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503816832:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787787550.012244:0:25037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787550.012327:0:25037:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f36b4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787787550.012382:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503816832 00000100:00100000:3.0:1787787550.012387:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503816832 00000100:00100000:3.0:1787787550.012419:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787787550.012426:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:25037:x1874630503816832:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787787550.012436:0:22708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787550.012448:0:22708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c13f5e00/0x11620bc3f30aaaed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aaae6 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787550.012565:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c13f5e00/0x11620bc3f30aaaed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aaae6 expref: 22 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787550.012581:0:22708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c13f5e00/0x11620bc3f30aaaed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aaae6 expref: 22 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787550.012599:0:22708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f5e00, rc 0) 00000100:00100000:1.0:1787787550.012758:0:25037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ef840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503816832:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787550.012771:0:25037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff986fc43e0800/0x11620bc3f30aaae6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aaaed expref: -99 pid: 25037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.012791:0:25037:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff986fc43e0800/0x11620bc3f30aaae6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aaaed expref: -99 pid: 25037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787550.014525:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+22:25037:x1874630503816832:12345-0@lo:101:mount.lustre.0 Request processed in 2041us (2222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787550.014538:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000040:00080000:1.0:1787787550.014743:0:25037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:1.0:1787787550.015613:0:25037:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787787550.025530:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1787787550.025588:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1787787550.025603:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1787787550.025616:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1787787550.025629:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1787787550.025641:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1787787550.025654:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1787787550.025666:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1787787550.025678:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:1.0:1787787550.025704:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:1.0:1787787550.025709:0:25037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:1.0:1787787550.025870:0:25037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ef840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503816960:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787550.026442:0:25037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787550.026601:0:25037:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f36b4900 going to sleep for 11 seconds 00000100:00100000:2.0:1787787550.027551:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503816960 00000100:00100000:2.0:1787787550.027563:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503816960 00000100:00100000:3.0:1787787550.031767:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787787550.031783:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+22:25037:x1874630503816960:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787550.032040:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+22:25037:x1874630503816960:12345-0@lo:501:mount.lustre.0 Request processed in 259us (5597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787550.032049:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787787550.032114:0:25037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ef840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503816960:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787787550.032205:0:25037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503817088:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787787550.032265:0:25037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787550.032304:0:25037:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0e56000 going to sleep for 11 seconds 00000100:00100000:1.0:1787787550.032449:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503817088 00000100:00100000:1.0:1787787550.032456:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503817088 00000100:00100000:1.0:1787787550.032493:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787787550.032501:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+22:25037:x1874630503817088:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787550.037431:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+22:25037:x1874630503817088:12345-0@lo:503:mount.lustre.0 Request processed in 4918us (5154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787550.037460:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787787550.040503:0:25037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503817088:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787787550.041330:0:25037:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787787550.041449:0:25037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503817216:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787787550.041575:0:25037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787550.041653:0:25037:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0e56000 going to sleep for 11 seconds 00000100:00100000:1.0:1787787550.041660:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503817216 00000100:00100000:1.0:1787787550.041668:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503817216 00000100:00100000:1.0:1787787550.041723:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787787550.041743:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+22:25037:x1874630503817216:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787550.042423:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+22:25037:x1874630503817216:12345-0@lo:502:mount.lustre.0 Request processed in 680us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787550.042432:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787787550.048286:0:25037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503817216:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787787550.048756:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1787787550.048809:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1787787550.048826:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1787787550.048854:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1787787550.048878:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1787787550.048891:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1787787550.048903:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1787787550.048915:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1787787550.048941:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1787787550.048979:0:25037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503817344:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787787550.049052:0:25037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787550.049097:0:25037:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c2c09540 going to sleep for 11 seconds 00000100:00100000:1.0:1787787550.049213:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503817344 00000100:00100000:1.0:1787787550.049219:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503817344 00000100:00100000:1.0:1787787550.049272:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787787550.049282:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+22:25037:x1874630503817344:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787550.049393:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+22:25037:x1874630503817344:12345-0@lo:502:mount.lustre.0 Request processed in 111us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787550.049401:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787787550.049555:0:25037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503817344:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787787550.049611:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:0.0:1787787550.049620:0:25037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1787787550.051001:0:25041:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787787550.051012:0:25041:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1787787550.051017:0:25041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787550.051020:0:25041:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787787550.051026:0:25041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787787550.051040:0:25041:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff986fc10c19b8) 00000020:00000080:2.0:1787787550.051065:0:25041:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787787550.051070:0:25041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787787550.051174:0:25041:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9870fc318800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787787550.051183:0:25041:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787787550.051189:0:25041:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x11620bc3f30aaafb 00010000:00010000:2.0:1787787550.057641:0:25041:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1787787550.058264:0:25041:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:2.0:1787787550.064555:0:25041:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1787787550.066628:0:25041:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787787550.066643:0:25041:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787550.066651:0:25041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787550.066653:0:25041:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787787550.066657:0:25041:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787787550.066661:0:25041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787550.066662:0:25041:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787787550.066665:0:25041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787787550.066667:0:25041:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787787550.066669:0:25041:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787550.066684:0:25041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787550.066685:0:25041:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787787550.066689:0:25041:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787787550.066692:0:25041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787550.066703:0:25041:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787787550.066708:0:25041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787787550.066747:0:25041:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787787550.066750:0:25041:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787787550.066752:0:25041:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787787550.066755:0:25041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:1.0:1787787550.067107:0:25037:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1787787550.067211:0:25037:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787787550.067264:0:25037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e0800/0x11620bc3f30aaae6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aaaed expref: -99 pid: 25037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.067277:0:25037:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff986fc43e0800/0x11620bc3f30aaae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aaaed expref: -99 pid: 25037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787550.067286:0:25037:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9870fc318800 from 1 10000000:01000000:1.0:1787787550.067289:0:25037:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787787550.067324:0:25037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aab02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.067341:0:25037:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aab02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.067352:0:25037:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aab02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787550.067376:0:25037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ed2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503817472:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787787550.067440:0:25037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787550.067480:0:25037:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c2ddf240 going to sleep for 11 seconds 00000100:00100000:2.0:1787787550.067540:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503817472 00000100:00100000:2.0:1787787550.067548:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503817472 00000100:00100000:2.0:1787787550.067595:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787787550.067604:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+22:25037:x1874630503817472:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787787550.067618:0:22708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787550.067631:0:22708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff987101ee3400/0x11620bc3f30aab09 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aab02 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787550.067653:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff987101ee3400/0x11620bc3f30aab09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aab02 expref: 23 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787550.067664:0:22708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff987101ee3400/0x11620bc3f30aab09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aab02 expref: 23 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787550.067673:0:22708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3400, rc 0) 00000100:00100000:2.0:1787787550.067722:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+23:25037:x1874630503817472:12345-0@lo:101:mount.lustre.0 Request processed in 120us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787550.067740:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787787550.067817:0:25037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ed2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503817472:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787550.067849:0:25037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aab02 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aab09 expref: -99 pid: 25037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.067859:0:25037:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aab02 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aab09 expref: -99 pid: 25037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787787550.071227:0:25037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1787787550.071507:0:25037:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787787550.071673:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1787787550.072858:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1787787550.072899:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1787787550.075503:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1787787550.075542:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1787787550.075556:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1787787550.075568:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1787787550.075580:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1787787550.075592:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1787787550.075603:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1787787550.075628:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1787787550.075653:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1787787550.075659:0:25037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1787787550.075785:0:25037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ed2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503817600:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787550.075852:0:25037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787550.075887:0:25037:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c538f300 going to sleep for 11 seconds 00000100:00100000:3.0:1787787550.076134:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503817600 00000100:00100000:3.0:1787787550.076169:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503817600 00000100:00100000:3.0:1787787550.076219:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787787550.076228:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+23:25037:x1874630503817600:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787550.076368:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+23:25037:x1874630503817600:12345-0@lo:501:mount.lustre.0 Request processed in 141us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787550.076376:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787787550.078211:0:25037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ed2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503817600:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787787550.078269:0:25037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ed2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503817728:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787787550.078339:0:25037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787550.078377:0:25037:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c538f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787787550.078452:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503817728 00000100:00100000:0.0:1787787550.078459:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503817728 00000100:00100000:0.0:1787787550.080269:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787787550.080285:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+23:25037:x1874630503817728:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787787550.080423:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+23:25037:x1874630503817728:12345-0@lo:503:mount.lustre.0 Request processed in 143us (2084us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787550.080438:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787787550.080532:0:25037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ed2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503817728:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787787550.080969:0:25037:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787787550.081045:0:25037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ed2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503817856:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787787550.081088:0:25037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787550.084223:0:25037:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c5f7b540 going to sleep for 11 seconds 00000100:00100000:3.0:1787787550.085611:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503817856 00000100:00100000:3.0:1787787550.085628:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503817856 00000100:00100000:3.0:1787787550.085694:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787787550.085714:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+23:25037:x1874630503817856:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787787550.086062:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+23:25037:x1874630503817856:12345-0@lo:502:mount.lustre.0 Request processed in 349us (4973us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787550.086070:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787787550.086324:0:25037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ed2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503817856:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787787550.086889:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1787787550.087039:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1787787550.087057:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1787787550.087071:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1787787550.087085:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1787787550.087099:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1787787550.087112:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1787787550.087125:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1787787550.087332:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1787787550.087353:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1787787550.087366:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1787787550.087407:0:25037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503817984:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787787550.087472:0:25037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787550.087549:0:25037:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d84d7300 going to sleep for 11 seconds 00000100:00100000:0.0:1787787550.087625:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503817984 00000100:00100000:0.0:1787787550.087632:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503817984 00000100:00100000:0.0:1787787550.087772:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787787550.087782:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+23:25037:x1874630503817984:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787787550.087890:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+23:25037:x1874630503817984:12345-0@lo:502:mount.lustre.0 Request processed in 109us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787550.087898:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787787550.088101:0:25037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503817984:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787787550.088176:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1787787550.088185:0:25037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787787550.089340:0:25045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787550.089352:0:25045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787550.089355:0:25045:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787787550.089361:0:25045:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9870fc318800 00000020:00000080:3.0:1787787550.089364:0:25045:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787787550.089372:0:25045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787550.089374:0:25045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787550.089376:0:25045:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787787550.089379:0:25045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787550.089381:0:25045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787550.089382:0:25045:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787787550.089385:0:25045:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9870fc318800 00000020:00000080:3.0:1787787550.089388:0:25045:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787787550.089443:0:25045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787550.089447:0:25045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787550.089454:0:25045:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787787550.089457:0:25045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787550.089460:0:25045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787550.089462:0:25045:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787787550.089465:0:25045:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9870fc318800 00000020:00000080:3.0:1787787550.089467:0:25045:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787787550.089486:0:25045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787550.089489:0:25045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787550.089490:0:25045:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787787550.089493:0:25045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787787550.089495:0:25045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787550.089496:0:25045:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787787550.089500:0:25045:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9870fc318800 00000020:00000080:3.0:1787787550.089502:0:25045:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787787550.089522:0:25045:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787787550.089525:0:25045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787787550.089526:0:25045:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787787550.089529:0:25045:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1787787550.089569:0:25037:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787787550.089596:0:25037:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787787550.089610:0:25037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aab02 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aab09 expref: -99 pid: 25037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787550.089621:0:25037:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aab02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aab09 expref: -99 pid: 25037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787550.089670:0:25037:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787787550.089673:0:25037:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9870fc318800 10000000:01000000:3.0:1787787550.089677:0:25037:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9870fc318800 10000000:01000000:3.0:1787787550.089681:0:25037:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787787550.089686:0:25037:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9870fc318800 from 1 10000000:01000000:3.0:1787787550.089689:0:25037:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787787550.089747:0:25037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30aab10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787550.089756:0:25037:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30aab10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787550.089767:0:25037:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30aab10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787550.089788:0:25037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503818112:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787787550.089850:0:25037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787550.099005:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503818112 00000100:00100000:1.0:1787787550.099022:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503818112 00000100:00100000:1.0:1787787550.099125:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787787550.099135:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+23:25037:x1874630503818112:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787787550.099166:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787550.099187:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc43e1000/0x11620bc3f30aab17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aab10 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.099217:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc43e1000/0x11620bc3f30aab17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aab10 expref: 24 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.099319:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc43e1000/0x11620bc3f30aab17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aab10 expref: 24 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.099328:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc43e1000, rc 0) 00000100:00100000:1.0:1787787550.099532:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:25037:x1874630503818112:12345-0@lo:101:mount.lustre.0 Request processed in 397us (9681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787550.099540:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787787550.104641:0:25037:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1557600 going to sleep for 11 seconds 00000100:00100000:3.0:1787787550.104682:0:25037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503818112:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787787550.104721:0:25037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30aab10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aab17 expref: -99 pid: 25037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787550.104745:0:25037:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30aab10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aab17 expref: -99 pid: 25037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787787550.115118:0:25037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1787787550.115466:0:25037:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787787550.115683:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1787787550.115721:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1787787550.115747:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1787787550.115759:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1787787550.115770:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1787787550.115780:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1787787550.115794:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1787787550.115807:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1787787550.115818:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1787787550.115925:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1787787550.115942:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1787787550.115955:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1787787550.115983:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1787787550.115999:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1787787550.116013:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1787787550.116026:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1787787550.116038:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1787787550.116051:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1787787550.116063:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1787787550.116075:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1787787550.116087:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1787787550.116101:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1787787550.116112:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1787787550.116124:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1787787550.116135:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1787787550.116177:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1787787550.116190:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1787787550.116201:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1787787550.116225:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1787787550.116239:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1787787550.116251:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1787787550.116263:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1787787550.116276:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1787787550.116288:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1787787550.116300:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1787787550.116312:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1787787550.116323:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1787787550.116335:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1787787550.116346:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1787787550.116357:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1787787550.116368:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1787787550.116380:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1787787550.116402:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1787787550.116415:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1787787550.116438:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1787787550.116453:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1787787550.116465:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1787787550.116482:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1787787550.116595:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1787787550.116615:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1787787550.116632:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1787787550.116638:0:25037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1787787550.116750:0:25037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503818240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787550.116843:0:25037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787550.116892:0:25037:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9540 going to sleep for 11 seconds 00000100:00100000:2.0:1787787550.117360:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503818240 00000100:00100000:2.0:1787787550.117368:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503818240 00000100:00100000:2.0:1787787550.117423:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787787550.117443:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:25037:x1874630503818240:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787787550.117583:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:25037:x1874630503818240:12345-0@lo:501:mount.lustre.0 Request processed in 142us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787550.117591:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787787550.117899:0:25037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503818240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787787550.117939:0:25037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503818368:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787787550.117982:0:25037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787550.118002:0:25037:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc26e9540 going to sleep for 11 seconds 00000100:00100000:0.0:1787787550.118094:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503818368 00000100:00100000:0.0:1787787550.118099:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503818368 00000100:00100000:0.0:1787787550.118207:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787787550.118216:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:25037:x1874630503818368:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787787550.118298:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:25037:x1874630503818368:12345-0@lo:503:mount.lustre.0 Request processed in 83us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787550.118305:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787787550.118390:0:25037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503818368:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787787550.118812:0:25037:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787787550.118895:0:25037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503818496:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787787550.118937:0:25037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787550.119623:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503818496 00000100:00100000:2.0:1787787550.119630:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503818496 00000100:00100000:2.0:1787787550.119664:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787787550.119672:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:25037:x1874630503818496:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787787550.119968:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:25037:x1874630503818496:12345-0@lo:502:mount.lustre.0 Request processed in 296us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787550.119976:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787787550.120131:0:25037:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f5852d80 going to sleep for 11 seconds 00010000:00010000:1.0:1787787550.123502:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787550.123817:0:25037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503818496:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787787550.124083:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1787787550.124116:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1787787550.124131:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1787787550.124356:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1787787550.124384:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1787787550.124399:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1787787550.124430:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1787787550.124446:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1787787550.124459:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1787787550.124472:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1787787550.124485:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1787787550.124498:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1787787550.124510:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1787787550.124522:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1787787550.124535:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1787787550.124547:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1787787550.124559:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1787787550.124573:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1787787550.124587:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1787787550.124600:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1787787550.124616:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1787787550.124631:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1787787550.124660:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1787787550.124680:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1787787550.124705:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1787787550.124734:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1787787550.124753:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1787787550.124770:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1787787550.124788:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1787787550.124804:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1787787550.124822:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1787787550.124839:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1787787550.124853:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1787787550.124866:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1787787550.124880:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1787787550.124895:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1787787550.124908:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1787787550.124933:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1787787550.124959:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1787787550.124974:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1787787550.124988:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1787787550.125002:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1787787550.125016:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1787787550.125028:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1787787550.125039:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1787787550.125049:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1787787550.125059:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1787787550.125070:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1787787550.125121:0:25037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503818624:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787787550.126952:0:25037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787550.127045:0:25037:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1557600 going to sleep for 11 seconds 00000100:00100000:0.0:1787787550.130682:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503818624 00000100:00100000:0.0:1787787550.130697:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503818624 00000100:00100000:2.0:1787787550.130977:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787787550.130989:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:25037:x1874630503818624:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787787550.131262:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:25037:x1874630503818624:12345-0@lo:502:mount.lustre.0 Request processed in 275us (4319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787550.131270:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787787550.131388:0:25037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503818624:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787787550.131617:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1787787550.131647:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1787787550.131686:0:25037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503818752:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787787550.131745:0:25037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787550.131777:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503818752 00000100:00100000:3.0:1787787550.131782:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503818752 00000100:00100000:3.0:1787787550.131813:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787787550.131821:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:25037:x1874630503818752:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787787550.131902:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:25037:x1874630503818752:12345-0@lo:502:mount.lustre.0 Request processed in 81us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787550.131909:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787787550.131952:0:25037:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1557600 going to sleep for 11 seconds 00000100:00100000:3.0:1787787550.131965:0:25037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503818752:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787787550.132006:0:25037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1787787550.132015:0:25037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787787550.134956:0:25050:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787787550.134974:0:25050:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9870d22f19b8) 00000020:00000080:3.0:1787787550.135014:0:25050:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1787787550.135099:0:25050:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9870fc318800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787787550.135102:0:25050:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9870fc318800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787787550.135105:0:25050:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9870fc318800 3 00010000:00080000:3.0:1787787550.135134:0:25050:0:(ldlm_lib.c:102:import_set_conn()) imp ffff986fc41d0000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.131@tcp at head 00010000:00010000:3.0:1787787550.142569:0:25050:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1787787550.144306:0:25050:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787787550.144360:0:25050:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787787550.144373:0:25050:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x11620bc3f30aab25 00000100:00080000:3.0:1787787550.144386:0:25050:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787787550.144392:0:25050:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff986fc41d0000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:3.0:1787787550.144427:0:25050:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc36e8f00 x1874630503818880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787787550.144459:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1874630503818880:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787787550.144542:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787787550.144601:0:25050:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787787550.144654:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787550.144658:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787787550.144661:0:8:0:(import.c:65:import_set_state_nolock()) ffff9870c580d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787787550.144665:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 692 00000100:00080000:3.0:1787787550.144668:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787787550.144673:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9870c580d800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:3.0:1787787550.144686:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc36e8780 x1874630503819264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787787550.144752:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787787550.144755:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787787550.144756:0:8:0:(import.c:65:import_set_state_nolock()) ffff986fc43a7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787787550.144760:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 692 00000100:00080000:3.0:1787787550.144764:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787787550.144768:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff986fc43a7000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:3.0:1787787550.144780:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9870ed927c00 x1874630503819776/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787787550.144815:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503819136:0@lo:400:kworker.0 00000100:00100000:3.0:1787787550.144843:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787550.144862:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed924b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503819904:0@lo:400:kworker.0 00000100:00100000:3.0:1787787550.144881:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787550.144899:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787787550.144904:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503819008:0@lo:400:kworker.0 00000100:00100000:3.0:1787787550.144925:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787550.144942:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503819648:0@lo:400:kworker.0 00000100:00100000:3.0:1787787550.144960:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787550.144982:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503819392:0@lo:400:kworker.0 00000100:00100000:3.0:1787787550.145006:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787550.145024:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503820032:0@lo:400:kworker.0 00000100:00100000:3.0:1787787550.145048:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787550.145063:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787787550.145068:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503819520:0@lo:400:kworker.0 00000100:00100000:3.0:1787787550.145111:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787550.145131:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed926580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503820160:0@lo:400:kworker.0 00000100:00100000:3.0:1787787550.145183:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787550.145209:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503819136 00000100:00100000:3.0:1787787550.145216:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503819136 00000100:00100000:3.0:1787787550.145447:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503819648 00000100:00100000:3.0:1787787550.145451:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503819648 00000100:00100000:3.0:1787787550.145480:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787787550.145489:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed925e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503819136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787550.145495:0:24939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787787550.145508:0:24939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503819648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787550.145547:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed925e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503819136:12345-0@lo:400:kworker.0 Request processed in 59us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787550.145555:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787787550.145560:0:24939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503819648:12345-0@lo:400:kworker.0 Request processed in 55us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787550.145569:0:24939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787787550.145579:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503818880 00000100:00100000:3.0:1787787550.145584:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503818880 00000100:00100000:3.0:1787787550.145599:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503819904 00000100:00100000:3.0:1787787550.145601:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503819904 00000100:00100000:3.0:1787787550.145618:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503819392 00000100:00100000:3.0:1787787550.145620:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503819392 00000100:00100000:3.0:1787787550.145633:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503820032 00000100:00100000:3.0:1787787550.145636:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503820032 00000100:00100000:3.0:1787787550.145668:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503820160 00000100:00100000:3.0:1787787550.145671:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503820160 00000100:00100000:3.0:1787787550.145692:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787787550.145699:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed924f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503819904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787550.145741:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed924f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503819904:12345-0@lo:400:kworker.0 Request processed in 42us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787550.145747:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787787550.145758:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787787550.145763:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503819392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787550.145799:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503819392:12345-0@lo:400:kworker.0 Request processed in 36us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787550.145805:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787787550.145816:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787787550.145821:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503820032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787550.145844:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503820032:12345-0@lo:400:kworker.0 Request processed in 23us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787550.145850:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787787550.146019:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787787550.146027:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503820160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787550.146056:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503820160:12345-0@lo:400:kworker.0 Request processed in 31us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787550.146063:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787787550.146074:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787787550.146078:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1874630503818880:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787787550.146099:0:22716:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 694 last 0 00000020:00000080:3.0:1787787550.146166:0:22716:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x11620bc3f30aab2c 00000004:00100000:3.0:1787787550.146294:0:22716:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787787550.146326:0:22716:0:(import.c:65:import_set_state_nolock()) ffff986fc41d1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787787550.146358:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874630503818880:12345-0@lo:38:llog_process_th.0 Request processed in 278us (1817us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787550.146366:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787787550.146387:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503819008 00000100:00100000:3.0:1787787550.146391:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503819008 00000100:00100000:3.0:1787787550.146416:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503819520 00000100:00100000:3.0:1787787550.146424:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503819520 00000100:00100000:3.0:1787787550.146438:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787787550.146444:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503819008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787550.146475:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503819008:12345-0@lo:400:kworker.0 Request processed in 31us (1549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787550.146481:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787787550.146491:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787787550.146497:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503819520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787550.146521:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503819520:12345-0@lo:400:kworker.0 Request processed in 25us (1410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787550.146527:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787787550.146561:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503819264:0@lo:8:kworker.0 00000100:00100000:3.0:1787787550.146589:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787550.146606:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed927c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503819776:0@lo:8:kworker.0 00000100:00100000:3.0:1787787550.146624:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787787550.146651:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36e8f00 x1874630503818880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787787560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787550.146661:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787787550.146669:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1787787550.146677:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787787550.146682:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787787550.146684:0:3652:0:(import.c:65:import_set_state_nolock()) ffff986fc41d0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787787550.146690:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3652:1874630503818880:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787787550.146716:0:24939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503819264 00000100:00100000:3.0:1787787550.146719:0:24939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503819264 00000100:00100000:3.0:1787787550.146752:0:24939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503819776 00000100:00100000:3.0:1787787550.146755:0:24939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503819776 00000100:00100000:3.0:1787787550.146763:0:24939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787787550.146767:0:24939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3652:x1874630503819264:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787787550.146806:0:24939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3652:x1874630503819264:12345-0@lo:8:kworker.0 Request processed in 37us (216us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787787550.146811:0:24939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787787550.146821:0:24939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787787550.146825:0:24939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3652:x1874630503819776:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787787550.146849:0:24939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3652:x1874630503819776:12345-0@lo:8:kworker.0 Request processed in 23us (223us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787787550.146855:0:24939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1787787550.147425:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787787550.147430:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787787550.147435:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787550.147559:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503819008:0@lo:400:kworker.0 00000100:00100000:3.0:1787787550.147575:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503819648:0@lo:400:kworker.0 00000100:00100000:3.0:1787787550.147586:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503819136:0@lo:400:kworker.0 00010000:00080000:3.0:1787787550.147597:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ed924b40 x1874630503819904/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787550.147607:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed924b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503819904:0@lo:400:kworker.0 00000100:00100000:3.0:1787787550.147638:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503819520:0@lo:400:kworker.0 00010000:00080000:3.0:1787787550.147649:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ed926580 x1874630503820160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787550.147657:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed926580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503820160:0@lo:400:kworker.0 00010000:00080000:3.0:1787787550.147668:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ed9261c0 x1874630503819392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787550.147687:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503819392:0@lo:400:kworker.0 00010000:00080000:3.0:1787787550.147699:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870ed927480 x1874630503820032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787550.147707:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503820032:0@lo:400:kworker.0 00000100:00100000:3.0:1787787550.147749:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787787550.147754:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870c580d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787787550.147758:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787787550.147762:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503819264:0@lo:8:kworker.0 00000100:00100000:3.0:1787787550.147771:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787787550.147774:0:3652:0:(import.c:65:import_set_state_nolock()) ffff986fc43a7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787787550.147778:0:3652:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787787550.147781:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed927c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503819776:0@lo:8:kworker.0 00000020:01000004:3.0:1787787550.148259:0:25050:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787787550.148275:0:25050:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff986fc38c4d28) 00000020:00000080:3.0:1787787550.148296:0:25050:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1787787550.148384:0:25050:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9870fc318800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787787550.148388:0:25050:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9870fc318800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787787550.148391:0:25050:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9870fc318800 3 00010000:00080000:3.0:1787787550.148417:0:25050:0:(ldlm_lib.c:102:import_set_conn()) imp ffff986fc41d6000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.131@tcp at head 00010000:00010000:3.0:1787787550.150517:0:25050:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1787787550.151348:0:25050:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1787787550.151413:0:25050:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787787550.151425:0:25050:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x11620bc3f30aab3a 00000100:00080000:2.0:1787787550.151436:0:25050:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787787550.151443:0:25050:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff986fc41d6000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:2.0:1787787550.151486:0:25050:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc24b4000 x1874630503820288/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787787550.151511:0:25050:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1787787550.153243:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3652:1874630503820288:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787787550.153344:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1787787550.156315:0:25050:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000100:00100000:3.0:1787787550.156561:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503820288 00000100:00100000:3.0:1787787550.156573:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503820288 00000100:00100000:3.0:1787787550.156624:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787787550.156633:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc24b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3652:x1874630503820288:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787787550.156676:0:22716:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 694 last 0 00000020:00000080:3.0:1787787550.156712:0:22716:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x11620bc3f30aab41 00000004:00100000:3.0:1787787550.156740:0:22716:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787787550.156774:0:22716:0:(import.c:65:import_set_state_nolock()) ffff986fc41d4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787787550.156878:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc24b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874630503820288:12345-0@lo:38:llog_process_th.0 Request processed in 246us (3535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787550.156886:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787787550.156940:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc24b4000 x1874630503820288/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787787560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787550.156963:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787787550.156973:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1787787550.156980:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787787550.156984:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787787550.156987:0:3652:0:(import.c:65:import_set_state_nolock()) ffff986fc41d6000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787787550.156994:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3652:1874630503820288:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1787787550.157024:0:25037:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787787550.157062:0:25037:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787787550.157078:0:25037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30aab10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aab17 expref: -99 pid: 25037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787550.157090:0:25037:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c13f4800/0x11620bc3f30aab10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aab17 expref: -99 pid: 25037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787787550.157567:0:25037:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787787550.157570:0:25037:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787787550.157572:0:25037:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787550.157574:0:25037:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787550.157579:0:25037:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787550.157582:0:25037:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787550.157583:0:25037:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787787550.157584:0:25037:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787550.157585:0:25037:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787787550.157589:0:25037:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1787787550.157592:0:25037:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787787550.157593:0:25037:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787787550.157594:0:25037:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787787550.157595:0:25037:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787787550.157596:0:25037:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787787550.157596:0:25037:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787787550.157597:0:25037:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787787550.157598:0:25037:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787787550.157599:0:25037:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787787550.157622:0:25037:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787787550.157640:0:25037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503820416:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787787550.157697:0:25037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787550.157743:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503820416 00000100:00100000:3.0:1787787550.157747:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503820416 00000100:00100000:3.0:1787787550.157787:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787787550.157796:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:25037:x1874630503820416:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787787550.157818:0:22706:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787787550.157835:0:22706:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787787550.158841:0:25037:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d1557cc0 going to sleep for 11 seconds 20000000:01000000:3.0:1787787550.162537:0:22706:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787787550.162562:0:22706:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787787550.162659:0:22730:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787787550.162666:0:22730:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787787550.162689:0:22730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff986fc43e0200/0x11620bc3f30aab48 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.162710:0:22730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff987101ee3000/0x11620bc3f30aa9dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa9d5 expref: 24 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.162719:0:22730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aa9ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa9e3 expref: 24 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787550.163088:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:25037:x1874630503820416:12345-0@lo:253:mount.lustre.0 Request processed in 5291us (5388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787550.163100:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00010000:1.0:1787787550.163415:0:22730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff986fc43e0200/0x11620bc3f30aab48 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.163458:0:22730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aa9ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30aa9e3 expref: 23 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.163473:0:22730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aa9ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30aa9e3 expref: 23 pid: 22707 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787550.163500:0:22730:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ed2c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22730:1874630503820544:0@lo:104: 00000100:00100000:1.0:1787787550.163536:0:22730:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787787550.163585:0:22730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff987101ee3000/0x11620bc3f30aa9dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30aa9d5 expref: 23 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.163594:0:22730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff987101ee3000/0x11620bc3f30aa9dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30aa9d5 expref: 23 pid: 22707 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787550.163604:0:25037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3fd2c107-7647-408e-8048-4ef16ee44cbc:25037:1874630503820416:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787787550.163604:0:22730:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ef0c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22730:1874630503820672:0@lo:104: 10000000:01000000:2.0:1787787550.163622:0:25037:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787787550.163625:0:25037:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787787550.163627:0:25037:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787787550.163629:0:25037:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787787550.163630:0:25037:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787787550.163632:0:25037:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787787550.163634:0:25037:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787787550.163636:0:25037:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787787550.163638:0:25037:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787787550.163640:0:25037:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1787787550.163649:0:22730:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:02000000:2.0:1787787550.163658:0:25037:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787787550.163668:0:22730:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d2379240 going to sleep for 11 seconds 00000100:00100000:1.0:1787787550.163689:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503820544 00000100:00100000:1.0:1787787550.163695:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503820544 00000100:00100000:1.0:1787787550.163736:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503820672 00000100:00100000:1.0:1787787550.163739:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503820672 00000100:00100000:1.0:1787787550.163753:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787787550.163763:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ed680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3fd2c107-7647-408e-8048-4ef16ee44cbc+4:22730:x1874630503820544:12345-0@lo:104: 00010000:00010000:1.0:1787787550.164927:0:22697:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870f6659000/0x11620bc3f30aa9e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa9ea expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.165158:0:22697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787787550.165167:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ed680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3fd2c107-7647-408e-8048-4ef16ee44cbc+4:22730:x1874630503820544:12345-0@lo:104: Request processed in 1403us (1629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787550.165321:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787787550.165350:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787787550.165361:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3fd2c107-7647-408e-8048-4ef16ee44cbc+3:22730:x1874630503820672:12345-0@lo:104: 00010000:00010000:1.0:1787787550.165374:0:22697:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870f6658600/0x11620bc3f30aa9d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa9dc expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.165417:0:22697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787787550.165423:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3fd2c107-7647-408e-8048-4ef16ee44cbc+3:22730:x1874630503820672:12345-0@lo:104: Request processed in 66us (1776us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787550.165430:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1787787550.165450:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787787550.165458:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870f6659000/0x11620bc3f30aa9e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa9ea expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.165467:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6659000 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:1.0:1787787550.165472:0:22702:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870f6659000/0x11620bc3f30aa9e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30aa9ea expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.165480:0:22702:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870f6659000/0x11620bc3f30aa9e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30aa9ea expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787550.165487:0:22702:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870f6659000/0x11620bc3f30aa9e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30aa9ea expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787550.165492:0:22702:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787787550.165528:0:22702:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870f6659000/0x11620bc3f30aa9e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa9ea expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.165535:0:22702:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787550.165559:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870f6659000/0x11620bc3f30aa9e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa9ea expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.165568:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870f6659000/0x11620bc3f30aa9e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa9ea expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.165592:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787550.165596:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870f6658600/0x11620bc3f30aa9d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa9dc expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.165601:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6658600 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:1.0:1787787550.165605:0:22702:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870f6658600/0x11620bc3f30aa9d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30aa9dc expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.165612:0:22702:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870f6658600/0x11620bc3f30aa9d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30aa9dc expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787787550.165618:0:22702:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870f6658600/0x11620bc3f30aa9d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30aa9dc expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787787550.165624:0:22702:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787787550.165638:0:22702:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870f6658600/0x11620bc3f30aa9d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa9dc expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.165644:0:22702:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787787550.165652:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870f6658600/0x11620bc3f30aa9d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa9dc expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.165659:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870f6658600/0x11620bc3f30aa9d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa9dc expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.165673:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787550.165675:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787550.165677:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787550.165685:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787550.165712:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3fd2c107-7647-408e-8048-4ef16ee44cbc:3653:1874630503820800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787550.165767:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787550.167547:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787550.167563:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3fd2c107-7647-408e-8048-4ef16ee44cbc:3653:1874630503820928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787787550.167610:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787550.167656:0:23473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503820800 00000100:00100000:1.0:1787787550.167666:0:23473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503820800 00010000:00010000:1.0:1787787550.167710:0:23473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aa9ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa9e3 expref: 24 pid: 22707 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787550.167793:0:23473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503820928 00000100:00100000:1.0:1787787550.167798:0:23473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503820928 00010000:00010000:1.0:1787787550.167813:0:23473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff987101ee3000/0x11620bc3f30aa9dc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa9d5 expref: 25 pid: 22707 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787550.167836:0:23473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787787550.167846:0:23473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ef840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2c107-7647-408e-8048-4ef16ee44cbc+25:3653:x1874630503820800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787787550.167870:0:23473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787550.167876:0:23473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aa9ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa9e3 expref: 25 pid: 22707 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.167889:0:23473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aa9ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30aa9e3 expref: 25 pid: 22707 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.167911:0:23473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787550.167965:0:23473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ef840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2c107-7647-408e-8048-4ef16ee44cbc+25:3653:x1874630503820800:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (2197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787550.167973:0:23473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787787550.167993:0:23473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787787550.168000:0:23473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ee580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:3653:x1874630503820928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787787550.168017:0:23473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787550.168022:0:23473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff987101ee3000/0x11620bc3f30aa9dc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa9d5 expref: 24 pid: 22707 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.168033:0:23473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff987101ee3000/0x11620bc3f30aa9dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30aa9d5 expref: 24 pid: 22707 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.168046:0:23473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff986fc43e0200/0x11620bc3f30aab48 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.168056:0:23473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc43e0200/0x11620bc3f30aab48 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787787550.168071:0:23473:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011767675s 00010000:00010000:1.0:1787787550.168076:0:23473:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff986fc43e0200/0x11620bc3f30aab48 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787550.168821:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3fd2c107-7647-408e-8048-4ef16ee44cbc:3653:1874630503820800:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787550.169269:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aa9ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30aa9e3 expref: 24 pid: 22707 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.169275:0:23473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff986fc43e0200/0x11620bc3f30aab48 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787550.169286:0:22730:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ed2c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22730:1874630503820544:0@lo:104: 00010000:00010000:1.0:1787787550.169287:0:23473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff986fc43e0200/0x11620bc3f30aab48 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787550.169300:0:22730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff987101ee3000/0x11620bc3f30aa9dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30aa9d5 expref: 23 pid: 22707 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787550.169309:0:22730:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ef0c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22730:1874630503820672:0@lo:104: 00010000:00010000:1.0:1787787550.169416:0:23473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff986fc43e0200/0x11620bc3f30aab48 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1787787550.169967:0:25037:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00010000:1.0:1787787550.170045:0:23473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc43e0200 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787550.170046:0:22730:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff986fc43e0200/0x11620bc3f30aab48 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.170054:0:23473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff986fc43e0200/0x11620bc3f30aab48 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787550.170060:0:22730:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff986fc43e0200/0x11620bc3f30aab48 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.170068:0:23473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff986fc43e0200/0x11620bc3f30aab48 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787550.170069:0:22730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff986fc43e0200/0x11620bc3f30aab48 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.172346:0:23473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff986fc43e0200/0x11620bc3f30aab48 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.172358:0:23473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc43e0200/0x11620bc3f30aab48 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787550.172381:0:23473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787550.172512:0:23473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ee580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3fd2c107-7647-408e-8048-4ef16ee44cbc+22:3653:x1874630503820928:12345-0@lo:103:ldlm_bl.0 Request processed in 4508us (4897us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787550.172523:0:23473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787787550.172675:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3fd2c107-7647-408e-8048-4ef16ee44cbc:3653:1874630503820928:0@lo:103:ldlm_bl.0 00002000:00080000:0.0:1787787550.182488:0:25037:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787787550.182500:0:25037:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787787550.182541:0:25037:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787787550.182584:0:25037:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.131@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787787550.182607:0:25037:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1787787550.182631:0:25037:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1787787550.183521:0:25037:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787787550.183771:0:25037:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787787551.085197:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503821056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787787551.085277:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787551.085363:0:24224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503821056 00000100:00100000:3.0:1787787551.085387:0:24224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503821056 00000100:00100000:3.0:1787787551.085439:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787787551.085448:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503821056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787787551.085486:0:24224:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787787551.085536:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503821056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787551.085545:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787787551.085598:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503821056:0@lo:13:osp-pre-0-0.0 00000020:00000004:3.0:1787787551.114969:0:25105:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787787551.120405:0:25105:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787787551.146047:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787787551.851713:0:22711:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787787551.851721:0:22711:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9870f576f800 from 14 10000000:01000000:3.0:1787787551.851727:0:22711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787787551.851779:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f4000/0x11620bc3f30aab4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787551.851792:0:22711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9870c13f4000/0x11620bc3f30aab4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787551.851819:0:22711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9870c13f4000/0x11620bc3f30aab4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787551.851846:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41ce940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503821184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787787551.851925:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787551.851975:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d84d76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787551.852028:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503821184 00000100:00100000:1.0:1787787551.852037:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503821184 00000100:00100000:1.0:1787787551.852092:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787787551.852103:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+22:22711:x1874630503821184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787551.852128:0:22708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787551.852175:0:22708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc43e0200/0x11620bc3f30aab56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aab4f expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787551.852216:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc43e0200/0x11620bc3f30aab56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aab4f expref: 23 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787551.852228:0:22708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc43e0200/0x11620bc3f30aab56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aab4f expref: 23 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787551.852237:0:22708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc43e0200, rc 0) 00000100:00100000:1.0:1787787551.852286:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+23:22711:x1874630503821184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787551.852342:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41ce940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503821184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787551.852359:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9870c13f4000/0x11620bc3f30aab4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aab56 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787551.852368:0:22711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9870c13f4000/0x11620bc3f30aab4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aab56 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787551.852427:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503821312:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787787551.852463:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787551.852468:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787787551.852489:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc371b540 going to sleep for 11 seconds 00000100:00100000:1.0:1787787551.852502:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503821312 00000100:00100000:1.0:1787787551.852507:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503821312 00000100:00100000:1.0:1787787551.852522:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787787551.852527:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+23:22711:x1874630503821312:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787787551.852540:0:22708:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787787551.852557:0:22708:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787787551.852560:0:22708:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1787787551.852650:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+23:22711:x1874630503821312:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 121us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787551.852657:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787787551.852715:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503821312:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787787551.853402:0:22711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787787551.853411:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9870c13f4000/0x11620bc3f30aab4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aab56 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787551.853421:0:22711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9870c13f4000/0x11620bc3f30aab4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aab56 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787551.853430:0:22711:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787787551.853433:0:22711:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff986fc2938000 from 14 10000000:01000000:2.0:1787787551.853436:0:22711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787787551.853458:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee2e00/0x11620bc3f30aab5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787551.853466:0:22711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff987101ee2e00/0x11620bc3f30aab5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787551.853485:0:22711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff987101ee2e00/0x11620bc3f30aab5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787551.853501:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503821440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787787551.853542:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787551.853579:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc371b540 going to sleep for 11 seconds 00000100:00100000:1.0:1787787551.853729:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503821440 00000100:00100000:1.0:1787787551.853735:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503821440 00000100:00100000:1.0:1787787551.853777:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787787551.853786:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+23:22711:x1874630503821440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787551.853955:0:22708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787551.853968:0:22708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc43e0000/0x11620bc3f30aab64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aab5d expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787551.853988:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc43e0000/0x11620bc3f30aab64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aab5d expref: 24 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787551.853998:0:22708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc43e0000/0x11620bc3f30aab64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aab5d expref: 24 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787551.854005:0:22708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc43e0000, rc 0) 00000100:00100000:1.0:1787787551.854054:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:22711:x1874630503821440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 268us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787551.854070:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787787551.855569:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503821440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787551.855597:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff987101ee2e00/0x11620bc3f30aab5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aab64 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787551.855608:0:22711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff987101ee2e00/0x11620bc3f30aab5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aab64 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787551.855682:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503821568:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787787551.855763:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787551.855806:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc371b540 going to sleep for 11 seconds 00000100:00100000:1.0:1787787551.857941:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503821568 00000100:00100000:1.0:1787787551.857955:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503821568 00000100:00100000:1.0:1787787551.858009:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787787551.858019:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:22711:x1874630503821568:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787787551.858046:0:22706:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787787551.858064:0:22706:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787787551.858067:0:22706:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1787787551.858426:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:22711:x1874630503821568:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 407us (2662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787551.858433:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787787551.858556:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503821568:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787787551.858628:0:22711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787787551.858637:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee2e00/0x11620bc3f30aab5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aab64 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787551.858648:0:22711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff987101ee2e00/0x11620bc3f30aab5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aab64 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787552.171878:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787787552.426093:0:22750:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787787553.137330:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787787553.137355:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503821824:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787787553.137436:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787553.145549:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503821952:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787787553.145638:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787553.145809:0:24224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503821952 00000100:00100000:0.0:1787787553.145818:0:24224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503821952 00000100:00100000:0.0:1787787553.145882:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787787553.145893:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503821952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787787553.145925:0:24224:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787787553.145984:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff987101f7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503821696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787787553.146015:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787553.146055:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503821824 00000100:00100000:3.0:1787787553.146069:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503821824 00000100:00100000:3.0:1787787553.146117:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503821696 00000100:00100000:3.0:1787787553.146120:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503821696 00000100:00100000:3.0:1787787553.146134:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787787553.146160:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503821824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787787553.146185:0:23456:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787787553.146299:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787787553.146309:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503821696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787787553.146335:0:22719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787787553.146391:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503821696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787553.146399:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787787553.146458:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff987101f7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503821696:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787553.153440:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503821952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7539us (7792us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787553.153457:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787787553.158267:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503821952:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787787553.159493:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503821824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 13327us (22050us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787553.159506:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1787787553.163113:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787553.170883:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503821824:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787787553.202751:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787787554.028794:0:23468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787787554.221029:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787787555.181484:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787555.181491:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787787555.181496:0:38:0:(import.c:65:import_set_state_nolock()) ffff9870c580d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787787555.181508:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9870c580d800 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:2.0:1787787555.181530:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc43f9e00 x1874630503822464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787787555.181561:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787787555.181564:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787787555.181566:0:38:0:(import.c:65:import_set_state_nolock()) ffff986fc43a7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787787555.181570:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff986fc43a7000 using connection 192.168.204.131@tcp/0@lo 00000100:00100000:2.0:1787787555.181580:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff986fc418c780 x1874630503822976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787787555.181644:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503822208:0@lo:400:kworker.0 00000100:00100000:1.0:1787787555.182012:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503822592:0@lo:400:kworker.0 00000100:00100000:3.0:1787787555.182077:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3fd2c107-7647-408e-8048-4ef16ee44cbc:3655:1874630503822080:0@lo:400:kworker.0 00000100:00100000:1.0:1787787555.184391:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787555.184438:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874630503823232:0@lo:400:kworker.0 00000100:00100000:1.0:1787787555.184467:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787555.184496:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787787555.184503:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503822336:0@lo:400:kworker.0 00000100:00100000:1.0:1787787555.184540:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787555.184558:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503823104:0@lo:400:kworker.0 00000100:00100000:1.0:1787787555.184580:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787555.184608:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874630503823616:0@lo:400:kworker.0 00000100:00100000:1.0:1787787555.184645:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787555.184700:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503822592 00000100:00100000:1.0:1787787555.184706:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503822592 00000100:00100000:1.0:1787787555.184744:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503823232 00000100:00100000:1.0:1787787555.184748:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503823232 00000100:00100000:1.0:1787787555.184770:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503823104 00000100:00100000:1.0:1787787555.184772:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503823104 00000100:00100000:1.0:1787787555.184782:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503823616 00000100:00100000:1.0:1787787555.184784:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503823616 00000100:00100000:1.0:1787787555.184798:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787787555.184806:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503822592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787555.184868:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874630503822592:12345-0@lo:400:kworker.0 Request processed in 63us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787555.184875:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787787555.184890:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787787555.184896:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874630503823232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787555.184922:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874630503823232:12345-0@lo:400:kworker.0 Request processed in 27us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787555.184928:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787787555.184938:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787787555.184944:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc48983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503823104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787555.184968:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc48983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874630503823104:12345-0@lo:400:kworker.0 Request processed in 24us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787555.184983:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787787555.184995:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787787555.185001:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4898f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874630503823616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787555.185027:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4898f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874630503823616:12345-0@lo:400:kworker.0 Request processed in 28us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787555.185033:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787787555.185053:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503822336 00000100:00100000:1.0:1787787555.185057:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503822336 00000100:00100000:1.0:1787787555.185085:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787787555.185091:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36efc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503822336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787555.185119:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36efc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503822336:12345-0@lo:400:kworker.0 Request processed in 29us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787555.185124:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787787555.188199:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787787555.188209:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787787555.188212:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787787555.188263:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503822336:0@lo:400:kworker.0 00010000:00080000:1.0:1787787555.188281:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc418cb40 x1874630503823104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787555.188292:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874630503823104:0@lo:400:kworker.0 00010000:00080000:1.0:1787787555.188305:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc3b3c00 x1874630503823616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787555.188314:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3654:1874630503823616:0@lo:400:kworker.0 00010000:00080000:1.0:1787787555.188325:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc43fa580 x1874630503822592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787555.188341:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874630503822592:0@lo:400:kworker.0 00010000:00080000:1.0:1787787555.188354:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc418cf00 x1874630503823232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787555.188362:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3654:1874630503823232:0@lo:400:kworker.0 00000100:00100000:3.0:1787787555.192373:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787555.192419:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503822720:0@lo:400:kworker.0 00000100:00100000:3.0:1787787555.192449:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787555.192469:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503823360:0@lo:400:kworker.0 00000100:00100000:3.0:1787787555.192488:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787555.192520:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503822464:0@lo:8:kworker.0 00000100:00100000:3.0:1787787555.192540:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787555.192555:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503822976:0@lo:8:kworker.0 00000100:00100000:3.0:1787787555.192571:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787555.192607:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503822720 00000100:00100000:3.0:1787787555.192614:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503822720 00000100:00100000:1.0:1787787555.192731:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503822080 00000100:00100000:1.0:1787787555.192735:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503822080 00000100:00100000:1.0:1787787555.192773:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787787555.192781:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:3655:x1874630503822080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787555.192830:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:3655:x1874630503822080:12345-0@lo:400:kworker.0 Request processed in 50us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787555.192837:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787787555.192865:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503823360 00000100:00100000:1.0:1787787555.192868:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503823360 00000100:00100000:1.0:1787787555.192895:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787787555.192900:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503823360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787555.192926:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3655:x1874630503823360:12345-0@lo:400:kworker.0 Request processed in 26us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787555.192932:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787787555.192947:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787787555.192971:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3fd2c107-7647-408e-8048-4ef16ee44cbc:3655:1874630503822080:0@lo:400:kworker.0 00010000:00080000:1.0:1787787555.192985:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc418e940 x1874630503823360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787555.192997:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3655:1874630503823360:0@lo:400:kworker.0 00000100:00100000:3.0:1787787555.193111:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787787555.193118:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503822720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787555.193173:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503822720:12345-0@lo:400:kworker.0 Request processed in 55us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787555.193188:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787787555.193206:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503822464 00000100:00100000:3.0:1787787555.193210:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503822464 00000100:00100000:3.0:1787787555.193222:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503822976 00000100:00100000:3.0:1787787555.193224:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503822976 00000100:00100000:3.0:1787787555.193235:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787787555.193239:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3652:x1874630503822464:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787787555.193265:0:24220:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 699 last 0 00000020:00000080:3.0:1787787555.193290:0:24220:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x11620bc3f30aab6b 00002000:00100000:3.0:1787787555.193302:0:24220:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff986fc41d4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113934 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787787555.193306:0:24220:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787787555.193309:0:24220:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787787555.193456:0:24220:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787787555.193478:0:24220:0:(import.c:65:import_set_state_nolock()) ffff986fc41d3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787787555.193512:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1874630503822464:12345-0@lo:8:kworker.0 Request processed in 272us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787555.193518:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787787555.193529:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787787555.193533:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3652:x1874630503822976:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787787555.193546:0:24220:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 699 last 0 00000020:00000080:3.0:1787787555.193558:0:24220:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x11620bc3f30aab72 00002000:00100000:3.0:1787787555.193563:0:24220:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff986fc41d5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113934 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1787787555.193566:0:24220:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1787787555.193568:0:24220:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787787555.193584:0:24220:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00100000:1.0:1787787555.193703:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503822720:0@lo:400:kworker.0 00000100:00080000:3.0:1787787555.193744:0:24220:0:(import.c:65:import_set_state_nolock()) ffff986fc41d2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787787555.193770:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3652:x1874630503822976:12345-0@lo:8:kworker.0 Request processed in 236us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787555.193777:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1787787555.193803:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc43f9e00 x1874630503822464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787787580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787787555.193816:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787787555.193822:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787787555.193827:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787787555.193829:0:3652:0:(import.c:65:import_set_state_nolock()) ffff9870c580d800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787787555.193854:0:3652:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787787555.193858:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3652:1874630503822464:0@lo:8:kworker.0 00010000:00080000:3.0:1787787555.193869:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc418c780 x1874630503822976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787787580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787787555.193877:0:3652:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1787787555.193881:0:3652:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787787555.193883:0:3652:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787787555.193885:0:3652:0:(import.c:65:import_set_state_nolock()) ffff986fc43a7000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787787555.193898:0:3652:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787787555.193901:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3652:1874630503822976:0@lo:8:kworker.0 00000004:00080000:1.0:1787787555.194059:0:22741:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:1.0:1787787555.194075:0:22741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489a580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22741:1874630503823872:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787787555.194101:0:22741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787555.194116:0:22741:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc371b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787555.194125:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787555.194131:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4899680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503823744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787555.194173:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787555.194197:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503823872 00000100:00100000:1.0:1787787555.194201:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503823872 00000100:00100000:1.0:1787787555.194227:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787787555.194233:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22741:x1874630503823872:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787787555.194419:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503823744 00000100:00100000:1.0:1787787555.194423:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503823744 00000100:00100000:1.0:1787787555.194444:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787787555.194450:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4899a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1874630503823744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787787555.194464:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787787555.194499:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4899a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1874630503823744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787555.194505:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787787555.194520:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787787555.194540:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc4899680 x1874630503823744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787555.194554:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4899680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503823744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787787555.195530:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787787555.195618:0:23460:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787787555.195645:0:23460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b0b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23460:1874630503824128:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1787787555.195674:0:23460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787555.195691:0:23460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d84d76c0 going to sleep for 11 seconds 00000004:00080000:2.0:1787787555.195711:0:23459:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787787555.195782:0:23459:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 699377643382ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787787555.195788:0:23459:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1787787555.195915:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503824128 00000100:00100000:2.0:1787787555.195920:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503824128 00000100:00100000:2.0:1787787555.195961:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787787555.195967:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23460:x1874630503824128:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1787787555.196011:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503822848:0@lo:400:kworker.0 00000100:00100000:2.0:1787787555.196037:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787555.196051:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503823488:0@lo:400:kworker.0 00000100:00100000:2.0:1787787555.196076:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787555.196092:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787787555.196098:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503824000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787787555.196117:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787787555.196301:0:22740:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787787555.196349:0:22740:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 699378209751ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787787555.196354:0:22740:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:1.0:1787787555.199000:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787787555.199030:0:24939:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1787787555.199040:0:24939:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1787787555.199059:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503823488 00000100:00100000:1.0:1787787555.199067:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503823488 00000100:00100000:1.0:1787787555.199118:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787787555.199128:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503823488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787555.199253:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503823488:12345-0@lo:400:kworker.0 Request processed in 126us (3175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787555.199260:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787787555.199283:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503824000 00000100:00100000:1.0:1787787555.199287:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503824000 00000100:00100000:1.0:1787787555.199310:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787787555.199316:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3656:x1874630503824000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787787555.199332:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787787555.199362:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3656:x1874630503824000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (3243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787555.199368:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1787787555.199473:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787787555.199522:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc3b3480 x1874630503824000/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787787571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787555.199543:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503824000:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1787787555.199562:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870fc3b3840 x1874630503823488/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787555.199571:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503823488:0@lo:400:kworker.0 00000100:00100000:1.0:1787787555.199612:0:24939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503822848 00000100:00100000:1.0:1787787555.199615:0:24939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503822848 00000100:00100000:1.0:1787787555.199655:0:24939:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1787787555.199672:0:24939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787787555.199684:0:24939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503822848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787555.199723:0:24939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503822848:12345-0@lo:400:kworker.0 Request processed in 46us (3685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787555.199730:0:24939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787787555.199744:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787555.199764:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503822848:0@lo:400:kworker.0 00000100:00100000:3.0:1787787555.200371:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503822208 00000100:00100000:3.0:1787787555.200379:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503822208 00000100:00100000:2.0:1787787555.200933:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787787555.200942:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503822208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787787555.201006:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503822208:12345-0@lo:400:kworker.0 Request processed in 65us (5478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787555.201013:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787787555.201546:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503822208:0@lo:400:kworker.0 00000004:00080000:3.0:1787787555.202563:0:23448:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:1.0:1787787555.202898:0:22694:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1787787555.204841:0:24221:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1787787555.204854:0:24221:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:3.0:1787787555.204861:0:24221:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:65) 00002000:00010000:2.0:1787787555.218748:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787787555.218760:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc213333/0x11620bc3f30aab79 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.218777:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=699s v=(0 0) 00010000:00010000:2.0:1787787555.218783:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787555.218789:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc213333/0x11620bc3f30aab79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.218820:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc213333/0x11620bc3f30aab79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.218832:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc213333/0x11620bc3f30aab79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.218840:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc213333/0x11620bc3f30aab79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.218860:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787555.218873:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787555.218879:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc213333/0x11620bc3f30aab79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.218887:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2c00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787555.218892:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc213333/0x11620bc3f30aab79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.218901:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc213333/0x11620bc3f30aab79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.218918:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc213333/0x11620bc3f30aab79 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.218927:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc213333/0x11620bc3f30aab79 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.218950:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.218952:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.218953:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787787555.219758:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787787555.219766:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000671b88fd/0x11620bc3f30aab80 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.219777:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=699s v=(0 0) 00010000:00010000:2.0:1787787555.219780:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787555.219785:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000671b88fd/0x11620bc3f30aab80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.219795:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000671b88fd/0x11620bc3f30aab80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.219802:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000671b88fd/0x11620bc3f30aab80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.219810:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000671b88fd/0x11620bc3f30aab80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.219827:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787555.219835:0:24527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787555.219840:0:24527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000671b88fd/0x11620bc3f30aab80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.219858:0:24527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2000 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787555.219862:0:24527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000671b88fd/0x11620bc3f30aab80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.219870:0:24527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000671b88fd/0x11620bc3f30aab80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.219882:0:24527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000671b88fd/0x11620bc3f30aab80 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.219890:0:24527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000671b88fd/0x11620bc3f30aab80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.219903:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.219905:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.219907:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787787555.220218:0:24220:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1787787555.220224:0:24220:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1787787555.220316:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23460:x1874630503824128:12345-0@lo:7:osp-pre-1-1.0 Request processed in 24345us (24636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787555.220326:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787787555.220452:0:23460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b0b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23460:1874630503824128:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1787787555.220467:0:23460:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1787787555.220508:0:23460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b0b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23460:1874630503824256:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1787787555.220544:0:23460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787555.220570:0:23460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c81c6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787787555.220588:0:24939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503824256 00000100:00100000:2.0:1787787555.220593:0:24939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503824256 00000100:00100000:2.0:1787787555.220641:0:24939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787787555.220649:0:24939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23460:x1874630503824256:12345-0@lo:5:osp-pre-1-1.0 00002000:00010000:0.0:1787787555.221854:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787555.221864:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028ec4075/0x11620bc3f30aab87 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.221889:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=699s v=(0 0) 00010000:00010000:0.0:1787787555.221893:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787555.221899:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028ec4075/0x11620bc3f30aab87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.221913:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028ec4075/0x11620bc3f30aab87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.221922:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028ec4075/0x11620bc3f30aab87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.221930:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028ec4075/0x11620bc3f30aab87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.221948:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787787555.221961:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787555.221966:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028ec4075/0x11620bc3f30aab87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.221974:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15200 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787555.221978:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028ec4075/0x11620bc3f30aab87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.221987:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028ec4075/0x11620bc3f30aab87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.222012:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028ec4075/0x11620bc3f30aab87 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.222020:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028ec4075/0x11620bc3f30aab87 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.222036:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787555.222039:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787555.222041:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787787555.223450:0:24939:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1787787555.223578:0:24939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23460:x1874630503824256:12345-0@lo:5:osp-pre-1-1.0 Request processed in 2923us (3027us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787555.223589:0:24939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787787555.223676:0:23460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b0b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23460:1874630503824256:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1787787555.223691:0:23460:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1787787555.223734:0:23460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b0b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23460:1874630503824384:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1787787555.223767:0:23460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787555.223792:0:23460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c81c6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787787555.224560:0:25288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503824384 00000100:00100000:2.0:1787787555.224569:0:25288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503824384 00000100:00100000:2.0:1787787555.224621:0:25288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787787555.224641:0:25288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23460:x1874630503824384:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1787787555.224688:0:25288:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:0.0:1787787555.226385:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787555.226397:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001623d64d/0x11620bc3f30aab8e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.226413:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=699s v=(0 0) 00010000:00010000:0.0:1787787555.226418:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787555.226426:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001623d64d/0x11620bc3f30aab8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.226440:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001623d64d/0x11620bc3f30aab8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.226451:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001623d64d/0x11620bc3f30aab8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.226458:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001623d64d/0x11620bc3f30aab8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.226489:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787555.227069:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787555.227077:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001623d64d/0x11620bc3f30aab8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.227085:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14800 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787555.227090:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001623d64d/0x11620bc3f30aab8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.227100:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001623d64d/0x11620bc3f30aab8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.227118:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001623d64d/0x11620bc3f30aab8e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.227133:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001623d64d/0x11620bc3f30aab8e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.227181:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.227183:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.227185:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787555.231117:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787555.231132:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6ff0916/0x11620bc3f30aab95 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.231195:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=699s v=(0 0) 00010000:00010000:0.0:1787787555.231199:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787555.231206:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6ff0916/0x11620bc3f30aab95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.231221:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6ff0916/0x11620bc3f30aab95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.231231:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6ff0916/0x11620bc3f30aab95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.231239:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6ff0916/0x11620bc3f30aab95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.231257:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787555.231695:0:24527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787555.231708:0:24527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6ff0916/0x11620bc3f30aab95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787555.231717:0:24527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15a00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787555.231721:0:24527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6ff0916/0x11620bc3f30aab95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787555.231730:0:24527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6ff0916/0x11620bc3f30aab95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787555.231749:0:24527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6ff0916/0x11620bc3f30aab95 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787555.231757:0:24527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6ff0916/0x11620bc3f30aab95 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787555.231774:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787555.231776:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787555.231777:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787555.231914:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787555.231920:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efa2a8da/0x11620bc3f30aab9c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.231929:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=699s v=(0 0) 00010000:00010000:0.0:1787787555.231938:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787555.231942:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efa2a8da/0x11620bc3f30aab9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.231952:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efa2a8da/0x11620bc3f30aab9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.231960:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efa2a8da/0x11620bc3f30aab9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.231968:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efa2a8da/0x11620bc3f30aab9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.231984:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787787555.232306:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787555.232312:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039650035/0x11620bc3f30aaba3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.232321:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=699s v=(0 0) 00010000:00010000:0.0:1787787555.232324:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787555.232328:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039650035/0x11620bc3f30aaba3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.232338:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039650035/0x11620bc3f30aaba3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.232346:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039650035/0x11620bc3f30aaba3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.232359:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039650035/0x11620bc3f30aaba3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.232415:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787787555.232663:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787555.232669:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007029aee2/0x11620bc3f30aabaa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.232730:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=699s v=(0 0) 00010000:00010000:0.0:1787787555.232735:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787555.232739:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007029aee2/0x11620bc3f30aabaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.232749:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007029aee2/0x11620bc3f30aabaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.232756:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007029aee2/0x11620bc3f30aabaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.232763:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007029aee2/0x11620bc3f30aabaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787555.238430:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787787555.238447:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efa2a8da/0x11620bc3f30aab9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787555.238464:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15e00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787555.238469:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efa2a8da/0x11620bc3f30aab9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787555.238491:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efa2a8da/0x11620bc3f30aab9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787555.238513:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efa2a8da/0x11620bc3f30aab9c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787555.238522:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efa2a8da/0x11620bc3f30aab9c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787555.238543:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787787555.238547:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039650035/0x11620bc3f30aaba3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787555.238552:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14a00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787555.238555:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039650035/0x11620bc3f30aaba3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787555.238563:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039650035/0x11620bc3f30aaba3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787555.238572:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039650035/0x11620bc3f30aaba3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787555.238579:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039650035/0x11620bc3f30aaba3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787555.238605:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787555.238609:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007029aee2/0x11620bc3f30aabaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787555.238616:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14600 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787555.238619:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007029aee2/0x11620bc3f30aabaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787555.238639:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007029aee2/0x11620bc3f30aabaa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787555.238650:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007029aee2/0x11620bc3f30aabaa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787555.238658:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787555.238659:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787555.238661:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787555.239917:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787555.245475:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787787555.245487:0:24221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007029aee2/0x11620bc3f30aabaa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787555.245775:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787555.247997:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787555.256126:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787555.256168:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077dc3a04/0x11620bc3f30aabb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.256188:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=699s v=(0 0) 00010000:00010000:0.0:1787787555.256193:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787555.256200:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077dc3a04/0x11620bc3f30aabb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.256215:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077dc3a04/0x11620bc3f30aabb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.256226:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077dc3a04/0x11620bc3f30aabb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.256233:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077dc3a04/0x11620bc3f30aabb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.256254:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787787555.256744:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787555.256750:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004bc24a2/0x11620bc3f30aabb8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.256759:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=699s v=(0 0) 00010000:00010000:0.0:1787787555.256763:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787555.256772:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004bc24a2/0x11620bc3f30aabb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.256782:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004bc24a2/0x11620bc3f30aabb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.256790:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004bc24a2/0x11620bc3f30aabb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.256797:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004bc24a2/0x11620bc3f30aabb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.256813:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787787555.256900:0:24527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787787555.256907:0:24527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077dc3a04/0x11620bc3f30aabb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.256914:0:24527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15c00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787555.256919:0:24527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077dc3a04/0x11620bc3f30aabb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.256929:0:24527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077dc3a04/0x11620bc3f30aabb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.256947:0:24527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077dc3a04/0x11620bc3f30aabb1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.256967:0:24527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077dc3a04/0x11620bc3f30aabb1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.256983:0:24527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787787555.256986:0:24527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004bc24a2/0x11620bc3f30aabb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.256992:0:24527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14400 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787555.256995:0:24527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004bc24a2/0x11620bc3f30aabb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.257001:0:24527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004bc24a2/0x11620bc3f30aabb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.257011:0:24527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004bc24a2/0x11620bc3f30aabb8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.257017:0:24527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004bc24a2/0x11620bc3f30aabb8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.257029:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787555.257031:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787555.257032:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787787555.257374:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787787555.257380:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028ec4075/0x11620bc3f30aabbf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.257395:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=699s v=(0 0) 00010000:00010000:0.0:1787787555.257398:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787555.257402:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028ec4075/0x11620bc3f30aabbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.257411:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028ec4075/0x11620bc3f30aabbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.257419:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028ec4075/0x11620bc3f30aabbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.257426:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028ec4075/0x11620bc3f30aabbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.257439:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787787555.260339:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787555.260353:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028ec4075/0x11620bc3f30aabbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787555.260366:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15200 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787555.260371:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028ec4075/0x11620bc3f30aabbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787555.260390:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028ec4075/0x11620bc3f30aabbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787555.260411:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028ec4075/0x11620bc3f30aabbf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787555.260419:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028ec4075/0x11620bc3f30aabbf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787555.260437:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787555.260439:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787555.260441:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787555.260449:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787787555.260615:0:25038:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1787787555.260646:0:25038:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1787787555.260651:0:25038:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787787555.260901:0:25288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:23460:x1874630503824384:12345-0@lo:5:osp-pre-1-1.0 Request processed in 36257us (37128us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1787787555.260911:0:25288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787787555.260996:0:23460:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1787787555.261004:0:23460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b0b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23460:1874630503824384:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1787787555.261020:0:23460:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:1.0:1787787555.261071:0:23460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc4899680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23460:1874630503824512:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1787787555.261108:0:23460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787555.261164:0:23460:0:(client.c:2715:ptlrpc_set_wait()) set ffff986fc371b780 going to sleep for 11 seconds 00000100:00100000:3.0:1787787555.261228:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503824512 00000100:00100000:3.0:1787787555.261234:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503824512 00000100:00100000:3.0:1787787555.261280:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787787555.261289:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23460:x1874630503824512:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1787787555.261334:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23460:x1874630503824512:12345-0@lo:900:osp-pre-1-1.0 Request processed in 47us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787555.261341:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787787555.262279:0:23460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc4899680 x1874630503824512/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787787571 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787555.262295:0:23460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc4899680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23460:1874630503824512:0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1787787555.262697:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787555.262706:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078cd3a04/0x11620bc3f30aabc6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.262737:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=699s v=(0 0) 00010000:00010000:1.0:1787787555.262742:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787555.262748:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078cd3a04/0x11620bc3f30aabc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.262763:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078cd3a04/0x11620bc3f30aabc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.262772:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078cd3a04/0x11620bc3f30aabc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.262779:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078cd3a04/0x11620bc3f30aabc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.262795:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787555.263263:0:24527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787555.263270:0:24527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078cd3a04/0x11620bc3f30aabc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.263279:0:24527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7b5e400 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787555.263284:0:24527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078cd3a04/0x11620bc3f30aabc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.263295:0:24527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078cd3a04/0x11620bc3f30aabc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.263314:0:24527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078cd3a04/0x11620bc3f30aabc6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.263321:0:24527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078cd3a04/0x11620bc3f30aabc6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.263339:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.263340:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.263342:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787555.263440:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787555.263446:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6d6a7b3/0x11620bc3f30aabcd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.263454:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=699s v=(0 0) 00010000:00010000:1.0:1787787555.263458:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787555.263462:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6d6a7b3/0x11620bc3f30aabcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.263471:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6d6a7b3/0x11620bc3f30aabcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.263491:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6d6a7b3/0x11620bc3f30aabcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.263498:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6d6a7b3/0x11620bc3f30aabcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.263520:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787555.263792:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787555.263797:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6d6a7b3/0x11620bc3f30aabcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.263805:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7b5f000 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787555.263808:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6d6a7b3/0x11620bc3f30aabcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.263815:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6d6a7b3/0x11620bc3f30aabcd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.263827:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6d6a7b3/0x11620bc3f30aabcd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.263834:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6d6a7b3/0x11620bc3f30aabcd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.263849:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.263850:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.263852:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787555.263938:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787555.263943:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053181f90/0x11620bc3f30aabd4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.263951:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=699s v=(0 0) 00010000:00010000:1.0:1787787555.263954:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787555.263958:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053181f90/0x11620bc3f30aabd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.263967:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053181f90/0x11620bc3f30aabd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.263974:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053181f90/0x11620bc3f30aabd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.263982:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053181f90/0x11620bc3f30aabd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.264015:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787555.264272:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787555.264278:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053181f90/0x11620bc3f30aabd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.264285:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7b5f400 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787555.264289:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053181f90/0x11620bc3f30aabd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.264310:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053181f90/0x11620bc3f30aabd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.264321:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053181f90/0x11620bc3f30aabd4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.264328:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053181f90/0x11620bc3f30aabd4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.264340:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.264342:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.264343:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787555.264479:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787555.264484:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c59117b/0x11620bc3f30aabdb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.264492:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=699s v=(0 0) 00010000:00010000:1.0:1787787555.264496:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787555.264500:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c59117b/0x11620bc3f30aabdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.264509:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c59117b/0x11620bc3f30aabdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.264516:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c59117b/0x11620bc3f30aabdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.264522:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c59117b/0x11620bc3f30aabdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.264541:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787555.264781:0:24527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787555.264785:0:24527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c59117b/0x11620bc3f30aabdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.264792:0:24527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7b5e800 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787555.264795:0:24527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c59117b/0x11620bc3f30aabdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.264804:0:24527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c59117b/0x11620bc3f30aabdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.264814:0:24527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c59117b/0x11620bc3f30aabdb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.264834:0:24527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c59117b/0x11620bc3f30aabdb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.264850:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.264851:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.264853:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787555.264920:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787555.264925:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085e381d6/0x11620bc3f30aabe2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.264933:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=699s v=(0 0) 00010000:00010000:1.0:1787787555.264943:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787555.264947:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085e381d6/0x11620bc3f30aabe2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.264957:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085e381d6/0x11620bc3f30aabe2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.264964:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085e381d6/0x11620bc3f30aabe2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.264971:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085e381d6/0x11620bc3f30aabe2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.264987:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787555.265135:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787555.265160:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085e381d6/0x11620bc3f30aabe2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.265168:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7b5e600 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787555.265171:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085e381d6/0x11620bc3f30aabe2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.265179:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085e381d6/0x11620bc3f30aabe2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.265190:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085e381d6/0x11620bc3f30aabe2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.265196:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085e381d6/0x11620bc3f30aabe2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.265209:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.265210:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.265212:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787555.265362:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787555.265368:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3a35315/0x11620bc3f30aabe9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.265377:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=699s v=(0 0) 00010000:00010000:1.0:1787787555.265379:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787555.265384:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3a35315/0x11620bc3f30aabe9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.265394:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3a35315/0x11620bc3f30aabe9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.265403:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3a35315/0x11620bc3f30aabe9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.265417:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3a35315/0x11620bc3f30aabe9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.265435:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787555.266059:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787555.266066:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3a35315/0x11620bc3f30aabe9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.266075:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7b5e000 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787555.266078:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3a35315/0x11620bc3f30aabe9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.266088:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3a35315/0x11620bc3f30aabe9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.266100:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3a35315/0x11620bc3f30aabe9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.266108:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3a35315/0x11620bc3f30aabe9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.266123:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.266125:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.266126:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787555.266303:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787555.266308:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb1c1071/0x11620bc3f30aabf0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.266317:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=699s v=(0 0) 00010000:00010000:1.0:1787787555.266320:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787555.266325:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb1c1071/0x11620bc3f30aabf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.266334:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb1c1071/0x11620bc3f30aabf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.266342:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb1c1071/0x11620bc3f30aabf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.266348:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb1c1071/0x11620bc3f30aabf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.266368:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787555.266602:0:24527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787555.266607:0:24527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb1c1071/0x11620bc3f30aabf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.266615:0:24527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7b5fe00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787555.266619:0:24527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb1c1071/0x11620bc3f30aabf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.266648:0:24527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb1c1071/0x11620bc3f30aabf0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.266659:0:24527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb1c1071/0x11620bc3f30aabf0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.266667:0:24527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb1c1071/0x11620bc3f30aabf0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.266690:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.266692:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.266693:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787555.266793:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787555.266798:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c638c507/0x11620bc3f30aabf7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.266811:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=699s v=(0 0) 00010000:00010000:1.0:1787787555.266814:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787555.266818:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c638c507/0x11620bc3f30aabf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.266828:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c638c507/0x11620bc3f30aabf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.266836:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c638c507/0x11620bc3f30aabf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.266843:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c638c507/0x11620bc3f30aabf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.266861:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787555.267123:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787555.267128:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c638c507/0x11620bc3f30aabf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.267153:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7b5ea00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787555.267157:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c638c507/0x11620bc3f30aabf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.267165:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c638c507/0x11620bc3f30aabf7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.267177:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c638c507/0x11620bc3f30aabf7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.267195:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c638c507/0x11620bc3f30aabf7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.267209:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.267211:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.267213:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787555.267291:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787555.267297:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f354ca0/0x11620bc3f30aabfe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.267306:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=699s v=(0 0) 00010000:00010000:1.0:1787787555.267309:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787555.267314:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f354ca0/0x11620bc3f30aabfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.267323:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f354ca0/0x11620bc3f30aabfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.267342:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f354ca0/0x11620bc3f30aabfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.267350:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f354ca0/0x11620bc3f30aabfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.267369:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787787555.270614:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787555.270640:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000788bd6bf/0x11620bc3f30aac05 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.270656:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=699s v=(0 0) 00010000:00010000:1.0:1787787555.270660:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787555.270666:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000788bd6bf/0x11620bc3f30aac05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.270689:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000788bd6bf/0x11620bc3f30aac05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.270699:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000788bd6bf/0x11620bc3f30aac05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.270707:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000788bd6bf/0x11620bc3f30aac05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.270744:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787787555.270925:0:24527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787787555.270933:0:24527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f354ca0/0x11620bc3f30aabfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.270942:0:24527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7b5f200 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787555.270946:0:24527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f354ca0/0x11620bc3f30aabfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.270955:0:24527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f354ca0/0x11620bc3f30aabfe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.270971:0:24527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f354ca0/0x11620bc3f30aabfe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.270979:0:24527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f354ca0/0x11620bc3f30aabfe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.270997:0:24527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787555.271001:0:24527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000788bd6bf/0x11620bc3f30aac05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.271007:0:24527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7b5ee00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787555.271011:0:24527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000788bd6bf/0x11620bc3f30aac05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.271029:0:24527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000788bd6bf/0x11620bc3f30aac05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.271040:0:24527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000788bd6bf/0x11620bc3f30aac05 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.271046:0:24527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000788bd6bf/0x11620bc3f30aac05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.271061:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787555.271063:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787555.271064:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787555.271331:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787555.271338:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030137b61/0x11620bc3f30aac0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.271346:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=699s v=(0 0) 00010000:00010000:1.0:1787787555.271350:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787555.271354:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030137b61/0x11620bc3f30aac0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.271363:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030137b61/0x11620bc3f30aac0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.271372:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030137b61/0x11620bc3f30aac0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.271386:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030137b61/0x11620bc3f30aac0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.271399:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787555.271651:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787555.271659:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030137b61/0x11620bc3f30aac0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.271667:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7b5ec00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787555.271671:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030137b61/0x11620bc3f30aac0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.271690:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030137b61/0x11620bc3f30aac0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.271702:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030137b61/0x11620bc3f30aac0c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.271708:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030137b61/0x11620bc3f30aac0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.271724:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.271726:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.271727:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.271741:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787555.271848:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787555.271853:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5e55f0e/0x11620bc3f30aac13 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.271861:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=699s v=(0 0) 00010000:00010000:1.0:1787787555.271863:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787555.271867:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5e55f0e/0x11620bc3f30aac13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.271874:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5e55f0e/0x11620bc3f30aac13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.271882:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5e55f0e/0x11620bc3f30aac13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.271888:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5e55f0e/0x11620bc3f30aac13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.271910:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787787555.272119:0:24527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787555.272125:0:24527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5e55f0e/0x11620bc3f30aac13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.272131:0:24527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7b5fc00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787555.272135:0:24527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5e55f0e/0x11620bc3f30aac13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.272161:0:24527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5e55f0e/0x11620bc3f30aac13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.272172:0:24527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5e55f0e/0x11620bc3f30aac13 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.272179:0:24527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5e55f0e/0x11620bc3f30aac13 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.272194:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.272196:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.272198:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787555.272275:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787555.272280:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eca2f3ac/0x11620bc3f30aac1a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.272293:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=699s v=(0 0) 00010000:00010000:1.0:1787787555.272296:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787555.272301:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eca2f3ac/0x11620bc3f30aac1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.272310:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eca2f3ac/0x11620bc3f30aac1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.272317:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eca2f3ac/0x11620bc3f30aac1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.272323:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eca2f3ac/0x11620bc3f30aac1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.272342:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787787555.272765:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787555.272771:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038ad19bd/0x11620bc3f30aac21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.272779:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=699s v=(0 0) 00010000:00010000:1.0:1787787555.272782:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787555.272787:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038ad19bd/0x11620bc3f30aac21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.272796:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038ad19bd/0x11620bc3f30aac21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.272815:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038ad19bd/0x11620bc3f30aac21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.272822:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038ad19bd/0x11620bc3f30aac21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.272845:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787787555.272945:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787787555.272951:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eca2f3ac/0x11620bc3f30aac1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.272959:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7b5e200 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787555.272962:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eca2f3ac/0x11620bc3f30aac1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.272980:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eca2f3ac/0x11620bc3f30aac1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.272992:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eca2f3ac/0x11620bc3f30aac1a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.272999:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eca2f3ac/0x11620bc3f30aac1a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.273015:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787555.273019:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038ad19bd/0x11620bc3f30aac21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.273025:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7b5fa00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787555.273028:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038ad19bd/0x11620bc3f30aac21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.273036:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038ad19bd/0x11620bc3f30aac21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.273046:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038ad19bd/0x11620bc3f30aac21 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.273052:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038ad19bd/0x11620bc3f30aac21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.273075:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.273077:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.273079:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787555.273114:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787787555.275209:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787555.275224:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de3b5731/0x11620bc3f30aac28 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.275240:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=699s v=(0 0) 00010000:00010000:1.0:1787787555.275244:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787555.275250:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de3b5731/0x11620bc3f30aac28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.275263:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de3b5731/0x11620bc3f30aac28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.275273:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de3b5731/0x11620bc3f30aac28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.275281:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de3b5731/0x11620bc3f30aac28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.275314:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787787555.275774:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787555.275780:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078024c03/0x11620bc3f30aac2f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.275789:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=699s v=(0 0) 00010000:00010000:1.0:1787787555.275792:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787555.275796:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078024c03/0x11620bc3f30aac2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.275805:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078024c03/0x11620bc3f30aac2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.275812:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078024c03/0x11620bc3f30aac2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.275819:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078024c03/0x11620bc3f30aac2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.275930:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787787555.276271:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787787555.276278:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e0b5b27/0x11620bc3f30aac36 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.276287:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=699s v=(0 0) 00010000:00010000:1.0:1787787555.276298:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787555.276303:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e0b5b27/0x11620bc3f30aac36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.276312:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e0b5b27/0x11620bc3f30aac36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.276320:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e0b5b27/0x11620bc3f30aac36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.276328:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e0b5b27/0x11620bc3f30aac36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.276378:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787787555.276388:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de3b5731/0x11620bc3f30aac28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.276396:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7b5f800 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:0.0:1787787555.276401:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de3b5731/0x11620bc3f30aac28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.276409:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de3b5731/0x11620bc3f30aac28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.276433:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de3b5731/0x11620bc3f30aac28 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787555.276441:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de3b5731/0x11620bc3f30aac28 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.278583:0:24527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787787555.278597:0:24527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078024c03/0x11620bc3f30aac2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.278612:0:24527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7b5f600 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787555.278617:0:24527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078024c03/0x11620bc3f30aac2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.278636:0:24527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078024c03/0x11620bc3f30aac2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.278657:0:24527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078024c03/0x11620bc3f30aac2f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.278666:0:24527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078024c03/0x11620bc3f30aac2f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.278695:0:24527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787555.278699:0:24527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e0b5b27/0x11620bc3f30aac36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.278706:0:24527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc4296400 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787555.278719:0:24527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e0b5b27/0x11620bc3f30aac36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.278727:0:24527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e0b5b27/0x11620bc3f30aac36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.278737:0:24527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e0b5b27/0x11620bc3f30aac36 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.278746:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.278747:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.278749:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787555.279958:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787555.279965:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787555.279968:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787555.282264:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787787555.282279:0:24221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e0b5b27/0x11620bc3f30aac36 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.282411:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787787555.282914:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787787555.282922:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000671b88fd/0x11620bc3f30aac3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.282938:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=699s v=(0 0) 00010000:00010000:2.0:1787787555.282942:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787555.282949:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000671b88fd/0x11620bc3f30aac3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.282963:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000671b88fd/0x11620bc3f30aac3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.282973:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000671b88fd/0x11620bc3f30aac3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.282994:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000671b88fd/0x11620bc3f30aac3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.283016:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787787555.283521:0:24527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787555.283529:0:24527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000671b88fd/0x11620bc3f30aac3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.283539:0:24527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2000 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787555.283543:0:24527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000671b88fd/0x11620bc3f30aac3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.283551:0:24527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000671b88fd/0x11620bc3f30aac3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.283580:0:24527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000671b88fd/0x11620bc3f30aac3d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.283587:0:24527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000671b88fd/0x11620bc3f30aac3d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.283604:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787555.283606:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787555.283608:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787787555.283723:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787787555.283729:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc213333/0x11620bc3f30aac44 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.283739:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=699s v=(0 0) 00010000:00010000:2.0:1787787555.283742:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787555.283747:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc213333/0x11620bc3f30aac44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.283756:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc213333/0x11620bc3f30aac44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.283764:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc213333/0x11620bc3f30aac44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.283772:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc213333/0x11620bc3f30aac44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.283796:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787787555.284068:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787555.284074:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc213333/0x11620bc3f30aac44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.284082:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2c00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787555.284086:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc213333/0x11620bc3f30aac44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.284094:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc213333/0x11620bc3f30aac44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.284104:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc213333/0x11620bc3f30aac44 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.284111:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc213333/0x11620bc3f30aac44 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.284134:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787555.284160:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787555.284162:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787787555.284244:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787787555.284250:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb72dd2b/0x11620bc3f30aac4b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.284264:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=699s v=(0 0) 00010000:00010000:2.0:1787787555.284268:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787555.284272:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb72dd2b/0x11620bc3f30aac4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.284282:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb72dd2b/0x11620bc3f30aac4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.284290:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb72dd2b/0x11620bc3f30aac4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.284298:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb72dd2b/0x11620bc3f30aac4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.284349:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787787555.284640:0:24221:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787787555.284646:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cace6b1c/0x11620bc3f30aac52 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.284655:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=699s v=(0 0) 00010000:00010000:2.0:1787787555.284659:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787555.284663:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cace6b1c/0x11620bc3f30aac52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.284672:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cace6b1c/0x11620bc3f30aac52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.284701:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cace6b1c/0x11620bc3f30aac52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787555.284709:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cace6b1c/0x11620bc3f30aac52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.285033:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787787555.285039:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb72dd2b/0x11620bc3f30aac4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.285048:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3600 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787555.285051:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb72dd2b/0x11620bc3f30aac4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.285059:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb72dd2b/0x11620bc3f30aac4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.285071:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb72dd2b/0x11620bc3f30aac4b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.285078:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb72dd2b/0x11620bc3f30aac4b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.285091:0:22703:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787787555.285094:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cace6b1c/0x11620bc3f30aac52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.285100:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee2600 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787555.285109:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cace6b1c/0x11620bc3f30aac52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.285117:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cace6b1c/0x11620bc3f30aac52 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.285127:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cace6b1c/0x11620bc3f30aac52 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787555.285135:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787555.285167:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787787555.285169:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787555.285242:0:24221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787787555.285247:0:24221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cace6b1c/0x11620bc3f30aac52 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1787787555.285506:0:24221:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:2.0:1787787555.285606:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22741:x1874630503823872:12345-0@lo:5:osp-pre-1-0.0 Request processed in 91368us (91499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787555.285614:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787787555.285741:0:22741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489a580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22741:1874630503823872:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787787555.285758:0:22741:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1787787555.285803:0:22741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b0f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22741:1874630503824640:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787787555.285838:0:22741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787555.285860:0:22741:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d2379780 going to sleep for 11 seconds 00000100:00100000:2.0:1787787555.285877:0:24939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503824640 00000100:00100000:2.0:1787787555.285882:0:24939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503824640 00000100:00100000:2.0:1787787555.285918:0:24939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787787555.285925:0:24939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22741:x1874630503824640:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787787555.285960:0:24939:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:2.0:1787787555.289613:0:24939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22741:x1874630503824640:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3680us (3766us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1787787555.289637:0:24939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787787555.289823:0:22741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b0f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22741:1874630503824640:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787787555.289840:0:22741:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:1.0:1787787555.290466:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787556.202627:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503824768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787556.202714:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787556.202789:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503824768 00000100:00100000:1.0:1787787556.202796:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503824768 00000100:00100000:1.0:1787787556.202839:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787787556.202849:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc4899680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503824768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787787556.202887:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1787787556.202932:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc4899680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503824768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787556.202941:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787787556.202988:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503824768:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787787556.269232:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787787556.698953:0:25395:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg431-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787787557.290619:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787787557.694457:0:25447:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787787557.694760:0:25447:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787787558.250014:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787787558.250035:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503824896:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787787558.250110:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787558.250186:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503824896 00000100:00100000:2.0:1787787558.250193:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503824896 00000100:00100000:2.0:1787787558.250234:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787787558.250243:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503824896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787787558.250274:0:22720:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787787558.250315:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503824896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787558.250322:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787787558.250360:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503825024:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787787558.250380:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787558.250413:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503824896:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787787558.250437:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503825024 00000100:00100000:2.0:1787787558.250440:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503825024 00000100:00100000:2.0:1787787558.250461:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787787558.250467:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503825024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787787558.250484:0:22719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787787558.250516:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503825024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 48us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787558.250522:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787787558.250559:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503825024:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787787558.253477:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787787558.253500:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503825152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787787558.253565:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787558.253639:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503825152 00000100:00100000:3.0:1787787558.253657:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503825152 00000100:00100000:3.0:1787787558.253829:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787787558.253840:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503825152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787787558.253870:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787787558.253911:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503825152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787558.254049:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787787558.254074:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787787558.254121:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503825152:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787787558.316726:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787787558.531289:0:25498:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787787558.531519:0:25498:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787787558.871641:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787558.871874:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484839168 00000100:00100000:2.0:1787787558.871886:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484839168 00000100:00100000:2.0:1787787558.871936:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 113 00000100:00100000:2.0:1787787558.871944:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c3521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2390:x1874630484839168:12345-192.168.204.31@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787787558.871972:0:22707:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b13f583f-f513-4656-8252-cd03f2d0eada@192.168.204.31@tcp t0 exp 0000000000000000 cur 703 last 0 00000020:00000080:2.0:1787787558.872000:0:22707:0:(genops.c:1385:class_connect()) connect: client b13f583f-f513-4656-8252-cd03f2d0eada, cookie 0x11620bc3f30aac59 00000100:00080000:2.0:1787787558.872187:0:22707:0:(import.c:65:import_set_state_nolock()) ffff986fc39d8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787558.872257:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c3521050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b13f583f-f513-4656-8252-cd03f2d0eada+5:2390:x1874630484839168:12345-192.168.204.31@tcp:250:mount.lustre.0 Request processed in 313us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787558.872265:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 113 00000100:00100000:1.0:1787787558.882752:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787558.883055:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484839296 00000100:00100000:2.0:1787787558.883065:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484839296 00000100:00100000:2.0:1787787558.883125:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 114 00000100:00100000:2.0:1787787558.883134:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f03e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b13f583f-f513-4656-8252-cd03f2d0eada+5:18087:x1874630484839296:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787787558.883179:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787558.883198:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff987101ee2000/0x11620bc3f30aac60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c86c1 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787558.883227:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff987101ee2000/0x11620bc3f30aac60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c86c1 expref: 6 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787558.883239:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff987101ee2000/0x11620bc3f30aac60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c86c1 expref: 6 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787558.883248:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2000, rc 0) 00000100:00100000:2.0:1787787558.883381:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f03e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b13f583f-f513-4656-8252-cd03f2d0eada+6:18087:x1874630484839296:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 247us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787558.883388:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 114 00000100:00100000:3.0:1787787558.891212:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787558.891299:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484839424 00000100:00100000:1.0:1787787558.891310:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484839424 00000100:00100000:1.0:1787787558.891374:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 115 00000100:00100000:1.0:1787787558.891384:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f03e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b13f583f-f513-4656-8252-cd03f2d0eada+6:18087:x1874630484839424:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787787558.891502:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f03e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b13f583f-f513-4656-8252-cd03f2d0eada+6:18087:x1874630484839424:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 119us (300us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787787558.891510:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 115 00000100:00100000:0.0:1787787558.894866:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787558.894954:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484839552 00000100:00100000:3.0:1787787558.894965:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484839552 00000100:00100000:3.0:1787787558.895029:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 116 00000100:00100000:3.0:1787787558.895039:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f03e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b13f583f-f513-4656-8252-cd03f2d0eada+6:18087:x1874630484839552:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787787558.895054:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787558.895072:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9871021c7000/0x11620bc3f30aac67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c86c8 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787558.895103:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9871021c7000/0x11620bc3f30aac67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c86c8 expref: 7 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787558.895171:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9871021c7000/0x11620bc3f30aac67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c86c8 expref: 7 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787558.895182:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c7000, rc 0) 00000100:00100000:3.0:1787787558.895254:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f03e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b13f583f-f513-4656-8252-cd03f2d0eada+7:18087:x1874630484839552:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 215us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787558.895264:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 116 00000100:00100000:0.0:1787787558.901135:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787558.901795:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484839680 00000100:00100000:2.0:1787787558.901805:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484839680 00000100:00100000:2.0:1787787558.901865:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 117 00000100:00100000:2.0:1787787558.901875:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f03e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b13f583f-f513-4656-8252-cd03f2d0eada+7:18087:x1874630484839680:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787787558.902057:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f03e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b13f583f-f513-4656-8252-cd03f2d0eada+8:18087:x1874630484839680:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 183us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787558.902065:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 117 00000100:00100000:2.0:1787787558.911845:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787558.912134:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484839808 00000100:00100000:1.0:1787787558.912238:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484839808 00000100:00100000:1.0:1787787558.912336:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 118 00000100:00100000:1.0:1787787558.912347:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f03e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b13f583f-f513-4656-8252-cd03f2d0eada+8:18087:x1874630484839808:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787787558.912546:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f03e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b13f583f-f513-4656-8252-cd03f2d0eada+8:18087:x1874630484839808:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 200us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787558.912565:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 118 00000100:00100000:0.0:1787787558.925219:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787558.926698:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484839936 00000100:00100000:3.0:1787787558.926714:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484839936 00000100:00100000:3.0:1787787558.926832:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 119 00000100:00100000:3.0:1787787558.926843:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f03e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b13f583f-f513-4656-8252-cd03f2d0eada+8:18105:x1874630484839936:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787787558.927028:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f03e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b13f583f-f513-4656-8252-cd03f2d0eada+8:18105:x1874630484839936:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 186us (1819us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787558.927037:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 119 00000100:00100000:0.0:1787787558.961189:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787558.961289:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484840064 00000100:00100000:1.0:1787787558.961299:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484840064 00000100:00100000:1.0:1787787558.961351:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 120 00000100:00100000:1.0:1787787558.961360:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f03e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b13f583f-f513-4656-8252-cd03f2d0eada+8:18105:x1874630484840064:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787787558.961515:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f03e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b13f583f-f513-4656-8252-cd03f2d0eada+8:18105:x1874630484840064:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 155us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787558.961523:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 120 00000100:00100000:0.0:1787787558.967989:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787558.968120:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484840192 00000100:00100000:3.0:1787787558.968129:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484840192 00000100:00100000:3.0:1787787558.968214:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 121 00000100:00100000:3.0:1787787558.968223:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f03e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b13f583f-f513-4656-8252-cd03f2d0eada+8:18105:x1874630484840192:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787787558.968356:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f03e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b13f583f-f513-4656-8252-cd03f2d0eada+8:18105:x1874630484840192:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 134us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787558.968377:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 121 00000100:00100000:0.0:1787787558.972305:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787558.972416:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484840320 00000100:00100000:2.0:1787787558.972427:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484840320 00000100:00100000:2.0:1787787558.972486:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 122 00000100:00100000:2.0:1787787558.972498:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f03e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b13f583f-f513-4656-8252-cd03f2d0eada+8:18087:x1874630484840320:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787787558.972518:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787558.972539:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff987101ee3600/0x11620bc3f30aac6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c86f9 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787558.972648:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff987101ee3600/0x11620bc3f30aac6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c86f9 expref: 9 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787558.972663:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff987101ee3600/0x11620bc3f30aac6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c86f9 expref: 9 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787558.972673:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3600, rc 0) 00000100:00100000:2.0:1787787558.972741:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f03e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b13f583f-f513-4656-8252-cd03f2d0eada+9:18087:x1874630484840320:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 245us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787558.972763:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 122 00000100:00100000:0.0:1787787558.983893:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787558.986528:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484840448 00000100:00100000:1.0:1787787558.986544:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484840448 00000100:00100000:1.0:1787787558.986628:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 123 00000100:00100000:1.0:1787787558.987483:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f03e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b13f583f-f513-4656-8252-cd03f2d0eada+9:18087:x1874630484840448:12345-192.168.204.31@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787787558.987529:0:22708:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787787558.987547:0:22708:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787787558.987551:0:22708:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787787558.987567:0:22708:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787787558.987571:0:22708:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787787558.987573:0:22708:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1787787558.999719:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f03e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b13f583f-f513-4656-8252-cd03f2d0eada+9:18087:x1874630484840448:12345-192.168.204.31@tcp:256:mount.lustre.0 Request processed in 13071us (15824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787558.999735:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 123 00000100:00100000:0.0:1787787559.005055:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787559.005428:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484840576 00000100:00100000:3.0:1787787559.005439:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484840576 00000100:00100000:3.0:1787787559.005498:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 124 00000100:00100000:3.0:1787787559.005508:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f03e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b13f583f-f513-4656-8252-cd03f2d0eada+9:18087:x1874630484840576:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787787559.005539:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787559.005576:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9871021c6800/0x11620bc3f30aac75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8700 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787559.005823:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9871021c6800/0x11620bc3f30aac75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8700 expref: 10 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787559.005838:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9871021c6800/0x11620bc3f30aac75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8700 expref: 10 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787559.005850:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c6800, rc 0) 00000100:00100000:3.0:1787787559.005915:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f03e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b13f583f-f513-4656-8252-cd03f2d0eada+10:18087:x1874630484840576:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 408us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787559.005922:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 124 00000100:00100000:2.0:1787787559.013722:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787559.013909:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484840704 00000100:00100000:1.0:1787787559.013919:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484840704 00000100:00100000:1.0:1787787559.014036:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 125 00000100:00100000:1.0:1787787559.014047:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f03e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b13f583f-f513-4656-8252-cd03f2d0eada+10:18087:x1874630484840704:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787787559.014231:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f03e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b13f583f-f513-4656-8252-cd03f2d0eada+10:18087:x1874630484840704:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 185us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787559.014239:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 125 00000100:00100000:0.0:1787787559.018547:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787559.018747:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484840832 00000100:00100000:2.0:1787787559.018757:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484840832 00000100:00100000:2.0:1787787559.018815:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 126 00000100:00100000:2.0:1787787559.018824:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f03e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b13f583f-f513-4656-8252-cd03f2d0eada+10:18087:x1874630484840832:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787787559.018979:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f03e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b13f583f-f513-4656-8252-cd03f2d0eada+10:18087:x1874630484840832:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 156us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787559.018986:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 126 00000100:00100000:1.0:1787787559.027542:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787559.027819:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484840960 00000100:00100000:2.0:1787787559.027831:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484840960 00000100:00100000:2.0:1787787559.027934:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 127 00000100:00100000:2.0:1787787559.027945:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f03e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b13f583f-f513-4656-8252-cd03f2d0eada+10:18109:x1874630484840960:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787787559.028122:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f03e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b13f583f-f513-4656-8252-cd03f2d0eada+10:18109:x1874630484840960:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 179us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787559.028131:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 127 00000100:00100000:0.0:1787787559.033234:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787559.033291:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484841088 00000100:00100000:3.0:1787787559.033302:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484841088 00000100:00100000:3.0:1787787559.033352:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 128 00000100:00100000:3.0:1787787559.033361:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f521f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b13f583f-f513-4656-8252-cd03f2d0eada+10:18109:x1874630484841088:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787787559.033528:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f521f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b13f583f-f513-4656-8252-cd03f2d0eada+10:18109:x1874630484841088:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 166us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787559.033536:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 128 00000100:00100000:0.0:1787787559.040209:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787559.040293:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787559.042964:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484841216 00000100:00100000:1.0:1787787559.042980:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484841216 00000100:00100000:1.0:1787787559.043363:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484841472 00000100:00100000:1.0:1787787559.043368:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484841472 00000100:00100000:1.0:1787787559.043391:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7 00000100:00100000:1.0:1787787559.043399:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2390:x1874630484841216:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787787559.043684:0:22716:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a65d3225-1272-4ba4-9698-bcc15a4206b3@192.168.204.31@tcp t0 exp 0000000000000000 cur 703 last 0 00000020:00000080:1.0:1787787559.043749:0:22716:0:(genops.c:1385:class_connect()) connect: client a65d3225-1272-4ba4-9698-bcc15a4206b3, cookie 0x11620bc3f30aac7c 00000004:00100000:1.0:1787787559.043780:0:22716:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787787559.044018:0:22716:0:(import.c:65:import_set_state_nolock()) ffff986fc2760000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787787559.044495:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a65d3225-1272-4ba4-9698-bcc15a4206b3+6:2390:x1874630484841216:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 1093us (4295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787559.044503:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7 00000100:00100000:1.0:1787787559.044528:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8 00000100:00100000:1.0:1787787559.044533:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2390:x1874630484841472:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787787559.044823:0:22716:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from a65d3225-1272-4ba4-9698-bcc15a4206b3@192.168.204.31@tcp t0 exp 0000000000000000 cur 703 last 0 00000020:00000080:1.0:1787787559.044871:0:22716:0:(genops.c:1385:class_connect()) connect: client a65d3225-1272-4ba4-9698-bcc15a4206b3, cookie 0x11620bc3f30aac83 00000004:00100000:1.0:1787787559.044891:0:22716:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787787559.045791:0:22716:0:(import.c:65:import_set_state_nolock()) ffff9870f6937000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787787559.045851:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a65d3225-1272-4ba4-9698-bcc15a4206b3+6:2390:x1874630484841472:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 1314us (5556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787559.045861:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8 00000100:00100000:0.0:1787787559.053212:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787559.053291:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787559.055229:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787559.064108:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484841344 00000100:00100000:2.0:1787787559.064149:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484841344 00000100:00100000:2.0:1787787559.064230:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484841600 00000100:00100000:2.0:1787787559.064235:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484841600 00000100:00100000:2.0:1787787559.064252:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484841728 00000100:00100000:2.0:1787787559.064254:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484841728 00000100:00100000:2.0:1787787559.064274:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9 00000100:00100000:2.0:1787787559.064282:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+7:0:x1874630484841344:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787787559.064319:0:22715:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787787559.064429:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+7:0:x1874630484841344:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 146us (11227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787559.064437:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9 00000100:00100000:2.0:1787787559.064457:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10 00000100:00100000:2.0:1787787559.064464:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+6:0:x1874630484841600:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787787559.064481:0:22715:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787787559.064519:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+6:0:x1874630484841600:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 56us (11228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787559.064526:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10 00000100:00100000:2.0:1787787559.064538:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11 00000100:00100000:2.0:1787787559.064545:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+6:18087:x1874630484841728:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787787559.064577:0:22715:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787787559.064600:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+6:18087:x1874630484841728:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 56us (9380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787559.064620:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11 00000100:00080000:0.0:1787787559.071813:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787787559.071825:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787559.075865:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787559.076030:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484841856 00000100:00100000:2.0:1787787559.076040:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484841856 00000100:00100000:2.0:1787787559.076101:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 12 00000100:00100000:2.0:1787787559.076110:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+6:18087:x1874630484841856:12345-192.168.204.31@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787787559.076230:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+6:18087:x1874630484841856:12345-192.168.204.31@tcp:40:mount.lustre.0 Request processed in 121us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787559.076237:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 12 00000100:00100000:0.0:1787787559.089045:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787559.089091:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787559.089223:0:25288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484841984 00000100:00100000:1.0:1787787559.089234:0:25288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484841984 00000100:00100000:1.0:1787787559.089280:0:25288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484842112 00000100:00100000:1.0:1787787559.089284:0:25288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484842112 00000100:00100000:1.0:1787787559.089313:0:25288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 22 00000100:00100000:1.0:1787787559.089322:0:25288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2390:x1874630484841984:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787787559.089361:0:25288:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a65d3225-1272-4ba4-9698-bcc15a4206b3@192.168.204.31@tcp t0 exp 0000000000000000 cur 703 last 0 00000020:00000080:1.0:1787787559.089400:0:25288:0:(genops.c:1385:class_connect()) connect: client a65d3225-1272-4ba4-9698-bcc15a4206b3, cookie 0x11620bc3f30aac8a 00002000:00100000:1.0:1787787559.089413:0:25288:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a65d3225-1272-4ba4-9698-bcc15a4206b3/ffff9870f6935000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113934 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787787559.089425:0:25288:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1787787559.089774:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 23 00000100:00100000:0.0:1787787559.089781:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1874630484842112:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787787559.089799:0:24219:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a65d3225-1272-4ba4-9698-bcc15a4206b3@192.168.204.31@tcp t0 exp 0000000000000000 cur 703 last 0 00000020:00000080:0.0:1787787559.089818:0:24219:0:(genops.c:1385:class_connect()) connect: client a65d3225-1272-4ba4-9698-bcc15a4206b3, cookie 0x11620bc3f30aac91 00002000:00100000:0.0:1787787559.089824:0:24219:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a65d3225-1272-4ba4-9698-bcc15a4206b3/ffff986fc43bf000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113934 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787787559.089835:0:24219:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787787559.089944:0:24219:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787787559.089974:0:24219:0:(import.c:65:import_set_state_nolock()) ffff986fc43b8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787787559.090038:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+6:2390:x1874630484842112:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 256us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787559.090046:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 23 00002000:00080000:1.0:1787787559.090463:0:25288:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787787559.090481:0:25288:0:(import.c:65:import_set_state_nolock()) ffff9870f6933800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787787559.090539:0:25288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a65d3225-1272-4ba4-9698-bcc15a4206b3+6:2390:x1874630484841984:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 1216us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787559.090713:0:25288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 22 00000100:00100000:0.0:1787787559.094952:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787559.095083:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484842240 00000100:00100000:3.0:1787787559.095093:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484842240 00000100:00100000:3.0:1787787559.095480:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3 00000100:00100000:3.0:1787787559.095493:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a65d3225-1272-4ba4-9698-bcc15a4206b3+6:18087:x1874630484842240:12345-192.168.204.31@tcp:900:mount.lustre.0 00000100:00100000:3.0:1787787559.095647:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a65d3225-1272-4ba4-9698-bcc15a4206b3+6:18087:x1874630484842240:12345-192.168.204.31@tcp:900:mount.lustre.0 Request processed in 157us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787559.095681:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3 00000100:00100000:0.0:1787787559.099403:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787559.099525:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484842368 00000100:00100000:3.0:1787787559.099535:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484842368 00000100:00100000:3.0:1787787559.099823:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 0 00000100:00100000:3.0:1787787559.099834:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+6:18087:x1874630484842368:12345-192.168.204.31@tcp:33:mount.lustre.0 00000004:00080000:3.0:1787787559.100841:0:22717:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 917us 00000004:00200000:3.0:1787787559.116904:0:22717:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787787559.117100:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+6:18087:x1874630484842368:12345-192.168.204.31@tcp:33:mount.lustre.0 Request processed in 17261us (17700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787559.117113:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 0 00000100:00100000:0.0:1787787559.276057:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787559.276193:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484842496 00000100:00100000:3.0:1787787559.276204:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484842496 00000100:00100000:3.0:1787787559.276273:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13 00000100:00100000:3.0:1787787559.276284:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+6:18132:x1874630484842496:12345-192.168.204.31@tcp:101:mkdir.0 00010000:00010000:3.0:1787787559.276305:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787559.276333:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30aac98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8731 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787559.276405:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aac9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787559.276420:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aac9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787559.276435:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aac9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787559.276499:0:22714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787787559.276504:0:22714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787787559.276571:0:22714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aac9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787559.276787:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30aac98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8731 expref: 8 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787559.276812:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aac9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8731 expref: 7 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787559.276821:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a1de00) 00010000:00010000:3.0:1787787559.276825:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787787559.276828:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c6400, rc 0) 00000100:00100000:3.0:1787787559.276899:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+7:18132:x1874630484842496:12345-192.168.204.31@tcp:101:mkdir.0 Request processed in 617us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787559.276908:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13 00010000:00010000:2.0:1787787559.337342:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787560.298563:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503825280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787787560.298715:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787560.298780:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503825280 00000100:00100000:3.0:1787787560.298785:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503825792:0@lo:400:kworker.0 00000100:00100000:1.0:1787787560.298788:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503825280 00000100:00100000:3.0:1787787560.298809:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787560.298825:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503826304:0@lo:400:kworker.0 00000100:00100000:1.0:1787787560.298840:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787787560.298843:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787560.298850:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41ce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1874630503825280:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787787560.298856:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503826816:0@lo:400:kworker.0 00002000:00000024:1.0:1787787560.298873:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787787560.298876:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787560.298915:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41ce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3656:x1874630503825280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787560.298922:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787787560.298931:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503825280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787560.298946:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503826816 00000100:00100000:1.0:1787787560.298949:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503826816 00000100:00100000:3.0:1787787560.298950:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787787560.298955:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503825664:0@lo:400:kworker.0 00000100:00100000:1.0:1787787560.298976:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787787560.298978:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787560.298983:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed9261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503826816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787560.298994:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503826176:0@lo:400:kworker.0 00000100:00100000:3.0:1787787560.299012:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787560.299013:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed9261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1874630503826816:12345-0@lo:400:kworker.0 Request processed in 30us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787560.299019:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787787560.299026:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874630503826688:0@lo:400:kworker.0 00000100:00100000:1.0:1787787560.299035:0:25288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503825792 00000100:00100000:1.0:1787787560.299038:0:25288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503825792 00000100:00100000:1.0:1787787560.299058:0:25288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503826304 00000100:00100000:1.0:1787787560.299061:0:25288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503826304 00000100:00100000:1.0:1787787560.299074:0:25288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503825664 00000100:00100000:1.0:1787787560.299076:0:25288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503825664 00000100:00100000:1.0:1787787560.299089:0:25288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503826176 00000100:00100000:1.0:1787787560.299091:0:25288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503826176 00000100:00100000:1.0:1787787560.299105:0:25288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787787560.299111:0:25288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed927c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3656:x1874630503825792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787560.299175:0:25288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed927c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3656:x1874630503825792:12345-0@lo:400:kworker.0 Request processed in 64us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787560.299182:0:25288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787787560.299194:0:25288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787787560.299200:0:25288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503826304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787560.299225:0:25288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503826304:12345-0@lo:400:kworker.0 Request processed in 26us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787560.299231:0:25288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787787560.299242:0:25288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787787560.299247:0:25288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed926580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503825664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787560.299272:0:25288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed926580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503825664:12345-0@lo:400:kworker.0 Request processed in 25us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787560.299277:0:25288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787787560.299288:0:25288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787787560.299293:0:25288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed9252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503826176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787560.299318:0:25288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed9252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503826176:12345-0@lo:400:kworker.0 Request processed in 25us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787560.299323:0:25288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787787560.299440:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3fd2c107-7647-408e-8048-4ef16ee44cbc:3653:1874630503825408:0@lo:400:kworker.0 00000100:00100000:0.0:1787787560.299489:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787560.299524:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503825920:0@lo:400:kworker.0 00000100:00100000:0.0:1787787560.299557:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787560.299574:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503826432:0@lo:400:kworker.0 00000100:00100000:0.0:1787787560.299593:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787560.299607:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503826944:0@lo:400:kworker.0 00000100:00100000:0.0:1787787560.299642:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787560.299662:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787787560.299668:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503825536:0@lo:400:kworker.0 00000100:00100000:0.0:1787787560.299690:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787560.299709:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503826048:0@lo:400:kworker.0 00000100:00100000:0.0:1787787560.299730:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787560.299742:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503826560:0@lo:400:kworker.0 00000100:00100000:0.0:1787787560.299760:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787787560.299779:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787787560.299784:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787787560.299786:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787787560.299800:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503825536 00000100:00100000:0.0:1787787560.299804:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503825536 00000100:00100000:0.0:1787787560.299829:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503826048 00000100:00100000:0.0:1787787560.299832:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503826048 00000100:00100000:0.0:1787787560.299847:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787787560.299852:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503825536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787560.299883:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787560.299888:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503825536:12345-0@lo:400:kworker.0 Request processed in 36us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787560.299893:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787787560.299903:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503825792:0@lo:400:kworker.0 00000100:00100000:0.0:1787787560.299906:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787787560.299911:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503826048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787560.299913:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503826304:0@lo:400:kworker.0 00000100:00100000:3.0:1787787560.299923:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3656:1874630503826816:0@lo:400:kworker.0 00000100:00100000:0.0:1787787560.299936:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503826048:12345-0@lo:400:kworker.0 Request processed in 26us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787560.299942:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787787560.299944:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503825664:0@lo:400:kworker.0 00000100:00100000:3.0:1787787560.299953:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503826176:0@lo:400:kworker.0 00000100:00100000:0.0:1787787560.299962:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503825536:0@lo:400:kworker.0 00000100:00100000:3.0:1787787560.299981:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503825920 00000100:00100000:0.0:1787787560.299981:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503826048:0@lo:400:kworker.0 00000100:00100000:3.0:1787787560.299984:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503825920 00000100:00100000:3.0:1787787560.300000:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503826944 00000100:00100000:0.0:1787787560.300000:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503826432 00000100:00100000:3.0:1787787560.300002:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503826944 00000100:00100000:0.0:1787787560.300002:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503826432 00000100:00100000:0.0:1787787560.300014:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503826560 00000100:00100000:0.0:1787787560.300016:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503826560 00000100:00100000:3.0:1787787560.300017:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503826688 00000100:00100000:3.0:1787787560.300019:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503826688 00000100:00100000:0.0:1787787560.300029:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787787560.300034:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503825920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787560.300081:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503825408 00000100:00100000:1.0:1787787560.300085:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503825408 00000100:00100000:1.0:1787787560.300110:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787787560.300116:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f521f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:3653:x1874630503825408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787560.300168:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f521f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:3653:x1874630503825408:12345-0@lo:400:kworker.0 Request processed in 52us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787560.300175:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1787787560.300217:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787787560.300220:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787787560.300228:0:22714:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787787560.300235:0:22714:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787787560.300291:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787787560.300299:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503826432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787560.300330:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874630503826432:12345-0@lo:400:kworker.0 Request processed in 33us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787560.300335:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787787560.300353:0:22715:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787787560.300359:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787787560.300364:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503826944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787560.300392:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874630503826944:12345-0@lo:400:kworker.0 Request processed in 28us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787560.300397:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787787560.300406:0:22715:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787787560.300410:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787787560.300415:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874630503826560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787560.300439:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874630503826560:12345-0@lo:400:kworker.0 Request processed in 24us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787560.300445:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787787560.300457:0:22715:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787787560.300463:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787787560.300470:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed924b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874630503826688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787560.300498:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed924b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1874630503826688:12345-0@lo:400:kworker.0 Request processed in 30us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787560.300503:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787787560.300511:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3653:1874630503826560:0@lo:400:kworker.0 00000100:00100000:1.0:1787787560.300519:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3fd2c107-7647-408e-8048-4ef16ee44cbc:3653:1874630503825408:0@lo:400:kworker.0 00010000:00080000:3.0:1787787560.300525:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc24b43c0 x1874630503826688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787560.300542:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874630503826432:0@lo:400:kworker.0 00010000:00080000:1.0:1787787560.300552:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc24b4000 x1874630503826944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787560.300561:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3653:1874630503826944:0@lo:400:kworker.0 00000100:00100000:3.0:1787787560.300598:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3656:1874630503826688:0@lo:400:kworker.0 00000100:00100000:0.0:1787787560.300656:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874630503825920:12345-0@lo:400:kworker.0 Request processed in 620us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787560.300663:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787787560.300779:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503827072:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787787560.300832:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787560.300980:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503827072 00000100:00100000:0.0:1787787560.300985:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503827072 00000100:00100000:0.0:1787787560.301022:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787787560.301029:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503827072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787787560.301044:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787787560.301078:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503827072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787560.301084:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787787560.301182:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503827072:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787787560.301346:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874630503825920:0@lo:400:kworker.0 00010000:00010000:1.0:1787787560.361435:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787787560.817686:0:25038:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a65d3225-1272-4ba4-9698-bcc15a4206b3 00000001:00080000:1.0:1787787560.817706:0:25038:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:2.0:1787787561.321551:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787787561.321580:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed9270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503827200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787787561.321653:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787561.321771:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503827200 00000100:00100000:0.0:1787787561.321780:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503827200 00000100:00100000:0.0:1787787561.321878:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787787561.321888:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503827200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787787561.321935:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787787561.322002:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503827200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787561.322010:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787787561.322124:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed9270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503827200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787787561.335233:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787561.336614:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484842624 00000100:00100000:1.0:1787787561.336628:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484842624 00000100:00100000:1.0:1787787561.336767:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14 00000100:00100000:1.0:1787787561.336777:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+7:18184:x1874630484842624:12345-192.168.204.31@tcp:41:lfs.0 00000004:00000024:1.0:1787787561.336837:0:22714:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787787561.336939:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+7:18184:x1874630484842624:12345-192.168.204.31@tcp:41:lfs.0 Request processed in 162us (1717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787561.336946:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14 00000100:00080000:0.0:1787787561.338795:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787561.342477:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787561.342551:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484842752 00000100:00100000:3.0:1787787561.342572:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484842752 00000100:00080000:0.0:1787787561.342628:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787787561.342651:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15 00000100:00100000:3.0:1787787561.342661:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+6:18184:x1874630484842752:12345-192.168.204.31@tcp:41:lfs.0 00000004:00000024:3.0:1787787561.342720:0:22715:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787787561.342804:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+6:18184:x1874630484842752:12345-192.168.204.31@tcp:41:lfs.0 Request processed in 144us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787561.342811:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15 00000100:00100000:3.0:1787787561.348106:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787561.348286:0:24224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484842880 00000100:00100000:2.0:1787787561.348297:0:24224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484842880 00000100:00100000:2.0:1787787561.348450:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 12 00000100:00100000:2.0:1787787561.348461:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed9270c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a65d3225-1272-4ba4-9698-bcc15a4206b3+6:18184:x1874630484842880:12345-192.168.204.31@tcp:13:lfs.0 00002000:00000024:2.0:1787787561.348487:0:24224:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1787787561.348599:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed9270c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a65d3225-1272-4ba4-9698-bcc15a4206b3+6:18184:x1874630484842880:12345-192.168.204.31@tcp:13:lfs.0 Request processed in 140us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787561.348607:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 12 00000100:00080000:0.0:1787787561.349123:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787561.352693:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787561.353117:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484843008 00000100:00100000:1.0:1787787561.353127:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484843008 00000100:00100000:1.0:1787787561.353226:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13 00000100:00100000:1.0:1787787561.353258:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a07c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a65d3225-1272-4ba4-9698-bcc15a4206b3+5:18184:x1874630484843008:12345-192.168.204.31@tcp:13:lfs.0 00002000:00000024:1.0:1787787561.353291:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787787561.353635:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a07c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a65d3225-1272-4ba4-9698-bcc15a4206b3+5:18184:x1874630484843008:12345-192.168.204.31@tcp:13:lfs.0 Request processed in 385us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787561.353644:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13 00000100:00080000:0.0:1787787561.355059:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787787561.385545:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787561.568375:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787561.568804:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484843136 00000100:00100000:2.0:1787787561.568814:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484843136 00000100:00100000:2.0:1787787561.568873:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 130 00000100:00100000:2.0:1787787561.568883:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f521c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b13f583f-f513-4656-8252-cd03f2d0eada+10:18218:x1874630484843136:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787787561.568899:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787561.568916:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff987101ee2600/0x11620bc3f30aaca6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8738 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787561.569833:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff987101ee2600/0x11620bc3f30aaca6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8738 expref: 11 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787561.569850:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff987101ee2600/0x11620bc3f30aaca6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8738 expref: 11 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787561.569877:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2600, rc 0) 00000100:00100000:2.0:1787787561.570287:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f521c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b13f583f-f513-4656-8252-cd03f2d0eada+11:18218:x1874630484843136:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 1403us (1920us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787561.570296:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 130 00000100:00100000:3.0:1787787561.581541:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787561.581830:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484843264 00000100:00100000:1.0:1787787561.581843:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484843264 00000100:00100000:1.0:1787787561.581931:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 131 00000100:00100000:1.0:1787787561.581942:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f521d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b13f583f-f513-4656-8252-cd03f2d0eada+11:18218:x1874630484843264:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787787561.582434:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f521d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b13f583f-f513-4656-8252-cd03f2d0eada+11:18218:x1874630484843264:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 491us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787561.582444:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 131 00000100:00100000:0.0:1787787561.590325:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787561.590536:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484843392 00000100:00100000:2.0:1787787561.590546:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484843392 00000100:00100000:2.0:1787787561.590600:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 132 00000100:00100000:2.0:1787787561.590611:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b13f583f-f513-4656-8252-cd03f2d0eada+11:18218:x1874630484843392:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787787561.590800:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b13f583f-f513-4656-8252-cd03f2d0eada+11:18218:x1874630484843392:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 190us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787561.590808:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 132 00000100:00100000:3.0:1787787561.594416:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787561.594602:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484843520 00000100:00100000:2.0:1787787561.594726:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484843520 00000100:00100000:2.0:1787787561.594800:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 133 00000100:00100000:2.0:1787787561.594811:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b13f583f-f513-4656-8252-cd03f2d0eada+11:18224:x1874630484843520:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787787561.595020:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b13f583f-f513-4656-8252-cd03f2d0eada+11:18224:x1874630484843520:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 211us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787561.595029:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 133 00000100:00100000:3.0:1787787561.616371:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787561.621726:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484843648 00000100:00100000:2.0:1787787561.621749:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484843648 00000100:00100000:2.0:1787787561.622013:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 134 00000100:00100000:2.0:1787787561.622028:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b13f583f-f513-4656-8252-cd03f2d0eada+11:18224:x1874630484843648:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787787561.622300:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b13f583f-f513-4656-8252-cd03f2d0eada+11:18224:x1874630484843648:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 275us (5943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787561.622329:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 134 00000100:00100000:0.0:1787787561.625982:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787561.626104:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484843776 00000100:00100000:2.0:1787787561.626119:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484843776 00000100:00100000:2.0:1787787561.626391:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 135 00000100:00100000:2.0:1787787561.626404:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b13f583f-f513-4656-8252-cd03f2d0eada+11:18224:x1874630484843776:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787787561.626780:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b13f583f-f513-4656-8252-cd03f2d0eada+11:18224:x1874630484843776:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 377us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787561.626789:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 135 00000100:00100000:3.0:1787787561.634931:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787561.635391:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484843904 00000100:00100000:2.0:1787787561.635406:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484843904 00000100:00100000:2.0:1787787561.635483:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 136 00000100:00100000:2.0:1787787561.635495:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b13f583f-f513-4656-8252-cd03f2d0eada+11:18218:x1874630484843904:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787787561.635530:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787561.635553:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff987101ee3a00/0x11620bc3f30aacad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8769 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787561.635601:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff987101ee3a00/0x11620bc3f30aacad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8769 expref: 12 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787561.635624:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff987101ee3a00/0x11620bc3f30aacad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8769 expref: 12 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787561.635850:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3a00, rc 0) 00000100:00100000:2.0:1787787561.635940:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b13f583f-f513-4656-8252-cd03f2d0eada+12:18218:x1874630484843904:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 447us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787561.635948:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 136 00000100:00100000:0.0:1787787561.641068:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787561.641491:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484844032 00000100:00100000:3.0:1787787561.641516:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484844032 00000100:00100000:0.0:1787787561.642282:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 137 00000100:00100000:0.0:1787787561.642300:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b13f583f-f513-4656-8252-cd03f2d0eada+12:18218:x1874630484844032:12345-192.168.204.31@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787787561.642339:0:22708:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787787561.642377:0:22708:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787787561.642381:0:22708:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787787561.642385:0:22708:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787787561.642389:0:22708:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787787561.642391:0:22708:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1787787561.644985:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b13f583f-f513-4656-8252-cd03f2d0eada+12:18218:x1874630484844032:12345-192.168.204.31@tcp:256:mount.lustre.0 Request processed in 2673us (3912us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787561.645004:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 137 00000100:00100000:3.0:1787787561.649320:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787561.650311:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484844160 00000100:00100000:2.0:1787787561.650328:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484844160 00000100:00100000:2.0:1787787561.650424:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 138 00000100:00100000:2.0:1787787561.650437:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b13f583f-f513-4656-8252-cd03f2d0eada+12:18218:x1874630484844160:12345-192.168.204.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787787561.650460:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787561.650484:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aacb4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8770 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787561.650535:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aacb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8770 expref: 13 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787561.650549:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aacb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8770 expref: 13 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787561.650569:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2a00, rc 0) 00000100:00100000:2.0:1787787561.650808:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b13f583f-f513-4656-8252-cd03f2d0eada+13:18218:x1874630484844160:12345-192.168.204.31@tcp:101:mount.lustre.0 Request processed in 373us (1501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787561.650817:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 138 00000100:00100000:0.0:1787787561.655619:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787561.656110:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484844288 00000100:00100000:1.0:1787787561.657343:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484844288 00000100:00100000:1.0:1787787561.657531:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 139 00000100:00100000:1.0:1787787561.657545:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b13f583f-f513-4656-8252-cd03f2d0eada+13:18218:x1874630484844288:12345-192.168.204.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787787561.657978:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b13f583f-f513-4656-8252-cd03f2d0eada+13:18218:x1874630484844288:12345-192.168.204.31@tcp:501:mount.lustre.0 Request processed in 434us (2855us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787561.657987:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 139 00000100:00100000:0.0:1787787561.662943:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787561.663061:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484844416 00000100:00100000:1.0:1787787561.663074:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484844416 00000100:00100000:1.0:1787787561.663335:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 140 00000100:00100000:1.0:1787787561.663348:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b13f583f-f513-4656-8252-cd03f2d0eada+13:18218:x1874630484844416:12345-192.168.204.31@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787787561.663572:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b13f583f-f513-4656-8252-cd03f2d0eada+13:18218:x1874630484844416:12345-192.168.204.31@tcp:503:mount.lustre.0 Request processed in 226us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787561.663581:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 140 00000100:00100000:2.0:1787787561.669987:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787561.670462:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484844544 00000100:00100000:0.0:1787787561.670478:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484844544 00000100:00100000:0.0:1787787561.670572:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 141 00000100:00100000:0.0:1787787561.670584:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b13f583f-f513-4656-8252-cd03f2d0eada+13:18230:x1874630484844544:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787787561.670820:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b13f583f-f513-4656-8252-cd03f2d0eada+13:18230:x1874630484844544:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 238us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787561.670829:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 141 00000100:00100000:0.0:1787787561.674712:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787561.675369:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484844672 00000100:00100000:1.0:1787787561.675384:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484844672 00000100:00100000:1.0:1787787561.675544:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 142 00000100:00100000:1.0:1787787561.675737:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b13f583f-f513-4656-8252-cd03f2d0eada+13:18230:x1874630484844672:12345-192.168.204.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787787561.676308:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b13f583f-f513-4656-8252-cd03f2d0eada+13:18230:x1874630484844672:12345-192.168.204.31@tcp:502:llog_process_th.0 Request processed in 752us (1608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787561.676320:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 142 00000100:00100000:1.0:1787787561.679588:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787561.679715:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484844800 00000100:00100000:2.0:1787787561.679729:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484844800 00000100:00100000:2.0:1787787561.679790:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16 00000100:00100000:2.0:1787787561.679799:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc24b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2390:x1874630484844800:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787787561.679841:0:22714:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from eb47d838-e4ce-420a-9c06-daf336fc8d65@192.168.204.31@tcp t0 exp 0000000000000000 cur 705 last 0 00000020:00000080:2.0:1787787561.679904:0:22714:0:(genops.c:1385:class_connect()) connect: client eb47d838-e4ce-420a-9c06-daf336fc8d65, cookie 0x11620bc3f30aacbb 00000004:00100000:2.0:1787787561.679939:0:22714:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787787561.680077:0:22714:0:(import.c:65:import_set_state_nolock()) ffff986fc39da800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787787561.680232:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc24b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb47d838-e4ce-420a-9c06-daf336fc8d65+6:2390:x1874630484844800:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 432us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787561.680240:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16 00000100:00100000:2.0:1787787561.689708:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787561.689756:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787561.692296:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484844928 00000100:00100000:1.0:1787787561.692321:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484844928 00000100:00100000:0.0:1787787561.692728:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484845056 00000100:00100000:0.0:1787787561.692734:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484845056 00000100:00100000:0.0:1787787561.692766:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 17 00000100:00100000:0.0:1787787561.692777:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb47d838-e4ce-420a-9c06-daf336fc8d65+6:0:x1874630484844928:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787787561.692821:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787787561.692927:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb47d838-e4ce-420a-9c06-daf336fc8d65+6:0:x1874630484844928:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 152us (3237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787561.692935:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 17 00000100:00100000:0.0:1787787561.692953:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 18 00000100:00100000:0.0:1787787561.692958:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2390:x1874630484845056:12345-192.168.204.31@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787787561.692985:0:22716:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from eb47d838-e4ce-420a-9c06-daf336fc8d65@192.168.204.31@tcp t0 exp 0000000000000000 cur 705 last 0 00000020:00000080:0.0:1787787561.693026:0:22716:0:(genops.c:1385:class_connect()) connect: client eb47d838-e4ce-420a-9c06-daf336fc8d65, cookie 0x11620bc3f30aacc2 00000004:00100000:0.0:1787787561.693057:0:22716:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787787561.693376:0:22716:0:(import.c:65:import_set_state_nolock()) ffff986fc43bd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787787561.693410:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb47d838-e4ce-420a-9c06-daf336fc8d65+6:2390:x1874630484845056:12345-192.168.204.31@tcp:38:mount.lustre.0 Request processed in 451us (3653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787561.693484:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 18 00000100:00080000:1.0:1787787561.693589:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787787561.696254:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787561.696588:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484845312 00000100:00100000:1.0:1787787561.696601:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484845312 00000100:00100000:1.0:1787787561.696676:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 19 00000100:00100000:1.0:1787787561.696687:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb47d838-e4ce-420a-9c06-daf336fc8d65+6:18218:x1874630484845312:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787787561.696727:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787787561.697658:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb47d838-e4ce-420a-9c06-daf336fc8d65+6:18218:x1874630484845312:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 963us (1409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787561.697672:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 19 00000100:00100000:1.0:1787787561.699797:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787561.700352:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484845184 00000100:00100000:0.0:1787787561.700366:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484845184 00000100:00100000:0.0:1787787561.700582:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 20 00000100:00100000:0.0:1787787561.700594:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc24b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb47d838-e4ce-420a-9c06-daf336fc8d65+6:0:x1874630484845184:12345-192.168.204.31@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787787561.700635:0:22715:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787787561.700734:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc24b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb47d838-e4ce-420a-9c06-daf336fc8d65+6:0:x1874630484845184:12345-192.168.204.31@tcp:41:mount.lustre.0 Request processed in 141us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787561.700763:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 20 00000100:00080000:1.0:1787787561.701319:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787787561.712845:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787561.713403:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484845440 00000100:00100000:0.0:1787787561.713418:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484845440 00000100:00100000:0.0:1787787561.713517:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 21 00000100:00100000:0.0:1787787561.713529:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc24b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb47d838-e4ce-420a-9c06-daf336fc8d65+6:18218:x1874630484845440:12345-192.168.204.31@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787787561.713798:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc24b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb47d838-e4ce-420a-9c06-daf336fc8d65+6:18218:x1874630484845440:12345-192.168.204.31@tcp:40:mount.lustre.0 Request processed in 270us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787561.713807:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 21 00000100:00100000:3.0:1787787561.721460:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787561.721526:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787561.721570:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787561.721738:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484845824 00000100:00100000:2.0:1787787561.721753:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484845824 00000100:00100000:2.0:1787787561.721826:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4 00000100:00100000:2.0:1787787561.721837:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:eb47d838-e4ce-420a-9c06-daf336fc8d65+6:18218:x1874630484845824:12345-192.168.204.31@tcp:900:mount.lustre.0 00000100:00100000:2.0:1787787561.721944:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:eb47d838-e4ce-420a-9c06-daf336fc8d65+6:18218:x1874630484845824:12345-192.168.204.31@tcp:900:mount.lustre.0 Request processed in 109us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787561.721953:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4 00000100:00100000:1.0:1787787561.722346:0:25288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484845568 00000100:00100000:1.0:1787787561.722353:0:25288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484845568 00000100:00100000:1.0:1787787561.722389:0:25288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484845696 00000100:00100000:1.0:1787787561.722392:0:25288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484845696 00000100:00100000:1.0:1787787561.722420:0:25288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 24 00000100:00100000:1.0:1787787561.722427:0:25288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2390:x1874630484845568:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787787561.722461:0:25288:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from eb47d838-e4ce-420a-9c06-daf336fc8d65@192.168.204.31@tcp t0 exp 0000000000000000 cur 705 last 0 00000020:00000080:1.0:1787787561.722521:0:25288:0:(genops.c:1385:class_connect()) connect: client eb47d838-e4ce-420a-9c06-daf336fc8d65, cookie 0x11620bc3f30aacc9 00002000:00100000:1.0:1787787561.722537:0:25288:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli eb47d838-e4ce-420a-9c06-daf336fc8d65/ffff9870f6931000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113934 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787787561.722560:0:25288:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787787561.722651:0:25288:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787787561.722687:0:25288:0:(import.c:65:import_set_state_nolock()) ffff9870f6934800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787787561.722729:0:25288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb47d838-e4ce-420a-9c06-daf336fc8d65+6:2390:x1874630484845568:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 301us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787561.722737:0:25288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 24 00000100:00100000:1.0:1787787561.722753:0:25288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 25 00000100:00100000:1.0:1787787561.722757:0:25288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2390:x1874630484845696:12345-192.168.204.31@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787787561.722772:0:25288:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from eb47d838-e4ce-420a-9c06-daf336fc8d65@192.168.204.31@tcp t0 exp 0000000000000000 cur 705 last 0 00000020:00000080:1.0:1787787561.722790:0:25288:0:(genops.c:1385:class_connect()) connect: client eb47d838-e4ce-420a-9c06-daf336fc8d65, cookie 0x11620bc3f30aacd0 00002000:00100000:1.0:1787787561.722796:0:25288:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli eb47d838-e4ce-420a-9c06-daf336fc8d65/ffff9870f6932000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113934 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787787561.722803:0:25288:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787787561.722853:0:25288:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787787561.722881:0:25288:0:(import.c:65:import_set_state_nolock()) ffff9870f6936800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787787561.722902:0:25288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb47d838-e4ce-420a-9c06-daf336fc8d65+6:2390:x1874630484845696:12345-192.168.204.31@tcp:8:mount.lustre.0 Request processed in 144us (1332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787561.722924:0:25288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 25 00000100:00100000:2.0:1787787561.725831:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787561.726187:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484845952 00000100:00100000:3.0:1787787561.726201:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484845952 00000100:00100000:3.0:1787787561.726271:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1 00000100:00100000:3.0:1787787561.726282:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb47d838-e4ce-420a-9c06-daf336fc8d65+6:18218:x1874630484845952:12345-192.168.204.31@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787787561.726395:0:22718:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787787561.726499:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb47d838-e4ce-420a-9c06-daf336fc8d65+6:18218:x1874630484845952:12345-192.168.204.31@tcp:33:mount.lustre.0 Request processed in 218us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787561.726520:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1 00000100:00100000:1.0:1787787561.925129:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787561.925409:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484846080 00000100:00100000:0.0:1787787561.925436:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484846080 00000100:00100000:0.0:1787787561.925537:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 22 00000100:00100000:0.0:1787787561.925551:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb47d838-e4ce-420a-9c06-daf336fc8d65+6:18253:x1874630484846080:12345-192.168.204.31@tcp:101:mkdir.0 00010000:00010000:0.0:1787787561.925582:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787561.925619:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15000/0x11620bc3f30aacd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c87a1 expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787561.925822:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14200/0x11620bc3f30aacde lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787561.925841:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14200/0x11620bc3f30aacde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787561.925929:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14200/0x11620bc3f30aacde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787561.925997:0:22715:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787787561.926001:0:22715:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787787561.926050:0:22715:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14200/0x11620bc3f30aacde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787561.926086:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15000/0x11620bc3f30aacd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87a1 expref: 8 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787561.926110:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14200/0x11620bc3f30aacde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87a1 expref: 7 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787561.926119:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a1de00) 00010000:00010000:0.0:1787787561.926123:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787787561.926127:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c14200, rc 0) 00000100:00100000:1.0:1787787561.927769:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb47d838-e4ce-420a-9c06-daf336fc8d65+7:18253:x1874630484846080:12345-192.168.204.31@tcp:101:mkdir.0 Request processed in 2205us (2639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787561.927783:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 22 00010000:00010000:2.0:1787787562.412025:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787787562.665944:0:22750:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787787563.370592:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787787563.370934:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503827328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787787563.371033:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787563.371276:0:24224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503827328 00000100:00100000:2.0:1787787563.371287:0:24224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503827328 00000100:00100000:2.0:1787787563.371353:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787787563.371365:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503827328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787787563.371406:0:24224:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1787787563.371481:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503827328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787563.371492:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787787563.371571:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503827328:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787787563.371896:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787563.371916:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503827456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787787563.371959:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787563.374861:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503827456 00000100:00100000:0.0:1787787563.374879:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503827456 00000100:00100000:0.0:1787787563.374948:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787787563.374958:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503827456:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787787563.374990:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00000024:0.0:1787787563.374996:0:23456:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787787563.375005:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503827584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787563.381405:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503827456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6426us (9422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787563.381430:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787787563.381735:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787563.381829:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503827456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787787563.384991:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503827584 00000100:00100000:0.0:1787787563.385008:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503827584 00000100:00100000:0.0:1787787563.385073:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787787563.385084:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503827584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787787563.385127:0:22720:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787787563.385252:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503827584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 169us (3518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787563.385260:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787787563.385853:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503827584:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787787563.433278:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787787564.265860:0:23468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787787564.457853:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787787564.907433:0:24216:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of eb47d838-e4ce-420a-9c06-daf336fc8d65 00000001:00100000:1.0:1787787564.907457:0:24216:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a65d3225-1272-4ba4-9698-bcc15a4206b3 00000001:00100000:3.0:1787787564.907610:0:22694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of eb47d838-e4ce-420a-9c06-daf336fc8d65 00000001:00100000:3.0:1787787564.907618:0:22694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a65d3225-1272-4ba4-9698-bcc15a4206b3 00000001:00100000:0.0:1787787564.912772:0:23448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of eb47d838-e4ce-420a-9c06-daf336fc8d65 00000001:00100000:0.0:1787787564.912786:0:23448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a65d3225-1272-4ba4-9698-bcc15a4206b3 00000001:02000400:3.0:1787787565.099796:0:25597:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1787787565.417440:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787787565.417468:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503827712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787787565.417570:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787565.419191:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503827840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787787565.419265:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787565.420093:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503827712 00000100:00100000:3.0:1787787565.420105:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503827712 00000100:00100000:3.0:1787787565.420183:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503827840 00000100:00100000:3.0:1787787565.420187:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503827840 00000100:00100000:3.0:1787787565.420208:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787787565.420217:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a06940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503827712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787787565.420252:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787787565.420313:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a06940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503827712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (2743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787565.420319:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787787565.420334:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787787565.420339:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503827840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787787565.420362:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787787565.420384:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503827840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787565.420390:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787787565.420443:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503827840:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787787565.420456:0:3656:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1787787565.420473:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503827712:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787787565.420863:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787787565.435358:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787787565.436808:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503828096:0@lo:400:kworker.0 00000100:00100000:0.0:1787787565.437018:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787565.437076:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3fd2c107-7647-408e-8048-4ef16ee44cbc:3654:1874630503827968:0@lo:400:kworker.0 00000100:00100000:0.0:1787787565.437105:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787565.437278:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503828096 00000100:00100000:1.0:1787787565.437286:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503828096 00000100:00100000:1.0:1787787565.437339:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787787565.437349:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503828096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787565.437409:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503828096:12345-0@lo:400:kworker.0 Request processed in 62us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787565.437416:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787787565.437469:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503828096:0@lo:400:kworker.0 00000100:00100000:3.0:1787787565.437928:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503828480:0@lo:400:kworker.0 00000100:00100000:3.0:1787787565.437979:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787565.438000:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503828992:0@lo:400:kworker.0 00000100:00100000:3.0:1787787565.438023:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787565.438044:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787787565.438050:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503828608:0@lo:400:kworker.0 00000100:00100000:3.0:1787787565.438073:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787565.438092:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874630503829120:0@lo:400:kworker.0 00000100:00100000:3.0:1787787565.438113:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787565.438163:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503828992 00000100:00100000:3.0:1787787565.438168:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503828992 00000100:00100000:3.0:1787787565.438208:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503829120 00000100:00100000:3.0:1787787565.438211:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503829120 00000100:00100000:3.0:1787787565.438231:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787787565.438239:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503828992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787565.438279:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503828992:12345-0@lo:400:kworker.0 Request processed in 41us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787565.438285:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787787565.438298:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787787565.438304:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874630503829120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787565.438331:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874630503829120:12345-0@lo:400:kworker.0 Request processed in 28us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787565.438337:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787787565.438354:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503828608 00000100:00100000:3.0:1787787565.438357:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503828608 00000100:00100000:3.0:1787787565.438382:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787787565.438389:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503828608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787565.438812:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503828608:12345-0@lo:400:kworker.0 Request processed in 422us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787565.438819:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787787565.438862:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503828224:0@lo:400:kworker.0 00000100:00100000:3.0:1787787565.438890:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787565.438912:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503828736:0@lo:400:kworker.0 00000100:00100000:3.0:1787787565.438934:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787565.438949:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503829248:0@lo:400:kworker.0 00000100:00100000:3.0:1787787565.438969:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787565.438987:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787787565.438993:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503828352:0@lo:400:kworker.0 00000100:00100000:3.0:1787787565.439011:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787565.439027:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503828864:0@lo:400:kworker.0 00000100:00100000:3.0:1787787565.439046:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787565.439066:0:24939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503828224 00000100:00100000:3.0:1787787565.439070:0:24939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503828224 00000100:00100000:3.0:1787787565.439100:0:24939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787787565.439106:0:24939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503828224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787565.439166:0:24939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503828224:12345-0@lo:400:kworker.0 Request processed in 60us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787565.439172:0:24939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787787565.439187:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503828736 00000100:00100000:3.0:1787787565.439190:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503828736 00000100:00100000:3.0:1787787565.439205:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503829248 00000100:00100000:3.0:1787787565.439208:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503829248 00000100:00100000:3.0:1787787565.439219:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503828352 00000100:00100000:3.0:1787787565.439230:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503828352 00000100:00100000:3.0:1787787565.439244:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503828864 00000100:00100000:3.0:1787787565.439246:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503828864 00000100:00100000:3.0:1787787565.439260:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787787565.439266:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503828736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787565.439296:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503828736:12345-0@lo:400:kworker.0 Request processed in 31us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787565.439302:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787787565.439313:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787787565.439319:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503829248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787565.439345:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503829248:12345-0@lo:400:kworker.0 Request processed in 26us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787565.439350:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787787565.439360:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787787565.439366:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503828352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787565.439411:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503828352:12345-0@lo:400:kworker.0 Request processed in 45us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787565.439417:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787787565.439796:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503828480 00000100:00100000:0.0:1787787565.439801:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503828480 00000100:00100000:0.0:1787787565.439841:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787787565.439848:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503828480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787565.439884:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503828480:12345-0@lo:400:kworker.0 Request processed in 37us (1905us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787565.439890:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787787565.440014:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787787565.440024:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503828864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787565.440058:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3655:x1874630503828864:12345-0@lo:400:kworker.0 Request processed in 38us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787565.440073:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1787787565.440212:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787787565.440218:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787787565.440220:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787787565.440257:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503828608:0@lo:400:kworker.0 00000100:00100000:0.0:1787787565.440275:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874630503829120:0@lo:400:kworker.0 00000100:00100000:0.0:1787787565.440285:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503828480:0@lo:400:kworker.0 00010000:00080000:0.0:1787787565.440308:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36ea580 x1874630503828992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787787565.440319:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503828992:0@lo:400:kworker.0 00000100:00100000:3.0:1787787565.440411:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503828352:0@lo:400:kworker.0 00000100:00100000:3.0:1787787565.440421:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3655:1874630503828864:0@lo:400:kworker.0 00000100:00100000:3.0:1787787565.440729:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503828224:0@lo:400:kworker.0 00000100:00100000:3.0:1787787565.440740:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503828736:0@lo:400:kworker.0 00010000:00080000:3.0:1787787565.440752:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc36e8f00 x1874630503829248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787565.440772:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503829248:0@lo:400:kworker.0 00000100:00100000:2.0:1787787565.441216:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503827968 00000100:00100000:2.0:1787787565.441223:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503827968 00000100:00100000:3.0:1787787565.441385:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787787565.441394:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:3654:x1874630503827968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787565.441475:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:3654:x1874630503827968:12345-0@lo:400:kworker.0 Request processed in 83us (4368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787565.441492:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787787565.441586:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3fd2c107-7647-408e-8048-4ef16ee44cbc:3654:1874630503827968:0@lo:400:kworker.0 00010000:00010000:2.0:1787787565.481334:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787566.444053:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503829376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787787566.444176:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787566.444246:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503829376 00000100:00100000:3.0:1787787566.444255:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503829376 00000100:00100000:3.0:1787787566.444311:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787787566.444321:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503829376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787787566.444372:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787787566.444429:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503829376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787566.444437:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787787566.444485:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503829376:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787787566.508221:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787566.776592:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787566.776654:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787566.776704:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787566.776724:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787566.776761:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484846592 00000100:00100000:2.0:1787787566.776774:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484846592 00000100:00100000:2.0:1787787566.776854:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484847104 00000100:00100000:2.0:1787787566.776858:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484847104 00000100:00100000:2.0:1787787566.776884:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11 00000100:00100000:2.0:1787787566.776896:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+5:2394:x1874630484846592:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787566.776990:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+5:2394:x1874630484846592:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 95us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787566.776998:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11 00000100:00100000:2.0:1787787566.777017:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 12 00000100:00100000:2.0:1787787566.777023:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb47d838-e4ce-420a-9c06-daf336fc8d65+5:2394:x1874630484847104:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787566.777047:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb47d838-e4ce-420a-9c06-daf336fc8d65+5:2394:x1874630484847104:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787566.777053:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 12 00000100:00100000:2.0:1787787566.777093:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787566.777196:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787566.777219:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484846336 00000100:00100000:2.0:1787787566.777223:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484846336 00000100:00100000:2.0:1787787566.777253:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484846848 00000100:00100000:2.0:1787787566.777257:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484846848 00000100:00100000:2.0:1787787566.777295:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484846464 00000100:00100000:2.0:1787787566.777298:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484846464 00000100:00100000:2.0:1787787566.777314:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 42 00000100:00100000:2.0:1787787566.777321:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+6:2394:x1874630484846336:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787566.777354:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+6:2394:x1874630484846336:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 33us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787566.777361:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 42 00000100:00100000:2.0:1787787566.777373:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 43 00000100:00100000:2.0:1787787566.777379:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb47d838-e4ce-420a-9c06-daf336fc8d65+6:2394:x1874630484846848:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787566.777413:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb47d838-e4ce-420a-9c06-daf336fc8d65+6:2394:x1874630484846848:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787566.777420:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 43 00000100:00100000:2.0:1787787566.777431:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 44 00000100:00100000:2.0:1787787566.777437:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+5:2394:x1874630484846464:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787566.777461:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+5:2394:x1874630484846464:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787566.777468:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 44 00000100:00100000:2.0:1787787566.777520:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787566.777540:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484846720 00000100:00100000:2.0:1787787566.777543:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484846720 00000100:00100000:2.0:1787787566.777571:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13 00000100:00100000:2.0:1787787566.777578:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c735e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+5:2394:x1874630484846720:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787566.777602:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c735e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+5:2394:x1874630484846720:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 25us (83us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787566.777609:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13 00000100:00100000:2.0:1787787566.777795:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787566.777811:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484846976 00000100:00100000:2.0:1787787566.777815:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484846976 00000100:00100000:2.0:1787787566.777840:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 45 00000100:00100000:2.0:1787787566.777847:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb47d838-e4ce-420a-9c06-daf336fc8d65+5:2394:x1874630484846976:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787566.777869:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb47d838-e4ce-420a-9c06-daf336fc8d65+5:2394:x1874630484846976:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (76us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787566.777876:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 45 00000100:00100000:2.0:1787787566.777921:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787566.777939:0:24939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484847232 00000100:00100000:2.0:1787787566.777942:0:24939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484847232 00000100:00100000:2.0:1787787566.777965:0:24939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14 00000100:00100000:2.0:1787787566.777972:0:24939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb47d838-e4ce-420a-9c06-daf336fc8d65+6:2394:x1874630484847232:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787566.777994:0:24939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb47d838-e4ce-420a-9c06-daf336fc8d65+6:2394:x1874630484847232:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 23us (74us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787566.778000:0:24939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14 00000100:00080000:0.0:1787787566.778343:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787787566.778350:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787787566.778352:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787787566.778355:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787566.778453:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484846208 00000100:00100000:1.0:1787787566.778461:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484846208 00000100:00100000:1.0:1787787566.778511:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 144 00000100:00100000:1.0:1787787566.778520:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b13f583f-f513-4656-8252-cd03f2d0eada+13:2394:x1874630484846208:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787566.778565:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b13f583f-f513-4656-8252-cd03f2d0eada+13:2394:x1874630484846208:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 47us (1471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787566.778572:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 144 00010000:00010000:1.0:1787787567.530622:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787787567.984944:0:25038:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of eb47d838-e4ce-420a-9c06-daf336fc8d65 00000100:00100000:2.0:1787787568.489347:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787787568.489391:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503829504:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787787568.489686:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787568.489799:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503829504 00000100:00100000:0.0:1787787568.489816:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503829504 00000100:00100000:0.0:1787787568.489896:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787787568.489907:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503829504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787787568.489941:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787787568.490035:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503829504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 131us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787568.490043:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1787787568.490065:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787787568.491901:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503829504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787787568.493250:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787787568.493279:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503829632:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787787568.493491:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787568.493543:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503829632 00000100:00100000:3.0:1787787568.493550:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503829632 00000100:00100000:3.0:1787787568.493594:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787787568.493603:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503829632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787787568.493650:0:22720:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787787568.493698:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503829632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787568.493706:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787787568.493748:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503829632:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787787568.496070:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503829760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787787568.497066:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787568.497501:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503829760 00000100:00100000:1.0:1787787568.497511:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503829760 00000100:00100000:1.0:1787787568.497563:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787787568.497572:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503829760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787787568.497607:0:23456:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787787568.497664:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503829760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787568.497670:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787787568.505171:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503829760:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787787568.558365:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787569.580676:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787787569.911464:0:25744:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1eb3dcf0 20000000:00000080:2.0:1787787569.911496:0:25744:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9870f69c0000 uarg=0000000000000000 20000000:01000000:2.0:1787787569.911593:0:25744:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787787569.912027:0:25744:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787787569.912034:0:25744:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787787569.918884:0:25745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1787787569.919282:0:25744:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787787569.933334:0:25744:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787787569.933436:0:25744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff987101ee3c00/0x11620bc3f30aace5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787569.933685:0:25744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff987101ee3800/0x11620bc3f30aa942 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa93b expref: 23 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787569.933695:0:25744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9870f6658a00/0x11620bc3f30aa950 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa949 expref: 23 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787569.933704:0:25744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff986fc43e0a00/0x11620bc3f30aa98f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aa988 expref: 23 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787569.933710:0:25744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff987101ee3400/0x11620bc3f30aab09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aab02 expref: 23 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787569.933720:0:25744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9871021c6800/0x11620bc3f30aac75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8700 expref: 12 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787569.933728:0:25744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aacb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8770 expref: 12 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787569.933736:0:25744:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff987101ee3c00/0x11620bc3f30aace5 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787569.938048:0:25744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aacb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8770 expref: 12 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787569.938082:0:25744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aacb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8770 expref: 12 pid: 22707 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787569.938154:0:25744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1874630503829888:192.168.204.31@tcp:104: 00010000:00010000:2.0:1787787569.941656:0:25744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9871021c6800/0x11620bc3f30aac75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8700 expref: 12 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787569.941683:0:25744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9871021c6800/0x11620bc3f30aac75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8700 expref: 12 pid: 22707 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787569.941701:0:25744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1874630503830016:192.168.204.31@tcp:104: 00010000:00010000:2.0:1787787569.941833:0:25744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff987101ee3400/0x11620bc3f30aab09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30aab02 expref: 23 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787569.941842:0:25744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff987101ee3400/0x11620bc3f30aab09 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30aab02 expref: 23 pid: 22708 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787569.941853:0:25744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1874630503830144:0@lo:104: 00000100:00100000:2.0:1787787569.941900:0:25744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787787569.942777:0:25744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff986fc43e0a00/0x11620bc3f30aa98f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30aa988 expref: 23 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787569.942792:0:25744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff986fc43e0a00/0x11620bc3f30aa98f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30aa988 expref: 23 pid: 22706 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787569.942803:0:25744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1874630503830272:0@lo:104: 00000100:00100000:2.0:1787787569.942847:0:25744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787569.943334:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787569.949222:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484847360 00000100:00100000:1.0:1787787569.949252:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484847360 00010000:00010000:1.0:1787787569.949331:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aacb4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8770 expref: 13 pid: 22707 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787569.949527:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9 00000100:00100000:1.0:1787787569.949563:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b13f583f-f513-4656-8252-cd03f2d0eada+13:2392:x1874630484847360:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787787569.949586:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787569.949592:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aacb4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8770 expref: 13 pid: 22707 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787569.949620:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aacb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8770 expref: 13 pid: 22707 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787569.949651:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787569.949747:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b13f583f-f513-4656-8252-cd03f2d0eada+13:2392:x1874630484847360:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 187us (6416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787569.949755:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9 00000100:00100000:0.0:1787787569.951214:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503830144 00000100:00100000:0.0:1787787569.951229:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503830144 00000100:00100000:0.0:1787787569.951285:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503830272 00000100:00100000:0.0:1787787569.951289:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503830272 00000100:00100000:0.0:1787787569.951308:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787787569.951318:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3fd2c107-7647-408e-8048-4ef16ee44cbc+4:25744:x1874630503830144:12345-0@lo:104: 00010000:00010000:0.0:1787787569.951351:0:22697:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aab02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aab09 expref: -99 pid: 25037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787569.951487:0:22697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787787569.951494:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3fd2c107-7647-408e-8048-4ef16ee44cbc+4:25744:x1874630503830144:12345-0@lo:104: Request processed in 178us (9595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787569.951518:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787787569.951537:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787787569.951544:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3fd2c107-7647-408e-8048-4ef16ee44cbc+3:25744:x1874630503830272:12345-0@lo:104: 00010000:00010000:0.0:1787787569.951553:0:22697:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870f6659800/0x11620bc3f30aa988 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa98f expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787569.951602:0:22697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787787569.951607:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3fd2c107-7647-408e-8048-4ef16ee44cbc+3:25744:x1874630503830272:12345-0@lo:104: Request processed in 64us (8760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787569.951612:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787787569.951659:0:22702:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787787569.951667:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aab02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aab09 expref: -99 pid: 25037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787569.951675:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc43e1200 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:0.0:1787787569.951680:0:22702:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aab02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30aab09 expref: -99 pid: 25037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787569.951690:0:22702:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aab02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30aab09 expref: -99 pid: 25037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787787569.951699:0:22702:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aab02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30aab09 expref: -99 pid: 25037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787787569.951706:0:22702:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787787569.952888:0:24527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787787569.952904:0:24527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870f6659800/0x11620bc3f30aa988 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa98f expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787569.952914:0:24527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6659800 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:3.0:1787787569.952919:0:24527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870f6659800/0x11620bc3f30aa988 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30aa98f expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787569.952929:0:24527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870f6659800/0x11620bc3f30aa988 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30aa98f expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787787569.952938:0:24527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870f6659800/0x11620bc3f30aa988 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30aa98f expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787569.952943:0:24527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787787569.952987:0:24527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870f6659800/0x11620bc3f30aa988 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa98f expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787569.953014:0:24527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787787569.953047:0:24527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870f6659800/0x11620bc3f30aa988 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa98f expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787569.953054:0:24527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870f6659800/0x11620bc3f30aa988 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa98f expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787569.953075:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787569.953077:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787787569.953079:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787569.953104:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3fd2c107-7647-408e-8048-4ef16ee44cbc:3656:1874630503830400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787787569.953217:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787569.953324:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503830400 00000100:00100000:1.0:1787787569.953332:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503830400 00010000:00010000:1.0:1787787569.953377:0:22701:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff986fc43e0a00/0x11620bc3f30aa98f lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa988 expref: 24 pid: 22706 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787569.953426:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787787569.953436:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:3656:x1874630503830400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787787569.953462:0:22701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787569.953468:0:22701:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff986fc43e0a00/0x11620bc3f30aa98f lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa988 expref: 24 pid: 22706 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787569.953478:0:22701:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff986fc43e0a00/0x11620bc3f30aa98f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30aa988 expref: 24 pid: 22706 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787569.953506:0:22701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787569.953540:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:3656:x1874630503830400:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787569.953559:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787787569.953598:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787569.953620:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484847488 00000100:00100000:1.0:1787787569.953625:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484847488 00010000:00010000:1.0:1787787569.953641:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9871021c6800/0x11620bc3f30aac75 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8700 expref: 13 pid: 22707 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787569.953648:0:25744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9870f6658a00/0x11620bc3f30aa950 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30aa949 expref: 23 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787569.953660:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11 00000100:00100000:1.0:1787787569.953665:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b13f583f-f513-4656-8252-cd03f2d0eada+13:2392:x1874630484847488:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787569.953673:0:25744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9870f6658a00/0x11620bc3f30aa950 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30aa949 expref: 23 pid: 22708 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787569.953673:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787569.953677:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9871021c6800/0x11620bc3f30aac75 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8700 expref: 13 pid: 22707 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787569.953686:0:25744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1874630503830528:0@lo:104: 00010000:00010000:1.0:1787787569.953688:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9871021c6800/0x11620bc3f30aac75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8700 expref: 13 pid: 22707 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787569.953698:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787569.953737:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b13f583f-f513-4656-8252-cd03f2d0eada+13:2392:x1874630484847488:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 71us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787569.953744:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11 00010000:00010000:0.0:1787787569.953783:0:22702:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aab02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aab09 expref: -99 pid: 25037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787569.953791:0:22702:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787787569.953875:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3fd2c107-7647-408e-8048-4ef16ee44cbc:3656:1874630503830400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787787569.953909:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3fd2c107-7647-408e-8048-4ef16ee44cbc:3653:1874630503830656:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787787569.953944:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aab02 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aab09 expref: -99 pid: 25037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787569.953952:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff986fc43e1200/0x11620bc3f30aab02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aab09 expref: -99 pid: 25037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787569.953966:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787569.953969:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787787569.953971:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787569.960015:0:25744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787787569.960188:0:25744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff987101ee3800/0x11620bc3f30aa942 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x11620bc3f30aa93b expref: 23 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787569.960207:0:25744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff987101ee3800/0x11620bc3f30aa942 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x11620bc3f30aa93b expref: 23 pid: 22706 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787569.960225:0:25744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b6580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1874630503830784:0@lo:104: 00000100:00100000:2.0:1787787569.960309:0:25744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787569.960339:0:25744:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f69853c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787787569.960387:0:25744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aacb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8770 expref: 12 pid: 22707 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787569.960406:0:25744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1874630503829888:192.168.204.31@tcp:104: 00010000:00010000:2.0:1787787569.960421:0:25744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9871021c6800/0x11620bc3f30aac75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8700 expref: 11 pid: 22707 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787569.960433:0:25744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1874630503830016:192.168.204.31@tcp:104: 00000100:00100000:2.0:1787787569.960443:0:25744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1874630503830144:0@lo:104: 00010000:00010000:2.0:1787787569.960454:0:25744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff986fc43e0a00/0x11620bc3f30aa98f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30aa988 expref: 23 pid: 22706 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787569.960463:0:25744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1874630503830272:0@lo:104: 00000100:00100000:2.0:1787787569.960535:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503830528 00000100:00100000:2.0:1787787569.960543:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503830528 00000100:00100000:2.0:1787787569.960594:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503830784 00000100:00100000:2.0:1787787569.960597:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503830784 00000100:00100000:2.0:1787787569.960614:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787787569.960624:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3fd2c107-7647-408e-8048-4ef16ee44cbc+4:25744:x1874630503830528:12345-0@lo:104: 00010000:00010000:2.0:1787787569.960641:0:22697:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30aa949 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa950 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787569.960712:0:22697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787787569.960718:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3fd2c107-7647-408e-8048-4ef16ee44cbc+4:25744:x1874630503830528:12345-0@lo:104: Request processed in 95us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787569.960726:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787787569.961087:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787787569.961097:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc24b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3fd2c107-7647-408e-8048-4ef16ee44cbc+3:25744:x1874630503830784:12345-0@lo:104: 00010000:00010000:2.0:1787787569.961107:0:22697:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.131@tcp lock: ffff9870f6658800/0x11620bc3f30aa93b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa942 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787569.961180:0:22697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787787569.961186:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc24b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3fd2c107-7647-408e-8048-4ef16ee44cbc+3:25744:x1874630503830784:12345-0@lo:104: Request processed in 92us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787569.961192:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787787569.961230:0:25744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1874630503830528:0@lo:104: 00000100:00100000:2.0:1787787569.961239:0:25744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b6580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25744:1874630503830784:0@lo:104: 00010000:00010000:2.0:1787787569.961281:0:25744:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff987101ee3c00/0x11620bc3f30aace5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787569.961318:0:24527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787787569.961335:0:24527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30aa949 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa950 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787569.961545:0:24527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f5000 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787569.961551:0:24527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30aa949 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30aa950 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787569.961561:0:24527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30aa949 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30aa950 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787569.961570:0:24527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30aa949 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30aa950 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787569.961577:0:24527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787787569.961623:0:24527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30aa949 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa950 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787569.961630:0:24527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787569.961650:0:24527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30aa949 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa950 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787569.961658:0:24527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870c13f5000/0x11620bc3f30aa949 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa950 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787569.961674:0:24527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787569.961678:0:24527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.131@tcp lock: ffff9870f6658800/0x11620bc3f30aa93b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x11620bc3f30aa942 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787569.961685:0:24527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6658800 already unused, calling callback (ffffffffc13dac20) 10000000:00010000:2.0:1787787569.961688:0:24527:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.131@tcp lock: ffff9870f6658800/0x11620bc3f30aa93b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x11620bc3f30aa942 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787569.961709:0:24527:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.131@tcp lock: ffff9870f6658800/0x11620bc3f30aa93b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x11620bc3f30aa942 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787787569.961715:0:24527:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.131@tcp lock: ffff9870f6658800/0x11620bc3f30aa93b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x11620bc3f30aa942 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787569.961721:0:24527:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787787569.961862:0:24527:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.131@tcp lock: ffff9870f6658800/0x11620bc3f30aa93b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa942 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787569.961869:0:24527:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787787569.961888:0:24527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.131@tcp lock: ffff9870f6658800/0x11620bc3f30aa93b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa942 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787569.961894:0:24527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.131@tcp lock: ffff9870f6658800/0x11620bc3f30aa93b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x11620bc3f30aa942 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787569.961911:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787569.961912:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787569.961914:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787569.961923:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787569.961942:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787787569.961960:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3fd2c107-7647-408e-8048-4ef16ee44cbc:3656:1874630503831040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787787569.962012:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787569.962767:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503831040 00000100:00100000:1.0:1787787569.962778:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503831040 00010000:00010000:1.0:1787787569.962819:0:22701:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff987101ee3800/0x11620bc3f30aa942 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa93b expref: 23 pid: 22706 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787569.962874:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787787569.962885:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2c107-7647-408e-8048-4ef16ee44cbc+23:3656:x1874630503831040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787787569.962900:0:22701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787787569.963744:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc24b6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3fd2c107-7647-408e-8048-4ef16ee44cbc:3654:1874630503830912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787787569.963825:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787787569.963830:0:22701:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff987101ee3800/0x11620bc3f30aa942 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa93b expref: 23 pid: 22706 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787569.963845:0:22701:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff987101ee3800/0x11620bc3f30aa942 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30aa93b expref: 23 pid: 22706 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787569.963874:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff987101ee3800/0x11620bc3f30aa942 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30aa93b expref: 23 pid: 22706 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787569.963892:0:22701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787569.964048:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2c107-7647-408e-8048-4ef16ee44cbc+22:3656:x1874630503831040:12345-0@lo:103:ldlm_bl.0 Request processed in 1163us (2034us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787569.964058:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787787569.964083:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503830912 00000100:00100000:1.0:1787787569.964088:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503830912 00010000:00010000:1.0:1787787569.964107:0:22701:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9870f6658a00/0x11620bc3f30aa950 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa949 expref: 22 pid: 22708 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787569.964441:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787787569.964462:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13f5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2c107-7647-408e-8048-4ef16ee44cbc+22:3654:x1874630503830912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787787569.964474:0:22701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787569.964479:0:22701:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9870f6658a00/0x11620bc3f30aa950 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aa949 expref: 22 pid: 22708 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787569.964489:0:22701:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9870f6658a00/0x11620bc3f30aa950 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30aa949 expref: 22 pid: 22708 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787569.964501:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9870f6658a00/0x11620bc3f30aa950 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30aa949 expref: 22 pid: 22708 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787569.964511:0:22701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787569.964553:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13f5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:3654:x1874630503830912:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787569.964560:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787787569.964661:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc24b6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3fd2c107-7647-408e-8048-4ef16ee44cbc:3654:1874630503830912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787787569.964844:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3fd2c107-7647-408e-8048-4ef16ee44cbc:3656:1874630503831040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787787569.967958:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787569.968904:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503830656 00000100:00100000:2.0:1787787569.968921:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503830656 00010000:00010000:3.0:1787787569.969042:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff987101ee3400/0x11620bc3f30aab09 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aab02 expref: 21 pid: 22708 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787569.969095:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787787569.969106:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:3653:x1874630503830656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787787569.969126:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787569.969132:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff987101ee3400/0x11620bc3f30aab09 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x11620bc3f30aab02 expref: 21 pid: 22708 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787569.969178:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff987101ee3400/0x11620bc3f30aab09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x11620bc3f30aab02 expref: 21 pid: 22708 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787569.969231:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff987101ee3400/0x11620bc3f30aab09 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x11620bc3f30aab02 expref: 21 pid: 22708 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787569.969254:0:22699:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff987101ee3c00/0x11620bc3f30aace5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787569.969265:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff987101ee3c00/0x11620bc3f30aace5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787569.969289:0:22699:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff987101ee3c00/0x11620bc3f30aace5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787569.969296:0:22699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff987101ee3c00/0x11620bc3f30aace5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787569.969304:0:22699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff987101ee3c00/0x11620bc3f30aace5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787569.969312:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff987101ee3c00/0x11620bc3f30aace5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787569.969319:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff987101ee3c00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:3.0:1787787569.969323:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff987101ee3c00/0x11620bc3f30aace5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787569.969332:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff987101ee3c00/0x11620bc3f30aace5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787569.969358:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff987101ee3c00/0x11620bc3f30aace5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787569.969382:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787569.969465:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3fd2c107-7647-408e-8048-4ef16ee44cbc+20:3653:x1874630503830656:12345-0@lo:103:ldlm_bl.0 Request processed in 361us (1518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787569.969473:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787787569.969528:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3fd2c107-7647-408e-8048-4ef16ee44cbc:3653:1874630503830656:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787787569.969883:0:25744:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff987101ee3c00/0x11620bc3f30aace5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787569.969894:0:25744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff987101ee3c00/0x11620bc3f30aace5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787569.969911:0:25744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff987101ee3c00/0x11620bc3f30aace5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787570.539196:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503831552:0@lo:400:kworker.0 00000100:00100000:3.0:1787787570.539309:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787570.539369:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503832064:0@lo:400:kworker.0 00000100:00100000:0.0:1787787570.539868:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503831424:0@lo:400:kworker.0 00000100:00100000:0.0:1787787570.539908:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787570.539931:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503831936:0@lo:400:kworker.0 00000100:00100000:0.0:1787787570.539968:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787570.539985:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874630503832448:0@lo:400:kworker.0 00000100:00100000:0.0:1787787570.540007:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787570.540032:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787787570.540039:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503831296:0@lo:400:kworker.0 00000100:00100000:0.0:1787787570.540061:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787570.540078:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503831808:0@lo:400:kworker.0 00000100:00100000:0.0:1787787570.540101:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787570.540119:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874630503832320:0@lo:400:kworker.0 00000100:00100000:0.0:1787787570.540195:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787570.540357:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503831424 00000100:00100000:0.0:1787787570.540452:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503831424 00000100:00100000:0.0:1787787570.540522:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503831936 00000100:00100000:0.0:1787787570.540527:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503831936 00000100:00100000:0.0:1787787570.540544:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503831296 00000100:00100000:0.0:1787787570.540547:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503831296 00000100:00100000:0.0:1787787570.540560:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503831808 00000100:00100000:0.0:1787787570.540562:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503831808 00000100:00100000:0.0:1787787570.540579:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787787570.540589:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503831424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787570.540655:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503831424:12345-0@lo:400:kworker.0 Request processed in 67us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787570.540663:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787787570.540683:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787787570.540689:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503831936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787570.540718:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503831936:12345-0@lo:400:kworker.0 Request processed in 29us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787570.540725:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787787570.540735:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787787570.540742:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503831296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787570.541189:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503831168:0@lo:400:kworker.0 00000100:00100000:2.0:1787787570.541340:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787787570.541354:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503831808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787570.542469:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787570.542518:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503832576:0@lo:400:kworker.0 00000100:00100000:1.0:1787787570.542518:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787570.542554:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787570.542560:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc2e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503831680:0@lo:400:kworker.0 00000100:00100000:1.0:1787787570.542596:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787570.542609:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503831552 00000100:00100000:3.0:1787787570.542618:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503831552 00000100:00100000:1.0:1787787570.542624:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503832192:0@lo:400:kworker.0 00000100:00100000:1.0:1787787570.542656:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787570.542664:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503832448 00000100:00100000:3.0:1787787570.542669:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503832448 00000100:00100000:1.0:1787787570.542675:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc3a043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503832704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787787570.542687:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503832320 00000100:00100000:3.0:1787787570.542691:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503832320 00000100:00100000:3.0:1787787570.542704:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503832064 00000100:00100000:3.0:1787787570.542708:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503832064 00000100:00100000:1.0:1787787570.542709:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787570.542722:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503832576 00000100:00100000:3.0:1787787570.542725:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503832576 00000100:00100000:3.0:1787787570.542741:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503832192 00000100:00100000:3.0:1787787570.542744:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503832192 00000100:00100000:1.0:1787787570.542769:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503831168 00000100:00100000:3.0:1787787570.542774:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787787570.542775:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503831168 00000100:00100000:3.0:1787787570.542785:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc304f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503831552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787570.542838:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503831680 00000100:00100000:3.0:1787787570.542842:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc304f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3655:x1874630503831552:12345-0@lo:400:kworker.0 Request processed in 57us (3533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787570.542844:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503831680 00000100:00100000:1.0:1787787570.542863:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787787570.542869:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787787570.542875:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503831168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787570.542888:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787787570.542896:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874630503832448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787570.542934:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503831168:12345-0@lo:400:kworker.0 Request processed in 60us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787570.542939:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874630503832448:12345-0@lo:400:kworker.0 Request processed in 43us (2929us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787570.542947:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787787570.542949:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787787570.542966:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787787570.542973:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874630503832320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787570.542977:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787787570.542988:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503831680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787570.543002:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874630503832320:12345-0@lo:400:kworker.0 Request processed in 29us (2806us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787570.543008:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787787570.543020:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787787570.543027:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503832064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787570.543033:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503831680:12345-0@lo:400:kworker.0 Request processed in 47us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787570.543042:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787787570.543080:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503832704 00000100:00100000:3.0:1787787570.543081:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3655:x1874630503832064:12345-0@lo:400:kworker.0 Request processed in 55us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787570.543087:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503832704 00000100:00100000:3.0:1787787570.543091:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787787570.543106:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787787570.543114:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503832576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787570.543128:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787787570.543165:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3655:x1874630503832576:12345-0@lo:400:kworker.0 Request processed in 50us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787570.543166:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503832704:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787787570.543176:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787787570.543187:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787787570.543193:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503832192:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1787787570.543214:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787787570.543221:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503832192:12345-0@lo:400:kworker.0 Request processed in 27us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787570.543234:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787787570.543267:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503832704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 130us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787570.543276:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787787570.543290:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3655:1874630503831552:0@lo:400:kworker.0 00000100:00100000:3.0:1787787570.543304:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3655:1874630503832064:0@lo:400:kworker.0 00010000:00080000:3.0:1787787570.543318:0:3655:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc418e940 x1874630503832576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787570.543340:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3655:1874630503832576:0@lo:400:kworker.0 00000100:00100000:1.0:1787787570.543360:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503831168:0@lo:400:kworker.0 00000100:00100000:1.0:1787787570.543375:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503831680:0@lo:400:kworker.0 00000100:00100000:1.0:1787787570.543388:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503832192:0@lo:400:kworker.0 00000100:00100000:1.0:1787787570.543407:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc3a043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503832704:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787787570.543451:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787787570.543457:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787787570.543461:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787787570.543462:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503832832:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787787570.543465:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787787570.543496:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff986fc418cb40 x1874630503832320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787570.543508:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3654:1874630503832320:0@lo:400:kworker.0 00000100:00100000:1.0:1787787570.543514:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787570.543527:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503831424:0@lo:400:kworker.0 00000100:00100000:3.0:1787787570.543542:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503831936:0@lo:400:kworker.0 00000100:00100000:3.0:1787787570.543556:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3654:1874630503832448:0@lo:400:kworker.0 00000100:00100000:1.0:1787787570.543557:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503832832 00000100:00100000:1.0:1787787570.543564:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503832832 00000100:00100000:1.0:1787787570.543593:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787787570.543601:0:24224:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1787787570.543601:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503832832:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787787570.543612:0:24224:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1787787570.543618:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787787570.543656:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503832832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787570.543664:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787787570.543697:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503832832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787787570.545934:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503831808:12345-0@lo:400:kworker.0 Request processed in 4571us (5817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787570.545952:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787787570.546563:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503831808:0@lo:400:kworker.0 00000100:00100000:0.0:1787787570.546734:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503831296:12345-0@lo:400:kworker.0 Request processed in 5989us (6668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787570.546745:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787787570.546911:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc2e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503831296:0@lo:400:kworker.0 00010000:00010000:0.0:1787787570.606361:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787571.474391:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787571.474652:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484847616 00000100:00100000:3.0:1787787571.474668:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484847616 00000100:00100000:3.0:1787787571.474783:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 23 00000100:00100000:3.0:1787787571.474795:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+6:18721:x1874630484847616:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787787571.474828:0:25511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787571.474850:0:25511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30aacec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c87a8 expref: -99 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.474919:0:25511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6000/0x11620bc3f30aacf3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.474935:0:25511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6000/0x11620bc3f30aacf3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.474950:0:25511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6000/0x11620bc3f30aacf3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.474965:0:25511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aacfa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.474990:0:25511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aacfa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.474998:0:25511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aacfa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.475091:0:25511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aad01 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.475100:0:25511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aad01 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.475108:0:25511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aad01 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787571.475188:0:25511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787787571.475193:0:25511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787787571.475233:0:25511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aad01 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.475245:0:25511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6000/0x11620bc3f30aacf3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.475252:0:25511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6000/0x11620bc3f30aacf3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.475259:0:25511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6000/0x11620bc3f30aacf3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.475265:0:25511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c6000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787571.475269:0:25511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6000/0x11620bc3f30aacf3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.475276:0:25511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6000/0x11620bc3f30aacf3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.475289:0:25511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a1de00) 00010000:00010000:3.0:1787787571.475292:0:25511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787571.475296:0:25511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6000/0x11620bc3f30aacf3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.475302:0:25511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6000/0x11620bc3f30aacf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.475327:0:25511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aacfa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.475344:0:25511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aacfa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.475349:0:25511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aacfa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.475354:0:25511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787571.475357:0:25511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aacfa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.475362:0:25511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aacfa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.475622:0:25511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff986fc2a18a00) 00010000:00010000:3.0:1787787571.475625:0:25511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787571.475629:0:25511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aacfa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.475636:0:25511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aacfa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.475673:0:25511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30aacec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87a8 expref: 8 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.475688:0:25511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7e00/0x11620bc3f30aad01 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87a8 expref: 7 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.475696:0:25511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff986fc2a18800) 00010000:00010000:3.0:1787787571.475699:0:25511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787787571.475708:0:25511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c7e00, rc 0) 00000100:00100000:3.0:1787787571.475787:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+7:18721:x1874630484847616:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 995us (1412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787571.475796:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 23 00000100:00080000:0.0:1787787571.477442:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787787571.486322:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787571.486454:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484847744 00000100:00100000:2.0:1787787571.486466:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484847744 00000100:00100000:2.0:1787787571.486535:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5 00000100:00100000:2.0:1787787571.486545:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a65d3225-1272-4ba4-9698-bcc15a4206b3+7:18721:x1874630484847744:12345-192.168.204.31@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787787571.486661:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a65d3225-1272-4ba4-9698-bcc15a4206b3+7:18721:x1874630484847744:12345-192.168.204.31@tcp:900:lhsmtool_posix.0 Request processed in 117us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787571.486670:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5 00000100:00100000:1.0:1787787571.496736:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787571.496909:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484848000 00000100:00100000:3.0:1787787571.496920:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484848000 00000100:00100000:3.0:1787787571.497002:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 24 00000100:00100000:3.0:1787787571.497013:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a65d3225-1272-4ba4-9698-bcc15a4206b3+7:18721:x1874630484848000:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787787571.497037:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787571.497235:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30aad08 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c87af expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.497335:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aad0f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.497349:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aad0f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.497362:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aad0f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.497377:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6000/0x11620bc3f30aad16 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.497384:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6000/0x11620bc3f30aad16 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.497391:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6000/0x11620bc3f30aad16 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.497696:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aad1d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.497720:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aad1d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.497727:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aad1d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787571.497738:0:22716:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1787787571.498365:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aad0f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.498376:0:22716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aad0f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.498384:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aad0f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.498391:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787571.498395:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aad0f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.498404:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aad0f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.498418:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff986fc2a18800) 00010000:00010000:3.0:1787787571.498421:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787571.498425:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aad0f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.498432:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aad0f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.498444:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6000/0x11620bc3f30aad16 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.498457:0:22716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6000/0x11620bc3f30aad16 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.498462:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6000/0x11620bc3f30aad16 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.498467:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c6000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787571.498470:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6000/0x11620bc3f30aad16 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.498476:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6000/0x11620bc3f30aad16 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.498484:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff986fc2a18a00) 00010000:00010000:3.0:1787787571.498486:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787571.498489:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6000/0x11620bc3f30aad16 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.498495:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6000/0x11620bc3f30aad16 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.509991:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7800/0x11620bc3f30aad08 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87af expref: 10 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.510035:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6600/0x11620bc3f30aad1d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87af expref: 9 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.510045:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff986fc2a18500) 00010000:00010000:3.0:1787787571.510049:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787571.510071:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c6600, rc 0) 00000100:00100000:3.0:1787787571.510186:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a65d3225-1272-4ba4-9698-bcc15a4206b3+9:18721:x1874630484848000:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 13174us (13461us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1787787571.510196:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 24 00000100:00100000:0.0:1787787571.526342:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787571.526467:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484848128 00000100:00100000:1.0:1787787571.526476:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484848128 00000100:00100000:1.0:1787787571.526531:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 25 00000100:00100000:1.0:1787787571.526540:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+9:18721:x1874630484848128:12345-192.168.204.31@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787787571.526649:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+9:18721:x1874630484848128:12345-192.168.204.31@tcp:59:lhsmtool_posix.0 Request processed in 110us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787571.526657:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 25 00000100:00100000:1.0:1787787571.530416:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787571.531032:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484848256 00000100:00100000:0.0:1787787571.531044:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484848256 00000100:00100000:0.0:1787787571.531127:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 26 00000100:00100000:0.0:1787787571.531164:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+5:18721:x1874630484848256:12345-192.168.204.31@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1787787571.531404:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1787787571.535464:0:22714:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4245us 00000100:00100000:3.0:1787787571.543191:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+5:18721:x1874630484848256:12345-192.168.204.31@tcp:59:lhsmtool_posix.0 Request processed in 12042us (12772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787571.543204:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 26 00000100:00100000:3.0:1787787571.545913:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787571.546733:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484848384 00000100:00100000:1.0:1787787571.546745:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484848384 00000100:00100000:1.0:1787787571.546810:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 27 00000100:00100000:1.0:1787787571.546820:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc306580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+9:18727:x1874630484848384:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1787787571.546842:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787571.546867:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296200/0x11620bc3f30aad2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c87b6 expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.546934:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297c00/0x11620bc3f30aad32 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.546950:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297c00/0x11620bc3f30aad32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.546962:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297c00/0x11620bc3f30aad32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.547455:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296c00/0x11620bc3f30aad39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.547482:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296c00/0x11620bc3f30aad39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.547491:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296c00/0x11620bc3f30aad39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.547551:0:22715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297c00/0x11620bc3f30aad32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.547559:0:22715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297c00/0x11620bc3f30aad32 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.547566:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297c00/0x11620bc3f30aad32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.547572:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc4297c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787571.547576:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297c00/0x11620bc3f30aad32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.547583:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297c00/0x11620bc3f30aad32 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.547597:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a1de00) 00010000:00010000:1.0:1787787571.547600:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787571.547606:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297c00/0x11620bc3f30aad32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.547612:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297c00/0x11620bc3f30aad32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.547626:0:22715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296c00/0x11620bc3f30aad39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.547638:0:22715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296c00/0x11620bc3f30aad39 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.547644:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296c00/0x11620bc3f30aad39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.547649:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc4296c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787571.547651:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296c00/0x11620bc3f30aad39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.547657:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296c00/0x11620bc3f30aad39 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.547666:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9870c29f1600) 00010000:00010000:1.0:1787787571.547668:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787571.547671:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296c00/0x11620bc3f30aad39 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.547677:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296c00/0x11620bc3f30aad39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.547717:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296200/0x11620bc3f30aad2b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87b6 expref: 10 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.547728:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a1de00) 00010000:00010000:1.0:1787787571.547730:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787571.547734:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296200/0x11620bc3f30aad2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87b6 expref: 10 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.547756:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc4296200, rc 0) 00000100:00100000:1.0:1787787571.547872:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc306580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+9:18727:x1874630484848384:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1053us (1966us total) trans 0 rc 301/301 00000100:00100000:1.0:1787787571.547880:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 27 00000100:00100000:3.0:1787787571.554716:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787571.560328:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484848512 00000100:00100000:1.0:1787787571.560346:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484848512 00000100:00100000:1.0:1787787571.560416:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 0 00000100:00100000:1.0:1787787571.560426:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc305e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a65d3225-1272-4ba4-9698-bcc15a4206b3+9:18727:x1874630484848512:12345-192.168.204.31@tcp:700:lfs.0 00000100:00100000:1.0:1787787571.561049:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc305e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a65d3225-1272-4ba4-9698-bcc15a4206b3+9:18727:x1874630484848512:12345-192.168.204.31@tcp:700:lfs.0 Request processed in 620us (6341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787571.561067:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 0 10000000:01000000:1.0:1787787571.561352:0:22711:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787787571.561356:0:22711:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9870fc318800 from 13 10000000:01000000:1.0:1787787571.561360:0:22711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787787571.561401:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc4296200/0x11620bc3f30aad40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.561412:0:22711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff986fc4296200/0x11620bc3f30aad40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.561422:0:22711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff986fc4296200/0x11620bc3f30aad40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787571.561446:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503832960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787787571.561518:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787571.561561:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d154e600 going to sleep for 11 seconds 00000100:00100000:2.0:1787787571.561774:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503832960 00000100:00100000:2.0:1787787571.561780:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503832960 00000100:00100000:2.0:1787787571.561826:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787787571.561835:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+20:22711:x1874630503832960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787571.561846:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787571.561861:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aad47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aad40 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.561884:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aad47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aad40 expref: 21 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.561902:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff987101ee2a00/0x11620bc3f30aad47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aad40 expref: 21 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.561911:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2a00, rc 0) 00000100:00100000:2.0:1787787571.561952:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:22711:x1874630503832960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787571.561958:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787787571.562002:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503832960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787571.562016:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff986fc4296200/0x11620bc3f30aad40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aad47 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.562025:0:22711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff986fc4296200/0x11620bc3f30aad40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aad47 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787571.562097:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503833088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787571.562125:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787571.562187:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f6985e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787787571.562199:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503833088 00000100:00100000:2.0:1787787571.562202:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503833088 00000100:00100000:2.0:1787787571.562221:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787787571.562226:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c6c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:22711:x1874630503833088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787571.562343:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c6c25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:22711:x1874630503833088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787571.562351:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787787571.562646:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503833088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787787571.562685:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503833216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787571.562724:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787571.562740:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f6985e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787787571.562752:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503833216 00000100:00100000:2.0:1787787571.562755:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503833216 00000100:00100000:2.0:1787787571.562778:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787787571.562783:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c6c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:22711:x1874630503833216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787571.562859:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c6c27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:22711:x1874630503833216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787571.562867:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787787571.562908:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503833216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787787571.566287:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787787571.566322:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503833344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787787571.566391:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787571.566439:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503833344 00000100:00100000:1.0:1787787571.566445:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503833344 00000100:00100000:1.0:1787787571.566490:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787787571.566498:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503833344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787787571.566537:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1787787571.566577:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503833344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787571.566583:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787787571.566639:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503833344:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787787571.567866:0:25759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787787571.570699:0:22711:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787787571.570735:0:22711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787787571.570747:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff986fc4296200/0x11620bc3f30aad40 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aad47 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.570759:0:22711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff986fc4296200/0x11620bc3f30aad40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aad47 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787571.570772:0:22711:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787787571.570775:0:22711:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9870c3570000 from 13 10000000:01000000:3.0:1787787571.570777:0:22711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787787571.570821:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9871021c7800/0x11620bc3f30aad4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.570830:0:22711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9871021c7800/0x11620bc3f30aad4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.570841:0:22711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9871021c7800/0x11620bc3f30aad4e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787571.570886:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503833472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787787571.570961:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787571.571018:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0bdb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787787571.571232:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503833472 00000100:00100000:2.0:1787787571.571240:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503833472 00000100:00100000:2.0:1787787571.571307:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787787571.571326:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c6c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+21:22711:x1874630503833472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787571.571340:0:22708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787571.571356:0:22708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff987101ee3c00/0x11620bc3f30aad55 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aad4e expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.571397:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff987101ee3c00/0x11620bc3f30aad55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aad4e expref: 22 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.571408:0:22708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff987101ee3c00/0x11620bc3f30aad55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aad4e expref: 22 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.571427:0:22708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3c00, rc 0) 00000100:00100000:2.0:1787787571.571481:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c6c25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+22:22711:x1874630503833472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787571.571498:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787787571.571769:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3070c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503833472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787571.571788:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9871021c7800/0x11620bc3f30aad4e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aad55 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787571.571797:0:22711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9871021c7800/0x11620bc3f30aad4e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aad55 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787571.571859:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503833600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787571.571891:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787571.571913:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e085d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787787571.571928:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503833600 00000100:00100000:0.0:1787787571.571932:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503833600 00000100:00100000:0.0:1787787571.571953:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787787571.571960:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+23:22711:x1874630503833600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787571.572103:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6544c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+23:22711:x1874630503833600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787571.572109:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787787571.572169:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503833600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787571.572215:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503833728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787787571.572256:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787571.572270:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e085d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787787571.572280:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503833728 00000100:00100000:0.0:1787787571.572283:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503833728 00000100:00100000:0.0:1787787571.572301:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787787571.572306:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+23:22711:x1874630503833728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787787571.572397:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6546450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+23:22711:x1874630503833728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787571.572404:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787787571.572448:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503833728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787571.573861:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787571.574399:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484848768 00000100:00100000:0.0:1787787571.574410:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484848768 00000100:00100000:0.0:1787787571.574497:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 28 00000100:00100000:0.0:1787787571.574658:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc305a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a65d3225-1272-4ba4-9698-bcc15a4206b3+9:18727:x1874630484848768:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:0.0:1787787571.574738:0:22716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787571.574781:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aac9f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8731 expref: 9 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787571.574812:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a1de00) 00010000:00010000:0.0:1787787571.574819:0:22716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:3.0:1787787571.576609:0:25760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787787571.577542:0:22711:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787787571.577573:0:22711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787787571.577584:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9871021c7800/0x11620bc3f30aad4e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aad55 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.577596:0:22711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9871021c7800/0x11620bc3f30aad4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aad55 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787787571.577608:0:22711:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787787571.577611:0:22711:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9870f576f800 from 13 10000000:01000000:3.0:1787787571.577613:0:22711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787787571.577652:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff9871021c6000/0x11620bc3f30aad5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.577661:0:22711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff9871021c6000/0x11620bc3f30aad5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.577670:0:22711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff9871021c6000/0x11620bc3f30aad5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787571.577699:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc306940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503833856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787787571.577781:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787571.577838:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0bdb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787787571.577913:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503833856 00000100:00100000:1.0:1787787571.577922:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503833856 00000100:00100000:1.0:1787787571.577985:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787787571.578006:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+22:22711:x1874630503833856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787787571.578022:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787571.578038:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff986fc4296c00/0x11620bc3f30aad63 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aad5c expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.578081:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff986fc4296c00/0x11620bc3f30aad63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aad5c expref: 23 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.578093:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff986fc4296c00/0x11620bc3f30aad63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aad5c expref: 23 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.578102:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc4296c00, rc 0) 00000100:00100000:1.0:1787787571.578182:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6545c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+23:22711:x1874630503833856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787571.578190:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787787571.578557:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc306940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503833856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787571.578575:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff9871021c6000/0x11620bc3f30aad5c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aad63 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.578585:0:22711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff9871021c6000/0x11620bc3f30aad5c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aad63 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787571.578643:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc306940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503833984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787571.578674:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787571.578698:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0bdb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787571.578712:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503833984 00000100:00100000:3.0:1787787571.578716:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503833984 00000100:00100000:3.0:1787787571.578740:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787787571.578747:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+23:22711:x1874630503833984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787571.578852:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6544850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+23:22711:x1874630503833984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787571.578859:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787787571.578890:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc306940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503833984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787571.578916:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc306940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503834112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787571.578954:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787571.578966:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d0bdb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787787571.578976:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503834112 00000100:00100000:3.0:1787787571.578980:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503834112 00000100:00100000:3.0:1787787571.579169:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787787571.579177:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+23:22711:x1874630503834112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787787571.579246:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6547450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+23:22711:x1874630503834112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787571.579258:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787787571.579298:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc306940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503834112:0@lo:503:ll_cfg_requeue.0 00010000:00010000:0.0:1787787571.579754:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15000/0x11620bc3f30aad6a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787571.579775:0:22716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14200/0x11620bc3f30aacde lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87a1 expref: 5 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787571.579786:0:22716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15000/0x11620bc3f30aad6a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787571.579813:0:22716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14200/0x11620bc3f30aacde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87a1 expref: 5 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787571.579827:0:22716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14200/0x11620bc3f30aacde lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87a1 expref: 5 pid: 22715 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787571.579846:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22716:1874630503834240:192.168.204.31@tcp:104: 00000100:00100000:0.0:1787787571.579903:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e085d900 going to sleep for 11 seconds 00000100:00100000:2.0:1787787571.583049:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787571.583195:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22716:1874630503834240:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787571.583226:0:22716:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15000/0x11620bc3f30aad6a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787571.583466:0:23473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484848896 00000100:00100000:3.0:1787787571.583474:0:23473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484848896 00010000:00010000:3.0:1787787571.583542:0:23473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14200/0x11620bc3f30aacde lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87a1 expref: 6 pid: 22715 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787571.583578:0:23473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15 00000100:00100000:3.0:1787787571.583587:0:23473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb47d838-e4ce-420a-9c06-daf336fc8d65+6:2391:x1874630484848896:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787571.583601:0:23473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787571.583608:0:23473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14200/0x11620bc3f30aacde lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87a1 expref: 6 pid: 22715 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.583621:0:23473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14200/0x11620bc3f30aacde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87a1 expref: 6 pid: 22715 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.583644:0:23473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14200/0x11620bc3f30aacde lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87a1 expref: 6 pid: 22715 timeout: 815 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.583662:0:23473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a1de00) 00010000:00010000:3.0:1787787571.583666:0:23473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15000/0x11620bc3f30aad6a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.583675:0:23473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15000/0x11620bc3f30aad6a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.583682:0:23473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15000/0x11620bc3f30aad6a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.583723:0:23473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787571.583772:0:23473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb47d838-e4ce-420a-9c06-daf336fc8d65+5:2391:x1874630484848896:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 185us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787571.583779:0:23473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15 00010000:00010000:3.0:1787787571.583808:0:22716:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15000/0x11620bc3f30aad6a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.583815:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15000/0x11620bc3f30aad6a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.583838:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aad71 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.583848:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aad71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.583855:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aad71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787787571.584596:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787787571.589625:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6800/0x11620bc3f30aad78 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.589650:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6800/0x11620bc3f30aad78 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.589674:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6800/0x11620bc3f30aad78 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787787571.589693:0:22716:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002459037e reply state 00000000df4c2d33 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6800/0x11620bc3f30aad78 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.589719:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6800/0x11620bc3f30aad78 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.589726:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff986fc2a18e00) 00010000:00010000:3.0:1787787571.589729:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787787571.589733:0:22716:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787787571.589739:0:22716:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787787571.589747:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15000/0x11620bc3f30aad6a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.589754:0:22716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15000/0x11620bc3f30aad6a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.589761:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15000/0x11620bc3f30aad6a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.589767:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:3.0:1787787571.589771:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15000/0x11620bc3f30aad6a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.589778:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15000/0x11620bc3f30aad6a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.589789:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc2a1de00) 00010000:00010000:3.0:1787787571.589791:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787787571.589795:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15000/0x11620bc3f30aad6a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.589801:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15000/0x11620bc3f30aad6a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787787571.589828:0:22716:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002459037e reply state 00000000df4c2d33 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aad71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.589838:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aad71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.589845:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff986fc2a18a00) 00010000:00010000:3.0:1787787571.589847:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787787571.589849:0:22716:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787787571.589961:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc305a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a65d3225-1272-4ba4-9698-bcc15a4206b3+10:18727:x1874630484848768:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 15450us (16102us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1787787571.589969:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 28 00000040:00080000:1.0:1787787571.594404:0:25761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787787571.594913:0:22711:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787787571.594938:0:22711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787787571.594949:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff9871021c6000/0x11620bc3f30aad5c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aad63 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.594960:0:22711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff9871021c6000/0x11620bc3f30aad5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aad63 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787787571.595368:0:22711:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787787571.595372:0:22711:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff986fc2938000 from 13 10000000:01000000:2.0:1787787571.595376:0:22711:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787787571.595426:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee3800/0x11620bc3f30aad7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.595435:0:22711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.131@tcp lock: ffff987101ee3800/0x11620bc3f30aad7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.595447:0:22711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.131@tcp lock: ffff987101ee3800/0x11620bc3f30aad7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787571.595476:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503834368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787787571.595556:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787571.595597:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f6985780 going to sleep for 11 seconds 00000100:00100000:3.0:1787787571.595800:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503834368 00000100:00100000:3.0:1787787571.595807:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503834368 00000100:00100000:3.0:1787787571.595861:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787787571.595870:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+23:22711:x1874630503834368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787787571.595882:0:22708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787571.595895:0:22708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9871021c6a00/0x11620bc3f30aad86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x11620bc3f30aad7f expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.595942:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9871021c6a00/0x11620bc3f30aad86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x11620bc3f30aad7f expref: 24 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.595955:0:22708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9871021c6a00/0x11620bc3f30aad86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x11620bc3f30aad7f expref: 24 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.595964:0:22708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9871021c6a00, rc 0) 00000100:00100000:3.0:1787787571.596023:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:22711:x1874630503834368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787571.596030:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787787571.596373:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503834368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787571.596389:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.131@tcp lock: ffff987101ee3800/0x11620bc3f30aad7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aad86 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787571.596398:0:22711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.131@tcp lock: ffff987101ee3800/0x11620bc3f30aad7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x11620bc3f30aad86 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787571.596472:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503834496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787571.596515:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787571.596540:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e085d900 going to sleep for 11 seconds 00000100:00100000:3.0:1787787571.596813:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503834496 00000100:00100000:3.0:1787787571.596819:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503834496 00000100:00100000:3.0:1787787571.596848:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787787571.596856:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:22711:x1874630503834496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787571.596966:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6545450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:22711:x1874630503834496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787571.596973:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787787571.597291:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503834496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787571.597334:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503834624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787787571.597391:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787571.597453:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870e085d900 going to sleep for 11 seconds 00000100:00100000:2.0:1787787571.598584:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503834624 00000100:00100000:2.0:1787787571.598594:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503834624 00000100:00100000:2.0:1787787571.598642:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787787571.598652:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:22711:x1874630503834624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787571.598923:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:22711:x1874630503834624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 272us (1531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787571.598931:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787787571.599483:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3fd2c107-7647-408e-8048-4ef16ee44cbc:22711:1874630503834624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787787571.603639:0:25762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787787571.603912:0:22711:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787787571.603940:0:22711:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787787571.603951:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.131@tcp lock: ffff987101ee3800/0x11620bc3f30aad7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aad86 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787571.603986:0:22711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.131@tcp lock: ffff987101ee3800/0x11620bc3f30aad7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x11620bc3f30aad86 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.625349:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787571.634420:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787571.645170:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484849024 00000100:00100000:1.0:1787787571.645186:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484849024 00000100:00100000:2.0:1787787571.648853:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 157 00000100:00100000:2.0:1787787571.648885:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b13f583f-f513-4656-8252-cd03f2d0eada+11:18102:x1874630484849024:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787787571.648902:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787571.648921:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff987101ee2c00/0x11620bc3f30aad8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c87bd expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.648953:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff987101ee2c00/0x11620bc3f30aad8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87bd expref: 12 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.648964:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff987101ee2c00/0x11620bc3f30aad8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87bd expref: 12 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.648973:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2c00, rc 0) 00000100:00100000:2.0:1787787571.649215:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b13f583f-f513-4656-8252-cd03f2d0eada+12:18102:x1874630484849024:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 Request processed in 334us (14852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787571.649287:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 157 00000100:00100000:2.0:1787787571.655891:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787571.666255:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484849152 00000100:00100000:0.0:1787787571.666270:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484849152 00000100:00100000:0.0:1787787571.666410:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 158 00000100:00100000:0.0:1787787571.666421:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b13f583f-f513-4656-8252-cd03f2d0eada+12:18102:x1874630484849152:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787787571.666585:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6547850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b13f583f-f513-4656-8252-cd03f2d0eada+12:18102:x1874630484849152:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 Request processed in 166us (10704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787571.666657:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 158 00000100:00100000:0.0:1787787571.669870:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787571.669974:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484849280 00000100:00100000:2.0:1787787571.669984:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484849280 00000100:00100000:2.0:1787787571.670060:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 159 00000100:00100000:2.0:1787787571.670070:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b13f583f-f513-4656-8252-cd03f2d0eada+12:18102:x1874630484849280:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787571.670265:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6547050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b13f583f-f513-4656-8252-cd03f2d0eada+12:18102:x1874630484849280:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 Request processed in 196us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787571.670274:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 159 00000100:00100000:2.0:1787787571.675979:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787571.676797:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484849408 00000100:00100000:0.0:1787787571.676813:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484849408 00000100:00100000:0.0:1787787571.676888:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 160 00000100:00100000:0.0:1787787571.676898:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b13f583f-f513-4656-8252-cd03f2d0eada+12:18102:x1874630484849408:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787787571.676916:0:22708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787571.676936:0:22708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9870c7c15800/0x11620bc3f30aad94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c87c4 expref: -99 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787571.676968:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9870c7c15800/0x11620bc3f30aad94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87c4 expref: 13 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787571.676980:0:22708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9870c7c15800/0x11620bc3f30aad94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87c4 expref: 13 pid: 22708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787571.677002:0:22708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c15800, rc 0) 00000100:00100000:0.0:1787787571.677105:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b13f583f-f513-4656-8252-cd03f2d0eada+13:18102:x1874630484849408:12345-192.168.204.31@tcp:101:ll_cfg_requeue.0 Request processed in 208us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787571.677112:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 160 00000100:00100000:3.0:1787787571.679326:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787571.679983:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484849536 00000100:00100000:2.0:1787787571.680000:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484849536 00000100:00100000:2.0:1787787571.680080:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 29 00000100:00100000:2.0:1787787571.680111:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc306940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+10:18735:x1874630484849536:12345-192.168.204.31@tcp:101:lctl.0 00010000:00010000:2.0:1787787571.680208:0:25511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787571.680245:0:25511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30aad9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c87cb expref: -99 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.680344:0:25511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30aada2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.680371:0:25511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30aada2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.680392:0:25511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30aada2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787571.680521:0:25511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787787571.680526:0:25511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787787571.680576:0:25511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30aada2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.680606:0:25511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30aad9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87cb expref: 12 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.680630:0:25511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3400/0x11620bc3f30aada2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87cb expref: 11 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.680640:0:25511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc3a1d600) 00010000:00010000:2.0:1787787571.680643:0:25511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787787571.680647:0:25511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3400, rc 0) 00000100:00100000:2.0:1787787571.680732:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc306940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+11:18735:x1874630484849536:12345-192.168.204.31@tcp:101:lctl.0 Request processed in 624us (1435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787571.680752:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 29 00000100:00100000:0.0:1787787571.687777:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787571.689701:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484849664 00000100:00100000:3.0:1787787571.689725:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484849664 00000100:00100000:3.0:1787787571.689808:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 161 00000100:00100000:3.0:1787787571.689819:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b13f583f-f513-4656-8252-cd03f2d0eada+13:18102:x1874630484849664:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787787571.690056:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6544050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b13f583f-f513-4656-8252-cd03f2d0eada+13:18102:x1874630484849664:12345-192.168.204.31@tcp:501:ll_cfg_requeue.0 Request processed in 237us (2289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787571.690065:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 161 00000100:00100000:0.0:1787787571.694728:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787571.694845:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484849792 00000100:00100000:2.0:1787787571.694859:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484849792 00000100:00100000:2.0:1787787571.694923:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 162 00000100:00100000:2.0:1787787571.694935:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b13f583f-f513-4656-8252-cd03f2d0eada+13:18102:x1874630484849792:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787787571.695120:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6544450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b13f583f-f513-4656-8252-cd03f2d0eada+13:18102:x1874630484849792:12345-192.168.204.31@tcp:503:ll_cfg_requeue.0 Request processed in 187us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787571.695178:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 162 00000100:00100000:1.0:1787787571.708290:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787571.708639:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484849920 00000100:00100000:2.0:1787787571.708653:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484849920 00000100:00100000:2.0:1787787571.708725:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 30 00000100:00100000:2.0:1787787571.708736:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb47d838-e4ce-420a-9c06-daf336fc8d65+5:18738:x1874630484849920:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1787787571.708764:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787571.708792:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30aada9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c87d2 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.708879:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30aadb0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.708896:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30aadb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.708911:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30aadb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787571.708970:0:22714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787787571.708974:0:22714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787787571.709027:0:22714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30aadb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.709059:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30aada9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87d2 expref: 7 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.709081:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee3000/0x11620bc3f30aadb0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87d2 expref: 6 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.709090:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc3a1d600) 00010000:00010000:2.0:1787787571.709094:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787787571.709098:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee3000, rc 0) 00000100:00100000:2.0:1787787571.709290:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb47d838-e4ce-420a-9c06-daf336fc8d65+6:18738:x1874630484849920:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 554us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787571.709299:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 30 00000100:00100000:0.0:1787787571.712466:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787571.712630:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484850048 00000100:00100000:1.0:1787787571.712642:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484850048 00000100:00100000:1.0:1787787571.712722:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 31 00000100:00100000:1.0:1787787571.712733:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb47d838-e4ce-420a-9c06-daf336fc8d65+6:18738:x1874630484850048:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1787787571.712759:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787571.712784:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296e00/0x11620bc3f30aadb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c87d9 expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.712861:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aadbe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.712878:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aadbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.712892:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aadbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.712904:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aadc5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.712912:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aadc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.712938:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aadc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.713047:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297e00/0x11620bc3f30aadcc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.713055:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297e00/0x11620bc3f30aadcc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.713062:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297e00/0x11620bc3f30aadcc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787571.713110:0:22715:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787787571.713115:0:22715:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787787571.713190:0:22715:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297e00/0x11620bc3f30aadcc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.713207:0:22715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aadbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.713215:0:22715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aadbe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.713222:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aadbe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.713228:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc4297200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787571.713233:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aadbe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.713242:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aadbe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.713266:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc3a1d600) 00010000:00010000:1.0:1787787571.713269:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787571.713275:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aadbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.713282:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aadbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.713299:0:22715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aadc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.713318:0:22715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aadc5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.713325:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aadc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.713331:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc4296a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787571.713334:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aadc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.713339:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aadc5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.713346:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff986fc2a18a00) 00010000:00010000:1.0:1787787571.713348:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787571.713351:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aadc5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.713358:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aadc5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.713584:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296e00/0x11620bc3f30aadb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87d9 expref: 8 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.713600:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297e00/0x11620bc3f30aadcc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87d9 expref: 7 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.713607:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff986fc2a18e00) 00010000:00010000:1.0:1787787571.713609:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787787571.713612:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc4297e00, rc 0) 00000100:00100000:1.0:1787787571.713692:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb47d838-e4ce-420a-9c06-daf336fc8d65+7:18738:x1874630484850048:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 960us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787571.713702:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 31 00000100:00100000:0.0:1787787571.717079:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787571.717261:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484850176 00000100:00100000:2.0:1787787571.717274:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484850176 00000100:00100000:2.0:1787787571.717380:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6 00000100:00100000:2.0:1787787571.717391:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:eb47d838-e4ce-420a-9c06-daf336fc8d65+5:18738:x1874630484850176:12345-192.168.204.31@tcp:900:lfs.0 00000100:00100000:2.0:1787787571.717502:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:eb47d838-e4ce-420a-9c06-daf336fc8d65+5:18738:x1874630484850176:12345-192.168.204.31@tcp:900:lfs.0 Request processed in 113us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787571.717510:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6 00000100:00080000:3.0:1787787571.718048:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787787571.720501:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787571.720656:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484850432 00000100:00100000:2.0:1787787571.720668:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484850432 00000100:00100000:2.0:1787787571.720741:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 32 00000100:00100000:2.0:1787787571.720752:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc306d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb47d838-e4ce-420a-9c06-daf336fc8d65+7:18738:x1874630484850432:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1787787571.720776:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787571.720819:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30aadd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c87e0 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787571.720965:0:22714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787787571.721097:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30aadd3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87e0 expref: 9 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.721114:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc3a1d600) 00010000:00010000:2.0:1787787571.721118:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787787571.721124:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30aadd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87e0 expref: 9 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.721286:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2200, rc 0) 00000100:00100000:2.0:1787787571.721364:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc306d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb47d838-e4ce-420a-9c06-daf336fc8d65+8:18738:x1874630484850432:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 612us (873us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1787787571.721372:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 32 00000100:00100000:2.0:1787787571.724429:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787571.724643:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484850688 00000100:00100000:3.0:1787787571.724655:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484850688 00000100:00100000:3.0:1787787571.724722:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 33 00000100:00100000:3.0:1787787571.724733:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb47d838-e4ce-420a-9c06-daf336fc8d65+8:18738:x1874630484850688:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:3.0:1787787571.724803:0:25511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787571.724841:0:25511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297e00/0x11620bc3f30aadcc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87d9 expref: 8 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.724863:0:25511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff986fc2a18e00) 00010000:00010000:3.0:1787787571.724869:0:25511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787787571.724897:0:25511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aade1 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.724913:0:25511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aade1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.724926:0:25511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aade1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787787571.725234:0:25511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000095b3a63a reply state 00000000df12bc64 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aade1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.725249:0:25511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aade1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.725255:0:25511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff986fc2a18e00) 00010000:00010000:3.0:1787787571.725258:0:25511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1787787571.725261:0:25511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787787571.725271:0:25511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787787571.725387:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb47d838-e4ce-420a-9c06-daf336fc8d65+9:18738:x1874630484850688:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 655us (980us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1787787571.725842:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 33 00000100:00100000:0.0:1787787571.728181:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787571.728380:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484850944 00000100:00100000:2.0:1787787571.728393:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484850944 00000100:00100000:2.0:1787787571.728464:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2 00000100:00100000:2.0:1787787571.728475:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb47d838-e4ce-420a-9c06-daf336fc8d65+9:18738:x1874630484850944:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:2.0:1787787571.728732:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb47d838-e4ce-420a-9c06-daf336fc8d65+10:18738:x1874630484850944:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 259us (608us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1787787571.728741:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2 00000100:00100000:0.0:1787787571.737452:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787571.737569:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484851200 00000100:00100000:2.0:1787787571.737582:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484851200 00000100:00100000:2.0:1787787571.737658:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 34 00000100:00100000:2.0:1787787571.737671:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb47d838-e4ce-420a-9c06-daf336fc8d65+10:18738:x1874630484851200:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1787787571.737725:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787571.737754:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30aade8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c87e7 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.737859:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aadef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.737878:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aadef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.737893:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aadef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.737908:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30aadf6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.737916:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30aadf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.737923:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30aadf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787571.738075:0:22714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787787571.738304:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aadef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.738326:0:22714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aadef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.738333:0:22714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aadef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.738353:0:22714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c13f5000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787571.738358:0:22714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aadef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.738368:0:22714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aadef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.738384:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc3a1d600) 00010000:00010000:2.0:1787787571.738388:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787571.738394:0:22714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aadef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.738401:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aadef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.738418:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30aadf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.738425:0:22714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30aadf6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.738431:0:22714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30aadf6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.738436:0:22714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787571.738439:0:22714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30aadf6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.738447:0:22714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30aadf6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.738468:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff986fc2a18a00) 00010000:00010000:2.0:1787787571.738470:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787571.738474:0:22714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30aadf6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.738480:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30aadf6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.738524:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30aade8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87e7 expref: 12 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.738536:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc3a1d600) 00010000:00010000:2.0:1787787571.738539:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787787571.738544:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30aade8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87e7 expref: 12 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.738555:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff987101ee2200, rc 0) 00000100:00100000:2.0:1787787571.738627:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb47d838-e4ce-420a-9c06-daf336fc8d65+11:18738:x1874630484851200:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 957us (1192us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1787787571.738637:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 34 00000100:00100000:0.0:1787787571.744764:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787571.744965:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484851328 00000100:00100000:1.0:1787787571.744979:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484851328 00000100:00100000:1.0:1787787571.745059:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 35 00000100:00100000:1.0:1787787571.745070:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb47d838-e4ce-420a-9c06-daf336fc8d65+11:18738:x1874630484851328:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1787787571.745103:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787571.745133:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296e00/0x11620bc3f30aae04 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c87ee expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.745319:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aae0b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.745338:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aae0b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.745352:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aae0b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787571.745548:0:22715:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787787571.745552:0:22715:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787787571.745577:0:22715:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aae0b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.745612:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296e00/0x11620bc3f30aae04 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87ee expref: 13 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.745637:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aae0b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87ee expref: 12 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787571.745648:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff986fc2a18e00) 00010000:00010000:1.0:1787787571.745652:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787787571.745655:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc4296a00, rc 0) 00000100:00100000:1.0:1787787571.745723:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb47d838-e4ce-420a-9c06-daf336fc8d65+12:18738:x1874630484851328:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 655us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787571.745731:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 35 00000100:00100000:0.0:1787787571.749619:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787571.749706:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484851456 00000100:00100000:2.0:1787787571.749719:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484851456 00000100:00100000:2.0:1787787571.749789:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3 00000100:00100000:2.0:1787787571.749799:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb47d838-e4ce-420a-9c06-daf336fc8d65+12:18738:x1874630484851456:12345-192.168.204.31@tcp:37:lfs.0 00000100:00100000:0.0:1787787571.755063:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb47d838-e4ce-420a-9c06-daf336fc8d65+12:18738:x1874630484851456:12345-192.168.204.31@tcp:37:lfs.0 Request processed in 5248us (5440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787571.755083:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3 00000100:00100000:0.0:1787787571.758539:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787571.758631:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484851712 00000100:00100000:3.0:1787787571.758645:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484851712 00000100:00100000:3.0:1787787571.758734:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4 00000100:00100000:3.0:1787787571.758745:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c47d2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb47d838-e4ce-420a-9c06-daf336fc8d65+12:18738:x1874630484851712:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1787787571.759064:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c47d2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb47d838-e4ce-420a-9c06-daf336fc8d65+13:18738:x1874630484851712:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 319us (539us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1787787571.759074:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4 00000100:00100000:2.0:1787787571.806728:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787571.806972:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484851840 00000100:00100000:3.0:1787787571.806985:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484851840 00000100:00100000:3.0:1787787571.807066:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 36 00000100:00100000:3.0:1787787571.807078:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+11:18744:x1874630484851840:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:3.0:1787787571.807108:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787571.807258:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0a00/0x11620bc3f30aae12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c87f5 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.807437:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aae19 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.807472:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aae19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.807485:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aae19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.807498:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aae20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.807505:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aae20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.807511:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aae20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.807612:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30aae27 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.807621:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30aae27 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.807630:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30aae27 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787571.807672:0:22714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787787571.807676:0:22714:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787787571.807722:0:22714:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30aae27 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.807737:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aae19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.807752:0:22714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aae19 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.807759:0:22714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aae19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.807766:0:22714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0031c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787571.807771:0:22714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aae19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.807779:0:22714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aae19 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.807793:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc3a1d600) 00010000:00010000:2.0:1787787571.807796:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787571.807800:0:22714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aae19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.807808:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aae19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.807826:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aae20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.807832:0:22714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aae20 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.807838:0:22714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aae20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.807842:0:22714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787571.807851:0:22714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aae20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.807857:0:22714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aae20 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.807866:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff986fc2a18a00) 00010000:00010000:2.0:1787787571.807868:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787571.807871:0:22714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aae20 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.807877:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aae20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.807908:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0a00/0x11620bc3f30aae12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87f5 expref: 13 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.807924:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031e00/0x11620bc3f30aae27 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87f5 expref: 12 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.807930:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff986fc2a18e00) 00010000:00010000:2.0:1787787571.807932:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787787571.807935:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0031e00, rc 0) 00000100:00100000:2.0:1787787571.808230:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+12:18744:x1874630484851840:12345-192.168.204.31@tcp:101:bash.0 Request processed in 1153us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787571.808239:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 36 00000100:00100000:1.0:1787787571.817780:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787571.818073:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484851968 00000100:00100000:2.0:1787787571.818088:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484851968 00000100:00100000:2.0:1787787571.818375:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7 00000100:00100000:2.0:1787787571.818389:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a65d3225-1272-4ba4-9698-bcc15a4206b3+5:18744:x1874630484851968:12345-192.168.204.31@tcp:900:bash.0 00000100:00100000:2.0:1787787571.818546:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a65d3225-1272-4ba4-9698-bcc15a4206b3+5:18744:x1874630484851968:12345-192.168.204.31@tcp:900:bash.0 Request processed in 160us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787571.818556:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7 00000100:00100000:1.0:1787787571.822052:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787571.822230:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484852224 00000100:00100000:2.0:1787787571.822243:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484852224 00000100:00100000:2.0:1787787571.822328:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 37 00000100:00100000:2.0:1787787571.822340:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+12:18744:x1874630484852224:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:2.0:1787787571.822524:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787571.822552:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aae2e lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c87fc expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.822704:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aae35 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.822722:0:22715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aae0b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87ee expref: 12 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.822732:0:22715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aae35 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.822773:0:22715:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aae0b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87ee expref: 12 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.822789:0:22715:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aae0b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87ee expref: 12 pid: 22715 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787571.822805:0:22715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc400c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22715:1874630503834752:192.168.204.31@tcp:104: 00000100:00100000:2.0:1787787571.822978:0:22715:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f6985000 going to sleep for 11 seconds 00000100:00100000:0.0:1787787571.840585:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787571.840997:0:22715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc400c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22715:1874630503834752:192.168.204.31@tcp:104: 00010000:00010000:2.0:1787787571.841035:0:22715:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aae35 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787571.841528:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484852352 00000100:00100000:3.0:1787787571.841538:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484852352 00010000:00010000:3.0:1787787571.841594:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aae0b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87ee expref: 13 pid: 22715 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787571.841645:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16 00000100:00100000:3.0:1787787571.841656:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb47d838-e4ce-420a-9c06-daf336fc8d65+13:2392:x1874630484852352:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787571.841675:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787571.841682:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aae0b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87ee expref: 13 pid: 22715 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.841715:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aae0b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87ee expref: 13 pid: 22715 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.841750:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aae0b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87ee expref: 13 pid: 22715 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.841773:0:22699:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff986fc2a18e00) 00010000:00010000:3.0:1787787571.841779:0:22699:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aae35 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.841789:0:22699:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aae35 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.841799:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aae35 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.841884:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787571.841954:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb47d838-e4ce-420a-9c06-daf336fc8d65+12:2392:x1874630484852352:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 299us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787571.841963:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16 00010000:00010000:2.0:1787787571.843578:0:22715:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aae35 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.843596:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aae35 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.846454:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30aae3c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.846480:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30aae3c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.846494:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30aae3c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.847321:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30aae43 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.847337:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30aae43 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.847346:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30aae43 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787571.847358:0:22715:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787787571.847386:0:22715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aae35 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.847412:0:22715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aae35 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.847419:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aae35 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.847426:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0031c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787571.847431:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aae35 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.847439:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aae35 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.847452:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff986fc2a18e00) 00010000:00010000:2.0:1787787571.847455:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787571.847459:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aae35 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.847467:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aae35 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787787571.847482:0:22715:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2eb8fda reply state 00000000cd06e66f transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30aae3c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.847493:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30aae3c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.847500:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff986fc3a1df00) 00010000:00010000:2.0:1787787571.847503:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787787571.847506:0:22715:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787787571.847544:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aae2e lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87fc expref: 15 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.847568:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30aae43 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87fc expref: 14 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787571.847576:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:2.0:1787787571.847579:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787787571.847581:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0031200, rc 0) 00000100:00100000:2.0:1787787571.847965:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+15:18744:x1874630484852224:12345-192.168.204.31@tcp:101:bash.0 Request processed in 25624us (25925us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1787787571.847975:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 37 00000100:00100000:0.0:1787787571.867609:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787571.867725:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484852480 00000100:00100000:3.0:1787787571.867738:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484852480 00000100:00100000:3.0:1787787571.867823:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 38 00000100:00100000:3.0:1787787571.867837:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a65d3225-1272-4ba4-9698-bcc15a4206b3+15:18744:x1874630484852480:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:3.0:1787787571.867870:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787571.867897:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1200/0x11620bc3f30aae51 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8803 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.868011:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0400/0x11620bc3f30aae58 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.868029:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0400/0x11620bc3f30aae58 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.868042:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0400/0x11620bc3f30aae58 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787571.868103:0:22716:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787787571.868108:0:22716:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787787571.868135:0:22716:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0400/0x11620bc3f30aae58 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.868196:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0400/0x11620bc3f30aae58 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.868225:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1200/0x11620bc3f30aae51 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8803 expref: 17 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.868246:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0400/0x11620bc3f30aae58 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8803 expref: 16 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.868256:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:3.0:1787787571.868259:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787787571.868263:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc43e0400, rc 0) 00000100:00100000:3.0:1787787571.868355:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a65d3225-1272-4ba4-9698-bcc15a4206b3+16:18744:x1874630484852480:12345-192.168.204.31@tcp:101:bash.0 Request processed in 521us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787571.870933:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 38 00000100:00100000:1.0:1787787571.872849:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787571.874178:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484852736 00000100:00100000:0.0:1787787571.874191:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484852736 00000100:00100000:1.0:1787787571.874358:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 5 00000100:00100000:1.0:1787787571.874369:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+16:18744:x1874630484852736:12345-192.168.204.31@tcp:35:bash.0 00000001:00080000:1.0:1787787571.874674:0:22717:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901897 00000100:00100000:1.0:1787787571.875120:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+18:18744:x1874630484852736:12345-192.168.204.31@tcp:35:bash.0 Request processed in 750us (2279us total) trans 12884901898 rc 0/0 00000100:00100000:1.0:1787787571.875130:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 5 00000020:00080000:1.0:1787787571.875175:0:22717:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1787787571.882699:0:22750:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787787571.892929:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787571.893048:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787571.895450:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787571.895473:0:25288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484852992 00000100:00100000:2.0:1787787571.895483:0:25288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484852992 00000100:00100000:3.0:1787787571.895517:0:24939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484853248 00000100:00100000:3.0:1787787571.895529:0:24939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484853248 00000100:00100000:2.0:1787787571.895619:0:25288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 19 00000100:00100000:2.0:1787787571.895631:0:25288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a65d3225-1272-4ba4-9698-bcc15a4206b3+5:2393:x1874630484852992:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787571.895702:0:25288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a65d3225-1272-4ba4-9698-bcc15a4206b3+5:2393:x1874630484852992:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 74us (2785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787571.895709:0:25288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 19 00000100:00100000:1.0:1787787571.896470:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787571.896521:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484852864 00000100:00100000:1.0:1787787571.896527:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484852864 00000100:00100000:2.0:1787787571.896580:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484853120 00000100:00100000:2.0:1787787571.896585:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484853120 00000100:00080000:0.0:1787787571.896628:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787787571.896634:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787787571.905863:0:24939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 20 00000100:00100000:3.0:1787787571.905884:0:24939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb47d838-e4ce-420a-9c06-daf336fc8d65+5:2393:x1874630484853248:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787571.906013:0:24939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb47d838-e4ce-420a-9c06-daf336fc8d65+5:2393:x1874630484853248:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 136us (12963us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787571.906023:0:24939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 20 00000100:00100000:1.0:1787787571.907818:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 21 00000100:00100000:1.0:1787787571.907842:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc24b6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a65d3225-1272-4ba4-9698-bcc15a4206b3+5:2393:x1874630484852864:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1787787571.908360:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc24b6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a65d3225-1272-4ba4-9698-bcc15a4206b3+5:2393:x1874630484852864:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 525us (12915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787571.908369:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 21 00000100:00100000:2.0:1787787571.908591:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 22 00000100:00100000:2.0:1787787571.908602:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb47d838-e4ce-420a-9c06-daf336fc8d65+5:2393:x1874630484853120:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787571.908651:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb47d838-e4ce-420a-9c06-daf336fc8d65+5:2393:x1874630484853120:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 51us (12182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787571.908658:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 22 00000100:00100000:0.0:1787787571.994827:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787571.995088:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484853504 00000100:00100000:3.0:1787787571.995102:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484853504 00000100:00100000:3.0:1787787571.995643:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 39 00000100:00100000:3.0:1787787571.995656:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+18:18755:x1874630484853504:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1787787571.995690:0:25511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787571.995719:0:25511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1200/0x11620bc3f30aae5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c880a expref: -99 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787571.995866:0:25511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787787571.996019:0:25511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1200/0x11620bc3f30aae5f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c880a expref: 20 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.996036:0:25511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc3a1d600) 00010000:00010000:3.0:1787787571.996040:0:25511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787787571.996047:0:25511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1200/0x11620bc3f30aae5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c880a expref: 20 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787571.996067:0:25511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc43e1200, rc 0) 00000100:00100000:3.0:1787787571.996534:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+19:18755:x1874630484853504:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 877us (1719us total) trans 12884901899 rc 301/301 00000100:00100000:3.0:1787787571.996568:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 39 00000100:00100000:1.0:1787787571.999290:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787572.005608:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484853760 00000100:00100000:3.0:1787787572.005623:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484853760 00000100:00100000:3.0:1787787572.005749:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6 00000100:00100000:3.0:1787787572.005762:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+19:18755:x1874630484853760:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1787787572.006023:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+20:18755:x1874630484853760:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 263us (6745us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1787787572.006032:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6 00000100:00100000:1.0:1787787572.067544:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787572.075687:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484854016 00000100:00100000:2.0:1787787572.075725:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484854016 00000100:00100000:2.0:1787787572.075854:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 40 00000100:00100000:2.0:1787787572.075867:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+20:18758:x1874630484854016:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1787787572.075901:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787572.075946:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30aae6d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8811 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787572.076091:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aae74 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787572.076108:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aae74 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787572.076122:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aae74 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787572.076176:0:22714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787787572.076326:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30aae6d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8811 expref: 23 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787572.076347:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aae74 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8811 expref: 22 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787572.076357:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:2.0:1787787572.076361:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787787572.076365:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0031c00, rc 0) 00000100:00100000:2.0:1787787572.076957:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+22:18758:x1874630484854016:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1090us (9427us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1787787572.076967:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 40 00000100:00100000:0.0:1787787572.081309:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787572.081367:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484854144 00000100:00100000:0.0:1787787572.081368:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787572.081384:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484854144 00000100:00100000:2.0:1787787572.081667:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 41 00000100:00100000:2.0:1787787572.081690:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+22:18758:x1874630484854144:12345-192.168.204.31@tcp:54:lfs.0 00000100:00100000:3.0:1787787572.081697:0:23473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484854272 00000100:00100000:3.0:1787787572.081707:0:23473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484854272 00010000:00010000:2.0:1787787572.081772:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aae82 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787572.081785:0:23473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 0 00010000:00010000:2.0:1787787572.081793:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aae82 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787572.081801:0:23473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ead00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+23:2391:x1874630484854272:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787572.081816:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aae82 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787572.081826:0:23473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787572.081856:0:22715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aae82 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787572.081858:0:23473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aae74 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8811 expref: 23 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787572.081892:0:22715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aae82 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787572.081903:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aae82 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787572.081905:0:23473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:3.0:1787787572.081919:0:23473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787572.081920:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787572.081928:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aae82 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787572.081937:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aae82 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787572.081950:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:2.0:1787787572.081953:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787787572.081983:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aae82 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787572.081993:0:23473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ead00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+22:2391:x1874630484854272:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 194us (621us total) trans 0 rc 0/0 00010000:00010000:2.0:1787787572.081996:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aae82 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787572.082018:0:23473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 0 00000100:00100000:2.0:1787787572.082087:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+21:18758:x1874630484854144:12345-192.168.204.31@tcp:54:lfs.0 Request processed in 407us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787572.082096:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 41 00000100:00100000:1.0:1787787572.093130:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787572.093278:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484854528 00000100:00100000:3.0:1787787572.093291:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484854528 00000100:00100000:3.0:1787787572.093384:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7 00000100:00100000:3.0:1787787572.093397:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+21:18758:x1874630484854528:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1787787572.093714:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+22:18758:x1874630484854528:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 318us (597us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1787787572.093723:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7 00000040:00080000:1.0:1787787572.457814:0:23468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787787572.535765:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787572.535975:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484854784 00000100:00100000:0.0:1787787572.535985:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484854784 00000100:00100000:0.0:1787787572.536044:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 42 00000100:00100000:0.0:1787787572.536053:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a65d3225-1272-4ba4-9698-bcc15a4206b3+22:18789:x1874630484854784:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1787787572.536090:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787572.536112:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14800/0x11620bc3f30aae89 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8818 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787572.536249:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15a00/0x11620bc3f30aae90 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787572.536264:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15a00/0x11620bc3f30aae90 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787572.536276:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15a00/0x11620bc3f30aae90 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787572.536286:0:22716:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787787572.536413:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14800/0x11620bc3f30aae89 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8818 expref: 25 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787572.536434:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15a00/0x11620bc3f30aae90 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8818 expref: 24 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787572.536443:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:0.0:1787787572.536446:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787787572.536449:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c15a00, rc 0) 00000100:00100000:0.0:1787787572.536517:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a65d3225-1272-4ba4-9698-bcc15a4206b3+24:18789:x1874630484854784:12345-192.168.204.31@tcp:101:cat.0 Request processed in 464us (761us total) trans 12884901903 rc 0/0 00000100:00100000:0.0:1787787572.536529:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 42 00000100:00100000:0.0:1787787572.545623:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787572.546047:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484855168 00000100:00100000:3.0:1787787572.546064:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484855168 00000100:00100000:3.0:1787787572.546199:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8 00000100:00100000:3.0:1787787572.546212:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+24:18789:x1874630484855168:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:3.0:1787787572.546650:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+25:18789:x1874630484855168:12345-192.168.204.31@tcp:35:cat.0 Request processed in 439us (1035us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1787787572.546660:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8 00000100:00100000:1.0:1787787572.553359:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787572.553539:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484854912 00000100:00100000:3.0:1787787572.553557:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484854912 00000100:00100000:3.0:1787787572.553648:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1 00000100:00100000:3.0:1787787572.553660:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+25:2393:x1874630484854912:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787572.553683:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787572.553720:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15a00/0x11620bc3f30aae90 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8818 expref: 25 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787572.553746:0:22699:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:3.0:1787787572.553753:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787572.553842:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+24:2393:x1874630484854912:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 183us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787572.553850:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1 00000100:00100000:1.0:1787787572.647338:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787572.647524:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484855424 00000100:00100000:0.0:1787787572.647534:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484855424 00000100:00100000:0.0:1787787572.647614:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 43 00000100:00100000:0.0:1787787572.647624:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+24:18795:x1874630484855424:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:0.0:1787787572.647648:0:25511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787572.647689:0:25511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14800/0x11620bc3f30aae9e lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c881f expref: -99 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787572.647799:0:25511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15e00/0x11620bc3f30aaea5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787572.647814:0:25511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15e00/0x11620bc3f30aaea5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787572.647826:0:25511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15e00/0x11620bc3f30aaea5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787572.647836:0:25511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787787572.647968:0:25511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14800/0x11620bc3f30aae9e lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c881f expref: 27 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787572.647989:0:25511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15e00/0x11620bc3f30aaea5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c881f expref: 26 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787572.647998:0:25511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:0.0:1787787572.648001:0:25511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787787572.648004:0:25511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c15e00, rc 0) 00000100:00100000:0.0:1787787572.648072:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+26:18795:x1874630484855424:12345-192.168.204.31@tcp:101:dd.0 Request processed in 442us (737us total) trans 12884901905 rc 0/0 00000100:00100000:0.0:1787787572.648080:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 43 00010000:00010000:2.0:1787787572.650275:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787572.658877:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787572.658961:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787572.659315:0:23473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484855552 00000100:00100000:3.0:1787787572.659325:0:23473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484855552 00000100:00100000:3.0:1787787572.659419:0:23473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2 00000100:00100000:3.0:1787787572.659445:0:23473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+26:2392:x1874630484855552:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787572.659463:0:23473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787572.659489:0:23473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15e00/0x11620bc3f30aaea5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c881f expref: 26 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787572.659759:0:23473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:3.0:1787787572.659766:0:23473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787572.659819:0:23473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+25:2392:x1874630484855552:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 375us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787572.659835:0:23473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2 00000100:00100000:0.0:1787787572.659989:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484855680 00000100:00100000:0.0:1787787572.659998:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484855680 00000100:00100000:0.0:1787787572.660033:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 44 00000100:00100000:0.0:1787787572.660040:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+25:18795:x1874630484855680:12345-192.168.204.31@tcp:101:dd.0 00010000:00010000:0.0:1787787572.660059:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787572.660074:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14800/0x11620bc3f30aaeb3 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8826 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787572.660101:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14a00/0x11620bc3f30aaeba lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787572.660113:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14a00/0x11620bc3f30aaeba lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787572.660123:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14a00/0x11620bc3f30aaeba lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787572.660256:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14800/0x11620bc3f30aaeb3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8826 expref: 27 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787572.660270:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14a00/0x11620bc3f30aaeba lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8826 expref: 26 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787572.660278:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:0.0:1787787572.660281:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787787572.660284:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c14a00, rc 0) 00000100:00100000:0.0:1787787572.660325:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+26:18795:x1874630484855680:12345-192.168.204.31@tcp:101:dd.0 Request processed in 285us (1458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787572.660331:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 44 00000100:00100000:2.0:1787787572.674107:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787572.674779:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484855936 00000100:00100000:1.0:1787787572.674791:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484855936 00000100:00100000:1.0:1787787572.674861:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 45 00000100:00100000:1.0:1787787572.674871:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+26:18795:x1874630484855936:12345-192.168.204.31@tcp:36:dd.0 00010000:00010000:1.0:1787787572.674920:0:22715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787572.674946:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0400/0x11620bc3f30aae58 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8803 expref: 26 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787572.674982:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:1.0:1787787572.674987:0:22715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787787572.675212:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aaec1 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787572.675226:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aaec1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787572.675235:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aaec1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787787572.675301:0:22715:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901906 00000004:00010000:1.0:1787787572.675327:0:22715:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c05a3b5 reply state 000000003f4a3008 transno 12884901907 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aaec1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787572.675339:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aaec1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787572.675346:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:1.0:1787787572.675349:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787787572.675352:0:22715:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787787572.675466:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+28:18795:x1874630484855936:12345-192.168.204.31@tcp:36:dd.0 Request processed in 596us (1375us total) trans 12884901907 rc 0/0 00000100:00100000:1.0:1787787572.675473:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 45 00000020:00080000:1.0:1787787572.675478:0:22715:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787787572.816318:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787572.816943:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484856192 00000100:00100000:1.0:1787787572.816954:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484856192 00000100:00100000:1.0:1787787572.817020:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 9 00000100:00100000:1.0:1787787572.817032:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+28:18795:x1874630484856192:12345-192.168.204.31@tcp:35:dd.0 00000100:00100000:1.0:1787787572.817327:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+29:18795:x1874630484856192:12345-192.168.204.31@tcp:35:dd.0 Request processed in 296us (1017us total) trans 12884901908 rc 0/0 00000100:00100000:1.0:1787787572.817335:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 9 00000040:00080000:2.0:1787787572.905876:0:22750:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787787573.135770:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787573.136946:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484856320 00000100:00100000:1.0:1787787573.136962:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484856320 00000100:00100000:1.0:1787787573.137057:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 46 00000100:00100000:1.0:1787787573.137070:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc307840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a65d3225-1272-4ba4-9698-bcc15a4206b3+29:18809:x1874630484856320:12345-192.168.204.31@tcp:101:stat.0 00010000:00010000:1.0:1787787573.137092:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787573.137111:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296600/0x11620bc3f30aaec8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c882d expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.137199:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296000/0x11620bc3f30aaecf lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.137212:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296000/0x11620bc3f30aaecf lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.137226:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296000/0x11620bc3f30aaecf lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.137237:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aaed6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.137255:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aaed6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.137263:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aaed6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.137348:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296e00/0x11620bc3f30aaedd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.137370:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296e00/0x11620bc3f30aaedd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.137377:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296e00/0x11620bc3f30aaedd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787573.137419:0:22716:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787787573.137424:0:22716:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787787573.137461:0:22716:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296e00/0x11620bc3f30aaedd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.137483:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296e00/0x11620bc3f30aaedd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.137492:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296000/0x11620bc3f30aaecf lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.137498:0:22716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296000/0x11620bc3f30aaecf lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.137505:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296000/0x11620bc3f30aaecf lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.137511:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc4296000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787573.137515:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296000/0x11620bc3f30aaecf lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.137522:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296000/0x11620bc3f30aaecf lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.137532:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff986fc2a18e00) 00010000:00010000:1.0:1787787573.137541:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787573.137546:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296000/0x11620bc3f30aaecf lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.137553:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296000/0x11620bc3f30aaecf lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.137570:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aaed6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.137576:0:22716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aaed6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.137582:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aaed6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.137587:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc4297200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787573.137589:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aaed6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.137596:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aaed6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.137603:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff986fc3a1df00) 00010000:00010000:1.0:1787787573.137605:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787573.137608:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aaed6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.137613:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aaed6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.137639:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296600/0x11620bc3f30aaec8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c882d expref: 31 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.137682:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296e00/0x11620bc3f30aaedd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c882d expref: 30 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.137690:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:1.0:1787787573.137692:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787787573.137694:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc4296e00, rc 0) 00000100:00100000:1.0:1787787573.137762:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc307840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a65d3225-1272-4ba4-9698-bcc15a4206b3+30:18809:x1874630484856320:12345-192.168.204.31@tcp:101:stat.0 Request processed in 695us (2008us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787573.137769:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 46 00000100:00080000:0.0:1787787573.137862:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787573.200610:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787573.201221:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484856576 00000100:00100000:1.0:1787787573.201235:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484856576 00000100:00100000:1.0:1787787573.201317:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 47 00000100:00100000:1.0:1787787573.201328:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc304b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+30:18815:x1874630484856576:12345-192.168.204.31@tcp:36:truncate.0 00010000:00010000:1.0:1787787573.201382:0:22715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787573.201410:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296e00/0x11620bc3f30aaedd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c882d expref: 30 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.201431:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:1.0:1787787573.201436:0:22715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787787573.201617:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296600/0x11620bc3f30aaee4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.201634:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296600/0x11620bc3f30aaee4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.201645:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296600/0x11620bc3f30aaee4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787787573.201716:0:22715:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901909 00000004:00010000:1.0:1787787573.201738:0:22715:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000019130189 reply state 00000000b27041e2 transno 12884901910 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296600/0x11620bc3f30aaee4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.201750:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296600/0x11620bc3f30aaee4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.201757:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:1.0:1787787573.201760:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787787573.201762:0:22715:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787787573.201891:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc304b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+32:18815:x1874630484856576:12345-192.168.204.31@tcp:36:truncate.0 Request processed in 564us (1297us total) trans 12884901910 rc 0/0 00000100:00100000:1.0:1787787573.201899:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 47 00000020:00080000:1.0:1787787573.201905:0:22715:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787787573.365455:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787573.365614:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484856704 00000100:00100000:1.0:1787787573.365629:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484856704 00000100:00100000:1.0:1787787573.365727:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 48 00000100:00100000:1.0:1787787573.365739:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc307c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a65d3225-1272-4ba4-9698-bcc15a4206b3+32:18829:x1874630484856704:12345-192.168.204.31@tcp:101:stat.0 00010000:00010000:1.0:1787787573.365772:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787787573.365801:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296e00/0x11620bc3f30aaeeb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8834 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.365904:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aaef2 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.365924:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aaef2 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.365939:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aaef2 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.365963:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296000/0x11620bc3f30aaef9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.365972:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296000/0x11620bc3f30aaef9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.365980:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296000/0x11620bc3f30aaef9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.366084:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297e00/0x11620bc3f30aaf00 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.366094:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297e00/0x11620bc3f30aaf00 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.366102:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297e00/0x11620bc3f30aaf00 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787787573.366218:0:22716:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1787787573.366224:0:22716:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787787573.366248:0:22716:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297e00/0x11620bc3f30aaf00 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.366263:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297e00/0x11620bc3f30aaf00 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.366273:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aaef2 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.366293:0:22716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aaef2 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.366312:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aaef2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.366320:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc4297200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787573.366325:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aaef2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.366335:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aaef2 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.366350:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff986fc2a18e00) 00010000:00010000:1.0:1787787573.366353:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787573.366359:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aaef2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.366366:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aaef2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.366382:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296000/0x11620bc3f30aaef9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.366389:0:22716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296000/0x11620bc3f30aaef9 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.366395:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296000/0x11620bc3f30aaef9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.366400:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc4296000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787573.366403:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296000/0x11620bc3f30aaef9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.366421:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296000/0x11620bc3f30aaef9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.366430:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff986fc3a1df00) 00010000:00010000:1.0:1787787573.366433:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787573.366436:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296000/0x11620bc3f30aaef9 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.366442:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296000/0x11620bc3f30aaef9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.366478:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296e00/0x11620bc3f30aaeeb lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8834 expref: 34 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.366493:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297e00/0x11620bc3f30aaf00 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8834 expref: 33 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787573.366500:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:1.0:1787787573.366503:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787787573.366506:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc4297e00, rc 0) 00000100:00100000:1.0:1787787573.366591:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc307c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a65d3225-1272-4ba4-9698-bcc15a4206b3+33:18829:x1874630484856704:12345-192.168.204.31@tcp:101:stat.0 Request processed in 854us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787573.366601:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 48 00000100:00100000:2.0:1787787573.520466:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787573.520589:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484856960 00000100:00100000:0.0:1787787573.520599:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484856960 00000100:00100000:0.0:1787787573.520668:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 49 00000100:00100000:0.0:1787787573.520679:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+33:18839:x1874630484856960:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1787787573.520980:0:25511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787573.521003:0:25511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14800/0x11620bc3f30aaf07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c883b expref: -99 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787573.521120:0:25511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787787573.521255:0:25511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14800/0x11620bc3f30aaf07 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c883b expref: 35 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.521270:0:25511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc3a1d600) 00010000:00010000:0.0:1787787573.521295:0:25511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787787573.521301:0:25511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14800/0x11620bc3f30aaf07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c883b expref: 35 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.521316:0:25511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c14800, rc 0) 00000100:00100000:0.0:1787787573.521379:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+34:18839:x1874630484856960:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 702us (925us total) trans 12884901911 rc 301/301 00000100:00100000:0.0:1787787573.521387:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 49 00000100:00100000:3.0:1787787573.525507:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787573.530068:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484857216 00000100:00100000:1.0:1787787573.530082:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484857216 00000100:00100000:1.0:1787787573.530161:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10 00000100:00100000:1.0:1787787573.530173:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c47d3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+34:18839:x1874630484857216:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:1.0:1787787573.530456:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c47d3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+35:18839:x1874630484857216:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 284us (4958us total) trans 12884901912 rc 0/0 00000100:00100000:1.0:1787787573.530463:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10 00000100:00100000:0.0:1787787573.609837:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc305680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503834880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787787573.609925:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787573.609976:0:3655:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787787573.609982:0:3655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503835008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787787573.610011:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787573.610039:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787787573.610052:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc304780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503835136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787787573.610082:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503834880 00000100:00100000:3.0:1787787573.610090:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787573.610108:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503834880 00000100:00100000:3.0:1787787573.610124:0:25757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503835136 00000100:00100000:3.0:1787787573.610156:0:25757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503835136 00000100:00100000:0.0:1787787573.610174:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503835008 00000100:00100000:0.0:1787787573.610179:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503835008 00000100:00080000:3.0:1787787573.610182:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787787573.610199:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787787573.610209:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503834880:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787787573.610219:0:25757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787787573.610228:0:25757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503835136:12345-0@lo:13:osp-pre-0-1.0 00000004:00000024:0.0:1787787573.610244:0:22719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00002000:00000024:3.0:1787787573.610262:0:25757:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787787573.610312:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3655:x1874630503834880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787573.610320:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787787573.610334:0:25757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503835136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787573.610341:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787787573.610346:0:25757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787787573.610351:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503835008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787787573.610372:0:22719:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787787573.610572:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc304780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503835136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787787573.610996:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3655:x1874630503835008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 646us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787573.611004:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787787573.612073:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc305680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3655:1874630503834880:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787787573.612117:0:3655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3655:1874630503835008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787787573.612504:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787573.612609:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484857472 00000100:00100000:0.0:1787787573.612618:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484857472 00000100:00100000:0.0:1787787573.612794:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 50 00000100:00100000:0.0:1787787573.612806:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a65d3225-1272-4ba4-9698-bcc15a4206b3+35:18845:x1874630484857472:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:0.0:1787787573.612830:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787573.612852:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14800/0x11620bc3f30aaf15 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8842 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.612975:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aaf1c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.612990:0:22716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30aae43 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87fc expref: 36 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.613022:0:22716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297e00/0x11620bc3f30aaf00 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8834 expref: 36 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.613032:0:22716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aaf1c lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.613064:0:22716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297e00/0x11620bc3f30aaf00 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8834 expref: 36 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.613080:0:22716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297e00/0x11620bc3f30aaf00 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8834 expref: 36 pid: 22716 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787573.613095:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e8780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22716:1874630503835264:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787573.613208:0:22716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30aae43 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87fc expref: 36 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.613217:0:22716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30aae43 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87fc expref: 36 pid: 22715 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787573.613226:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e83c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22716:1874630503835392:192.168.204.31@tcp:104: 00000100:00100000:0.0:1787787573.613260:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c5392840 going to sleep for 11 seconds 00000100:00100000:0.0:1787787573.616099:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e8780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22716:1874630503835264:192.168.204.31@tcp:104: 00000100:00100000:0.0:1787787573.616116:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e83c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22716:1874630503835392:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787573.616166:0:22716:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aaf1c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787573.618336:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787573.618388:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787573.618512:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484857728 00000100:00100000:3.0:1787787573.618524:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484857728 00010000:00010000:3.0:1787787573.618569:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30aae43 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87fc expref: 37 pid: 22715 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787573.618606:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484857600 00000100:00100000:3.0:1787787573.618610:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484857600 00010000:00010000:3.0:1787787573.618634:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297e00/0x11620bc3f30aaf00 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8834 expref: 38 pid: 22716 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787573.618667:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 17 00000100:00100000:3.0:1787787573.618679:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13f5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+38:2391:x1874630484857728:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787573.618695:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787573.618703:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30aae43 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87fc expref: 38 pid: 22715 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787573.618715:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30aae43 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87fc expref: 38 pid: 22715 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787573.618743:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30aae43 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c87fc expref: 38 pid: 22715 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787573.618763:0:22699:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:3.0:1787787573.618784:0:22699:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aaf1c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787573.618794:0:22699:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aaf1c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787573.618801:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787573.618859:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13f5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+37:2391:x1874630484857728:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 183us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787573.618867:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 17 00000100:00100000:3.0:1787787573.618913:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 18 00000100:00100000:3.0:1787787573.618920:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+36:2391:x1874630484857600:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787573.618929:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787573.618934:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297e00/0x11620bc3f30aaf00 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8834 expref: 36 pid: 22716 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787573.618944:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297e00/0x11620bc3f30aaf00 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8834 expref: 36 pid: 22716 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787573.618957:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297e00/0x11620bc3f30aaf00 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8834 expref: 36 pid: 22716 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787573.618967:0:22699:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:3.0:1787787573.618970:0:22699:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aaf1c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787573.618978:0:22699:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aaf1c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787573.618996:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aaf1c lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787573.619020:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787573.619041:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+35:2391:x1874630484857600:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 121us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787573.619048:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 18 00010000:00010000:3.0:1787787573.619075:0:22716:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aaf1c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787573.619082:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aaf1c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787573.619102:0:22716:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1787787573.619304:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14800/0x11620bc3f30aaf15 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8842 expref: 36 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787573.619321:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aaf1c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8842 expref: 35 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787573.619329:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:3.0:1787787573.619331:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787787573.619334:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c15200, rc 0) 00000100:00100000:3.0:1787787573.619359:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a65d3225-1272-4ba4-9698-bcc15a4206b3+35:18845:x1874630484857472:12345-192.168.204.31@tcp:101:bash.0 Request processed in 6557us (6858us total) trans 12884901913 rc 0/0 00000100:00100000:3.0:1787787573.619366:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 50 00000100:00100000:2.0:1787787573.623534:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787573.623630:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484857984 00000100:00100000:0.0:1787787573.623642:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484857984 00000100:00100000:0.0:1787787573.623704:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 51 00000100:00100000:0.0:1787787573.623715:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+35:18845:x1874630484857984:12345-192.168.204.31@tcp:36:bash.0 00010000:00010000:0.0:1787787573.623954:0:25511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14400/0x11620bc3f30aaf2a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.623971:0:25511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14400/0x11620bc3f30aaf2a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.623982:0:25511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14400/0x11620bc3f30aaf2a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787787573.624025:0:25511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000004:00010000:0.0:1787787573.624047:0:25511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008bfd4213 reply state 00000000a7d6dea8 transno 12884901915 ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14400/0x11620bc3f30aaf2a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.624061:0:25511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14400/0x11620bc3f30aaf2a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.624068:0:25511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:0.0:1787787573.624071:0:25511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787787573.624074:0:25511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787787573.624207:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+38:18845:x1874630484857984:12345-192.168.204.31@tcp:36:bash.0 Request processed in 492us (683us total) trans 12884901915 rc 0/0 00000100:00100000:0.0:1787787573.624213:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 51 00000020:00080000:0.0:1787787573.624218:0:25511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787787573.627220:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787573.627317:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484858112 00000100:00100000:2.0:1787787573.627335:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484858112 00000100:00100000:2.0:1787787573.627396:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 52 00000100:00100000:2.0:1787787573.627406:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc305680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+38:18845:x1874630484858112:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:2.0:1787787573.627430:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787573.627451:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30aaf31 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8849 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.627514:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30aaf31 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8849 expref: 39 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.627528:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30aaf31 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8849 expref: 39 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.627567:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:2.0:1787787573.627571:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787787573.627575:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030600, rc 0) 00000100:00100000:2.0:1787787573.627643:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc305680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+39:18845:x1874630484858112:12345-192.168.204.31@tcp:101:bash.0 Request processed in 239us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787573.627650:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 52 00000100:00100000:3.0:1787787573.635258:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787573.635542:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484858240 00000100:00100000:0.0:1787787573.635553:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484858240 00000100:00100000:0.0:1787787573.635626:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 53 00000100:00100000:0.0:1787787573.635636:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc304780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+39:18845:x1874630484858240:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:0.0:1787787573.635656:0:25511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787573.635676:0:25511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15c00/0x11620bc3f30aaf38 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8850 expref: -99 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.635767:0:25511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14600/0x11620bc3f30aaf3f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.635782:0:25511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aaf1c lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8842 expref: 40 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.635791:0:25511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14600/0x11620bc3f30aaf3f lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.635823:0:25511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aaf1c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8842 expref: 40 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.635837:0:25511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aaf1c lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8842 expref: 40 pid: 22716 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787573.635851:0:25511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36e83c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25511:1874630503835520:192.168.204.31@tcp:104: 00000100:00100000:0.0:1787787573.635939:0:25511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c5392840 going to sleep for 11 seconds 00000100:00100000:1.0:1787787573.640542:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787573.640640:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484858368 00000100:00100000:3.0:1787787573.640650:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484858368 00010000:00010000:3.0:1787787573.640692:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aaf1c lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8842 expref: 41 pid: 22716 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787573.640734:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 19 00000100:00100000:3.0:1787787573.640745:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+41:2391:x1874630484858368:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787573.640760:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787573.640768:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aaf1c lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8842 expref: 41 pid: 22716 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787573.640784:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aaf1c lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8842 expref: 41 pid: 22716 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787573.640810:0:22699:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:3.0:1787787573.640815:0:22699:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14600/0x11620bc3f30aaf3f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787573.640825:0:22699:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14600/0x11620bc3f30aaf3f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787573.640833:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14600/0x11620bc3f30aaf3f lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787573.640852:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787787573.640915:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+41:2391:x1874630484858368:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 171us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787573.640923:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 19 00010000:00010000:0.0:1787787573.642824:0:25511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30aaf1c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8842 expref: 40 pid: 22716 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787573.642849:0:25511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36e83c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25511:1874630503835520:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787573.642874:0:25511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14600/0x11620bc3f30aaf3f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.642899:0:25511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14600/0x11620bc3f30aaf3f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.642905:0:25511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14600/0x11620bc3f30aaf3f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787573.642962:0:25511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787787573.642967:0:25511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787787573.642988:0:25511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14600/0x11620bc3f30aaf3f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.643022:0:25511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15c00/0x11620bc3f30aaf38 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8850 expref: 40 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.643037:0:25511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14600/0x11620bc3f30aaf3f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8850 expref: 39 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.643045:0:25511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:0.0:1787787573.643048:0:25511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787787573.643052:0:25511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c14600, rc 0) 00000100:00100000:0.0:1787787573.643258:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc304780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+39:18845:x1874630484858240:12345-192.168.204.31@tcp:101:bash.0 Request processed in 7622us (8019us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787573.643267:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 53 00000100:00100000:3.0:1787787573.649009:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787573.649097:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484858624 00000100:00100000:2.0:1787787573.649107:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484858624 00000100:00100000:2.0:1787787573.649185:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 3 00000100:00100000:2.0:1787787573.649194:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3052c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65d3225-1272-4ba4-9698-bcc15a4206b3+39:18845:x1874630484858624:12345-192.168.204.31@tcp:103:bash.0 00010000:00010000:2.0:1787787573.649210:0:22701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787787573.649234:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30aaf31 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8849 expref: 39 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.649267:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14600/0x11620bc3f30aaf3f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8850 expref: 38 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.649290:0:22701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:2.0:1787787573.649294:0:22701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787573.650521:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3052c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65d3225-1272-4ba4-9698-bcc15a4206b3+37:18845:x1874630484858624:12345-192.168.204.31@tcp:103:bash.0 Request processed in 1321us (1516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787573.650532:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 3 00000100:00100000:3.0:1787787573.653755:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787573.653893:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484858752 00000100:00100000:2.0:1787787573.653903:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484858752 00000100:00100000:2.0:1787787573.653970:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 54 00000100:00100000:2.0:1787787573.653981:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+37:18845:x1874630484858752:12345-192.168.204.31@tcp:58:bash.0 00010000:00010000:2.0:1787787573.654098:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aaf46 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.654117:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aaf46 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.654129:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aaf46 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787787573.655950:0:22714:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787787573.655984:0:22714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1787787573.656129:0:22714:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1787787573.656434:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+37:18845:x1874630484858752:12345-192.168.204.31@tcp:58:bash.0 Request processed in 2262us (2495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787573.656445:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 54 00000100:00100000:1.0:1787787573.660198:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787573.660501:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484858880 00000100:00100000:2.0:1787787573.660512:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484858880 00000100:00100000:2.0:1787787573.660574:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 55 00000100:00100000:2.0:1787787573.660585:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+37:18845:x1874630484858880:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:2.0:1787787573.660605:0:22715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787573.660736:0:22715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30aaf4d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8857 expref: -99 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.660798:0:22715:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aaf46 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.660811:0:22715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30aaf4d lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8857 expref: 38 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.660850:0:22715:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aaf46 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.660864:0:22715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30aaf4d lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8857 expref: 38 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.660879:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:2.0:1787787573.660882:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787787573.660886:0:22715:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30aaf4d lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8857 expref: 38 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.660894:0:22715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0031200, rc 0) 00000100:00100000:2.0:1787787573.660959:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+38:18845:x1874630484858880:12345-192.168.204.31@tcp:101:bash.0 Request processed in 375us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787573.662285:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 55 00010000:00010000:0.0:1787787573.673466:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787787573.929407:0:22750:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787787573.929417:0:22750:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787787573.929443:0:22750:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1787787573.929451:0:22750:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1787787573.929598:0:22750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ecb40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22750:1874630503835648:192.168.204.31@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787787573.929702:0:22750:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870f6985900 going to sleep for 11 seconds 00000100:00100000:1.0:1787787573.937574:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787573.937809:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484859008 00000100:00100000:2.0:1787787573.937820:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484859008 00000100:00100000:2.0:1787787573.937880:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 56 00000100:00100000:2.0:1787787573.937890:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+39:18846:x1874630484859008:12345-192.168.204.31@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787787573.937923:0:22714:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787787573.938205:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+39:18846:x1874630484859008:12345-192.168.204.31@tcp:53:lhsmtool_posix.0 Request processed in 315us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787573.938214:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 56 00000100:00100000:2.0:1787787573.951595:0:22750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ecb40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22750:1874630503835648:192.168.204.31@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787787573.956330:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787573.956513:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484859136 00000100:00100000:0.0:1787787573.956523:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484859136 00000100:00100000:0.0:1787787573.956594:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 57 00000100:00100000:0.0:1787787573.956605:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+38:18846:x1874630484859136:12345-192.168.204.31@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787787573.956694:0:25511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14c00/0x11620bc3f30aaf54 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.956712:0:25511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14c00/0x11620bc3f30aaf54 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.956726:0:25511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14c00/0x11620bc3f30aaf54 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.956784:0:25511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15400/0x11620bc3f30aaf5b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.956793:0:25511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15400/0x11620bc3f30aaf5b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.956801:0:25511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15400/0x11620bc3f30aaf5b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.956827:0:25511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14e00/0x11620bc3f30aaf62 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.956836:0:25511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14e00/0x11620bc3f30aaf62 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.956843:0:25511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14e00/0x11620bc3f30aaf62 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787787573.956890:0:25511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787787573.956895:0:25511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787787573.956911:0:25511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14e00/0x11620bc3f30aaf62 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.956922:0:25511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14c00/0x11620bc3f30aaf54 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.956934:0:25511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14c00/0x11620bc3f30aaf54 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.956941:0:25511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14c00/0x11620bc3f30aaf54 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.956947:0:25511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787573.956951:0:25511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14c00/0x11620bc3f30aaf54 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.956958:0:25511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14c00/0x11620bc3f30aaf54 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.956970:0:25511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff986fc2a18500) 00010000:00010000:0.0:1787787573.956973:0:25511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787573.956978:0:25511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14c00/0x11620bc3f30aaf54 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.956985:0:25511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14c00/0x11620bc3f30aaf54 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.957000:0:25511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15400/0x11620bc3f30aaf5b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.957005:0:25511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15400/0x11620bc3f30aaf5b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.957011:0:25511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15400/0x11620bc3f30aaf5b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.957017:0:25511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787573.957027:0:25511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15400/0x11620bc3f30aaf5b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.957034:0:25511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15400/0x11620bc3f30aaf5b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.957043:0:25511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9870d974b700) 00010000:00010000:0.0:1787787573.957046:0:25511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787573.957049:0:25511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15400/0x11620bc3f30aaf5b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.957055:0:25511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15400/0x11620bc3f30aaf5b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.957069:0:25511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14e00/0x11620bc3f30aaf62 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.957076:0:25511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14e00/0x11620bc3f30aaf62 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.957082:0:25511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14e00/0x11620bc3f30aaf62 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.957087:0:25511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787573.957090:0:25511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14e00/0x11620bc3f30aaf62 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.957096:0:25511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14e00/0x11620bc3f30aaf62 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.957104:0:25511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:0.0:1787787573.957106:0:25511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787573.957118:0:25511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14e00/0x11620bc3f30aaf62 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787573.957125:0:25511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14e00/0x11620bc3f30aaf62 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787573.957255:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+38:18846:x1874630484859136:12345-192.168.204.31@tcp:34:lhsmtool_posix.0 Request processed in 650us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787573.957276:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 57 00000100:00100000:0.0:1787787573.967682:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787573.969542:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484859392 00000100:00100000:2.0:1787787573.969559:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484859392 00000100:00100000:2.0:1787787573.969634:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 58 00000100:00100000:2.0:1787787573.969645:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+38:18846:x1874630484859392:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787787573.969668:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787573.969692:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30aaf69 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c885e expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.969803:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30aaf70 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.969819:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30aaf70 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.969832:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30aaf70 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787787573.969845:0:22714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787787573.969939:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30aaf70 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.969947:0:22714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30aaf70 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.969955:0:22714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30aaf70 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.969981:0:22714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787573.969985:0:22714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30aaf70 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.969992:0:22714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30aaf70 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.970005:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:2.0:1787787573.970007:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787787573.970012:0:22714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30aaf70 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.970018:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30aaf70 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.970064:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30aaf69 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c885e expref: 40 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.970074:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff986fc2a18500) 00010000:00010000:2.0:1787787573.970076:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787787573.970080:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30aaf69 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c885e expref: 40 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.970088:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030600, rc 0) 00000100:00100000:2.0:1787787573.970216:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+39:18846:x1874630484859392:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 572us (2545us total) trans 12884901916 rc 301/301 00000100:00100000:2.0:1787787573.970224:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 58 00000100:00100000:3.0:1787787573.978925:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787573.979478:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484859520 00000100:00100000:0.0:1787787573.979489:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484859520 00000100:00100000:0.0:1787787573.979544:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 59 00000100:00100000:0.0:1787787573.979554:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+39:18846:x1874630484859520:12345-192.168.204.31@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787787573.979597:0:25511:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787787573.979717:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+39:18846:x1874630484859520:12345-192.168.204.31@tcp:53:lhsmtool_posix.0 Request processed in 163us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787573.979724:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 59 00000100:00100000:0.0:1787787573.987363:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787573.987631:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484859776 00000100:00100000:2.0:1787787573.987657:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484859776 00000100:00100000:2.0:1787787573.987718:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 60 00000100:00100000:2.0:1787787573.987729:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+39:18846:x1874630484859776:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787787573.987752:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787573.987773:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30aaf7e lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8865 expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787787573.988195:0:22714:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =59 00000004:00080000:2.0:1787787573.988202:0:22714:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+59 in llog 00000004:00080000:2.0:1787787573.988222:0:22714:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:2.0:1787787573.988629:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30aaf85 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.988645:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30aaf85 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.988657:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30aaf85 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.988717:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30aaf7e lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8865 expref: 42 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.988736:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30aaf85 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8865 expref: 41 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.988746:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff986fc3a1d400) 00010000:00010000:2.0:1787787573.988748:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787787573.988752:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030a00, rc 0) 00000100:00100000:2.0:1787787573.988817:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+41:18846:x1874630484859776:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 1089us (1471us total) trans 12884901917 rc 0/0 00000100:00100000:2.0:1787787573.988835:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 60 00000100:00100000:1.0:1787787573.994846:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787573.995073:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484860032 00000100:00100000:0.0:1787787573.995083:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484860032 00000100:00100000:2.0:1787787573.995226:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 61 00000100:00100000:2.0:1787787573.995240:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+41:18846:x1874630484860032:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787787573.995310:0:22715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787573.995349:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030a00/0x11620bc3f30aaf85 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8865 expref: 41 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.995380:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff986fc3a1d400) 00010000:00010000:2.0:1787787573.995389:0:22715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787787573.995413:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30aaf93 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.995427:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30aaf93 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.995437:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30aaf93 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.995453:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aaf9a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xe64a1d7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.995460:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aaf9a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe64a1d7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.995467:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aaf9a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe64a1d7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.995523:0:22715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30aaf93 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.995547:0:22715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30aaf93 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.995555:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30aaf93 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.995561:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787573.995565:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30aaf93 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.995573:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30aaf93 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.995582:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff986fc2a18e00) 00010000:00010000:2.0:1787787573.995585:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787573.995589:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30aaf93 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.995595:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030600/0x11620bc3f30aaf93 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.995605:0:22715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aaf9a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe64a1d7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.995611:0:22715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aaf9a lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe64a1d7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.995617:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aaf9a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe64a1d7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.995622:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787573.995630:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aaf9a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe64a1d7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.995638:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aaf9a lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe64a1d7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.995645:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xe64a1d7a (ffff986fc3a1db00) 00010000:00010000:2.0:1787787573.995647:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787787573.995650:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aaf9a lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xe64a1d7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.995657:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aaf9a lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xe64a1d7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787573.995749:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+40:18846:x1874630484860032:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 Request processed in 512us (913us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787787573.995757:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 61 00000100:00100000:0.0:1787787573.999701:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787573.999779:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484860160 00000100:00100000:2.0:1787787573.999789:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484860160 00000100:00100000:2.0:1787787573.999847:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 62 00000100:00100000:2.0:1787787573.999857:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+40:18846:x1874630484860160:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787787573.999876:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787573.999902:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30aafa1 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c886c expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.999942:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aafa8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.999955:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aafa8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787573.999984:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aafa8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787574.000086:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff987101ee2200/0x11620bc3f30aafa1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c886c expref: 42 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787574.000104:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c13f5000/0x11620bc3f30aafa8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c886c expref: 41 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787574.000113:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff986fc3a1d900) 00010000:00010000:2.0:1787787574.000116:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787787574.000119:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c13f5000, rc 0) 00000100:00100000:2.0:1787787574.000687:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+41:18846:x1874630484860160:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 830us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787574.000694:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 62 00000100:00100000:1.0:1787787574.005017:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787574.005093:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484860416 00000100:00100000:2.0:1787787574.005103:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484860416 00000100:00100000:2.0:1787787574.005197:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 63 00000100:00100000:2.0:1787787574.005208:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+41:18846:x1874630484860416:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787787574.005307:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aafaf lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787574.005330:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aafaf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787574.005343:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aafaf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787787574.005562:0:22715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:2.0:1787787574.005573:0:22715:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 718187434304ns, next at 719187431731ns, rc = 0 00000004:00010000:2.0:1787787574.005625:0:22715:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000092aca62e reply state 00000000489cdc96 transno 12884901918 ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aafaf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787574.005637:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aafaf lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787574.005644:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff986fc3a1d900) 00010000:00010000:2.0:1787787574.005647:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787787574.005650:0:22715:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787787574.005751:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+43:18846:x1874630484860416:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 Request processed in 544us (744us total) trans 12884901918 rc 0/0 00000100:00100000:2.0:1787787574.005758:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 63 00000100:00100000:0.0:1787787574.009773:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787574.009908:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484860544 00000100:00100000:3.0:1787787574.009919:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484860544 00000100:00100000:3.0:1787787574.009975:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 64 00000100:00100000:3.0:1787787574.009984:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a65d3225-1272-4ba4-9698-bcc15a4206b3+43:18846:x1874630484860544:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787787574.010009:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787574.010028:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1200/0x11620bc3f30aafb6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8873 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787574.010082:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1200/0x11620bc3f30aafb6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8873 expref: 44 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787574.010096:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1200/0x11620bc3f30aafb6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8873 expref: 44 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787574.010112:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff986fc3a1d900) 00010000:00010000:3.0:1787787574.010115:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787787574.010118:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc43e1200, rc 0) 00000100:00100000:3.0:1787787574.010279:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a65d3225-1272-4ba4-9698-bcc15a4206b3+44:18846:x1874630484860544:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 279us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787574.010287:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 64 00000100:00100000:3.0:1787787574.013721:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787574.013826:0:24939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484860672 00000100:00100000:2.0:1787787574.013836:0:24939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484860672 00000100:00100000:2.0:1787787574.013942:0:24939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 26 00000100:00100000:2.0:1787787574.013953:0:24939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+5:2392:x1874630484860672:12345-192.168.204.31@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787787574.014197:0:24939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+6:2392:x1874630484860672:12345-192.168.204.31@tcp:2:lhsmtool_posix.0 Request processed in 245us (486us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1787787574.014204:0:24939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 26 00000100:00080000:3.0:1787787574.017052:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787787574.017285:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787574.017550:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484860928 00000100:00100000:3.0:1787787574.017559:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484860928 00000100:00100000:3.0:1787787574.017648:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11 00000100:00100000:3.0:1787787574.017659:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+44:18846:x1874630484860928:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787787574.017879:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+45:18846:x1874630484860928:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 Request processed in 221us (598us total) trans 12884901919 rc 0/0 00000100:00100000:3.0:1787787574.017887:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11 00000100:00100000:0.0:1787787574.022596:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787574.022951:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484861184 00000100:00100000:2.0:1787787574.022962:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484861184 00000100:00100000:2.0:1787787574.023018:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 65 00000100:00100000:2.0:1787787574.023027:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+45:18846:x1874630484861184:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787787574.023190:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+45:18846:x1874630484861184:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 Request processed in 163us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787574.023204:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 65 00000100:00100000:0.0:1787787574.025979:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787574.026058:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484861312 00000100:00100000:3.0:1787787574.026067:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484861312 00000100:00100000:3.0:1787787574.026121:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 66 00000100:00100000:3.0:1787787574.026130:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a65d3225-1272-4ba4-9698-bcc15a4206b3+45:18846:x1874630484861312:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787787574.026180:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787574.026201:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0400/0x11620bc3f30aafbd lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c887a expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787574.026281:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0a00/0x11620bc3f30aafc4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787574.026297:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0a00/0x11620bc3f30aafc4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787574.026309:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0a00/0x11620bc3f30aafc4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787574.026650:0:22716:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787787574.026674:0:22716:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0a00/0x11620bc3f30aafc4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787574.026700:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0400/0x11620bc3f30aafbd lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c887a expref: 47 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787574.026719:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0a00/0x11620bc3f30aafc4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c887a expref: 46 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787574.026748:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff986fc3a1d900) 00010000:00010000:3.0:1787787574.026752:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787787574.026755:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff986fc43e0a00, rc 0) 00000100:00100000:3.0:1787787574.026819:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a65d3225-1272-4ba4-9698-bcc15a4206b3+46:18846:x1874630484861312:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 689us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787574.026826:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 66 00000100:00100000:1.0:1787787574.033768:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787574.035590:0:25288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484861440 00000100:00100000:0.0:1787787574.035608:0:25288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484861440 00000100:00100000:0.0:1787787574.035682:0:25288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 27 00000100:00100000:0.0:1787787574.035693:0:25288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a65d3225-1272-4ba4-9698-bcc15a4206b3+6:2392:x1874630484861440:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787787574.035728:0:25288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787574.035753:0:25288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa7a6457/0x11620bc3f30aafcb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8881 expref: -99 pid: 25288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787787574.035781:0:25288:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f7936, blocks: 0x0 00010000:00010000:0.0:1787787574.035803:0:25288:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=718s v=(0 0) 00010000:00010000:0.0:1787787574.035808:0:25288:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787787574.035818:0:25288:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa7a6457/0x11620bc3f30aafcb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8881 expref: 7 pid: 25288 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.035838:0:25288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fa7a6457/0x11620bc3f30aafcb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8881 expref: 7 pid: 25288 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.035852:0:25288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c15600, rc 0) 00000100:00100000:0.0:1787787574.035923:0:25288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a65d3225-1272-4ba4-9698-bcc15a4206b3+7:2392:x1874630484861440:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 232us (2165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787574.035930:0:25288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 27 00000100:00100000:0.0:1787787574.048056:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787574.048182:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484861696 00000100:00100000:2.0:1787787574.048191:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484861696 00000100:00100000:2.0:1787787574.048242:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 67 00000100:00100000:2.0:1787787574.048252:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+46:18846:x1874630484861696:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787787574.048400:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+46:18846:x1874630484861696:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 Request processed in 148us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787574.048408:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 67 00000100:00100000:3.0:1787787574.051555:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787574.051853:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484861824 00000100:00100000:2.0:1787787574.051863:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484861824 00000100:00100000:2.0:1787787574.051917:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 68 00000100:00100000:2.0:1787787574.051927:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc400da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+46:18846:x1874630484861824:12345-192.168.204.31@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787787574.055289:0:22694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901919 is committed 00000004:00080000:1.0:1787787574.055306:0:22694:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1787787574.055419:0:22694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:0.0:1787787574.055541:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aad71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055555:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aad71 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055563:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aad71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055570:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c7a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787574.055578:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aad71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055596:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aad71 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055613:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff986fc2a18a00) 00010000:00010000:0.0:1787787574.055616:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787574.055621:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aad71 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055628:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c7a00/0x11620bc3f30aad71 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055648:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6800/0x11620bc3f30aad78 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055655:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6800/0x11620bc3f30aad78 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055661:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6800/0x11620bc3f30aad78 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055666:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c6800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787574.055669:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6800/0x11620bc3f30aad78 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055675:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6800/0x11620bc3f30aad78 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055682:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff986fc2a18e00) 00010000:00010000:0.0:1787787574.055685:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787574.055695:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6800/0x11620bc3f30aad78 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055701:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6800/0x11620bc3f30aad78 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055716:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30aae3c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055722:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30aae3c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055728:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30aae3c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055734:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787574.055737:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30aae3c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055742:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30aae3c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055750:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff986fc3a1df00) 00010000:00010000:0.0:1787787574.055753:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787574.055756:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30aae3c lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055761:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030e00/0x11620bc3f30aae3c lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055776:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aaec1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055792:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aaec1 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055797:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aaec1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055803:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc4296a00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787574.055806:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aaec1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055812:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aaec1 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055822:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:0.0:1787787574.055824:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787574.055827:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aaec1 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055834:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296a00/0x11620bc3f30aaec1 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055847:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296600/0x11620bc3f30aaee4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055853:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296600/0x11620bc3f30aaee4 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055859:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296600/0x11620bc3f30aaee4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055864:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc4296600 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787574.055877:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296600/0x11620bc3f30aaee4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055883:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296600/0x11620bc3f30aaee4 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055891:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:0.0:1787787574.055894:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787574.055896:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296600/0x11620bc3f30aaee4 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055903:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296600/0x11620bc3f30aaee4 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055914:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14400/0x11620bc3f30aaf2a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055920:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14400/0x11620bc3f30aaf2a lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055925:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14400/0x11620bc3f30aaf2a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055930:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c14400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787574.055932:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14400/0x11620bc3f30aaf2a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055938:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14400/0x11620bc3f30aaf2a lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055945:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:0.0:1787787574.055948:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787787574.055958:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14400/0x11620bc3f30aaf2a lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055964:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14400/0x11620bc3f30aaf2a lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055978:0:3639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aafaf lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055984:0:3639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aafaf lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055990:0:3639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aafaf lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.055995:0:3639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0030800 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:0.0:1787787574.055998:0:3639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aafaf lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.056004:0:3639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aafaf lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.056012:0:3639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff986fc3a1d900) 00010000:00010000:0.0:1787787574.056014:0:3639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787787574.056017:0:3639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aafaf lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.056022:0:3639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0030800/0x11620bc3f30aafaf lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787574.056378:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787787574.056394:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503835776:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787787574.056454:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787787574.056597:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc400da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+14:18846:x1874630484861824:12345-192.168.204.31@tcp:44:lhsmtool_posix.0 Request processed in 4659us (5041us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787574.056607:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 68 00000100:00100000:2.0:1787787574.056652:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503835776 00000100:00100000:2.0:1787787574.056659:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503835776 00000100:00100000:2.0:1787787574.056718:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787787574.056726:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503835776:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787787574.056846:0:24220:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787787574.056850:0:24220:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1787787574.056852:0:24220:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787787574.056861:0:24220:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1787787574 -> 1787787574 00002000:00010000:2.0:1787787574.056863:0:24220:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787787574.056898:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3653:x1874630503835776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 172us (442us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1787787574.056904:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1787787574.056922:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1787787574.056953:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff986fc36ecb40/2, rc 0, transno 12884901892 00000100:00100000:2.0:1787787574.056959:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503835776:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787787574.060963:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787574.061075:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484861952 00000100:00100000:0.0:1787787574.061085:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484861952 00000100:00100000:0.0:1787787574.061177:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 29 00000100:00100000:0.0:1787787574.061200:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a65d3225-1272-4ba4-9698-bcc15a4206b3+7:2391:x1874630484861952:12345-192.168.204.31@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787787574.061307:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a65d3225-1272-4ba4-9698-bcc15a4206b3+7:2391:x1874630484861952:12345-192.168.204.31@tcp:16:lhsmtool_posix.0 Request processed in 109us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787574.061323:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 29 00000100:00100000:0.0:1787787574.065171:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787574.065241:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484862208 00000100:00100000:1.0:1787787574.065250:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484862208 00000100:00100000:1.0:1787787574.065313:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 69 00000100:00100000:1.0:1787787574.065328:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+14:18846:x1874630484862208:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787787574.065392:0:22715:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787574.065419:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e0a00/0x11620bc3f30aafc4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c887a expref: 14 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.065438:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff986fc3a1d900) 00010000:00010000:1.0:1787787574.065456:0:22715:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787787574.065649:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297600/0x11620bc3f30aafd2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.065663:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297600/0x11620bc3f30aafd2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.065673:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297600/0x11620bc3f30aafd2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787787574.065791:0:22715:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000912b5a26 reply state 0000000070414997 transno 12884901920 ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297600/0x11620bc3f30aafd2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.065803:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297600/0x11620bc3f30aafd2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.065810:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff986fc3a1d900) 00010000:00010000:1.0:1787787574.065813:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787787574.065815:0:22715:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787787574.065978:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+15:18846:x1874630484862208:12345-192.168.204.31@tcp:36:lhsmtool_posix.0 Request processed in 650us (851us total) trans 12884901920 rc 0/0 00000100:00100000:1.0:1787787574.065986:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 69 00010000:00010000:2.0:1787787574.066911:0:3640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aade1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787574.066924:0:3640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aade1 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787574.066931:0:3640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aade1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787574.066938:0:3640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9871021c6400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:2.0:1787787574.066942:0:3640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aade1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787574.066949:0:3640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aade1 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787574.066962:0:3640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff986fc2a18e00) 00010000:00010000:2.0:1787787574.066965:0:3640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1787787574.066968:0:3640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aade1 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787574.066973:0:3640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9871021c6400/0x11620bc3f30aade1 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787574.074595:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787574.074735:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484862336 00000100:00100000:2.0:1787787574.074745:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484862336 00000100:00100000:2.0:1787787574.074810:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 30 00000100:00100000:2.0:1787787574.074820:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+7:18846:x1874630484862336:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787787574.074838:0:24219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787574.074855:0:24219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037b4f96d/0x11620bc3f30aafd9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8888 expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787574.074889:0:24219:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa7a6457/0x11620bc3f30aafcb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8881 expref: 8 pid: 25288 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787574.074898:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787574.074902:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787574.074907:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037b4f96d/0x11620bc3f30aafd9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8888 expref: 8 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787574.074941:0:24219:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fa7a6457/0x11620bc3f30aafcb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8881 expref: 8 pid: 25288 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787574.074956:0:24219:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fa7a6457/0x11620bc3f30aafcb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8881 expref: 8 pid: 25288 timeout: 818 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787574.074971:0:24219:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc36efc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:24219:1874630503835904:192.168.204.31@tcp:104: 00000100:00100000:2.0:1787787574.075063:0:24219:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d84d7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787787574.078938:0:24219:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc36efc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:24219:1874630503835904:192.168.204.31@tcp:104: 00010000:00010000:2.0:1787787574.078979:0:24219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000037b4f96d/0x11620bc3f30aafd9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8888 expref: 8 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787574.079003:0:24219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030600, rc 0) 00000100:00100000:2.0:1787787574.079070:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+8:18846:x1874630484862336:12345-192.168.204.31@tcp:101:lhsmtool_posix.0 Request processed in 4250us (4486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787574.079079:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 30 00000100:00100000:0.0:1787787574.079824:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787574.079900:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484862464 00000100:00100000:3.0:1787787574.079909:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484862464 00010000:00010000:3.0:1787787574.079955:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fa7a6457/0x11620bc3f30aafcb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8881 expref: 8 pid: 25288 timeout: 818 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787574.080002:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 20 00000100:00100000:3.0:1787787574.080013:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+8:2391:x1874630484862464:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787787574.080029:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787787574.080053:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fa7a6457/0x11620bc3f30aafcb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8881 expref: 8 pid: 25288 timeout: 818 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787574.080069:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fa7a6457/0x11620bc3f30aafcb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8881 expref: 8 pid: 25288 timeout: 818 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787574.080097:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa7a6457/0x11620bc3f30aafcb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8881 expref: 8 pid: 25288 timeout: 818 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787574.080214:0:22699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787574.080219:0:22699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787787574.080228:0:22699:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000037b4f96d/0x11620bc3f30aafd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8888 expref: 7 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787574.080239:0:22699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037b4f96d/0x11620bc3f30aafd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8888 expref: 7 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787574.080293:0:22699:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000037b4f96d/0x11620bc3f30aafd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8888 expref: 7 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787574.080308:0:22699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fa580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:22699:1874630503836032:192.168.204.31@tcp:105: 00000100:00100000:3.0:1787787574.081017:0:22699:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c8caccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787574.086962:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787574.087423:0:24939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484862592 00000100:00100000:2.0:1787787574.087434:0:24939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484862592 00000100:00100000:2.0:1787787574.087609:0:24939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 31 00000100:00100000:2.0:1787787574.087620:0:24939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+8:2391:x1874630484862592:12345-192.168.204.31@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787787574.087772:0:24939:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787787574.087776:0:24939:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1787787573 00002000:00010000:2.0:1787787574.087779:0:24939:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1787787571 00002000:00010000:2.0:1787787574.087781:0:24939:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1787787574 -> 1787787573 00002000:00010000:2.0:1787787574.087784:0:24939:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787787574.088015:0:22699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fa580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:22699:1874630503836032:192.168.204.31@tcp:105: 00010000:00010000:3.0:1787787574.088041:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787787574.088256:0:24939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+9:2391:x1874630484862592:12345-192.168.204.31@tcp:2:lhsmtool_posix.0 Request processed in 637us (1303us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1787787574.088277:0:24939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 31 00000100:00100000:3.0:1787787574.088778:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+8:2391:x1874630484862464:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 8765us (8956us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787574.088787:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 20 00000100:00100000:2.0:1787787574.092086:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787574.092461:0:25288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484862720 00000100:00100000:1.0:1787787574.092543:0:25288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484862720 00000100:00100000:1.0:1787787574.092677:0:25288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 32 00000100:00100000:1.0:1787787574.092689:0:25288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc36efc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a65d3225-1272-4ba4-9698-bcc15a4206b3+8:2391:x1874630484862720:12345-192.168.204.31@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787787574.092739:0:25288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000069be4232/0x11620bc3f30aafe0 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.092762:0:25288:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000037b4f96d/0x11620bc3f30aafd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8888 expref: 8 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.092785:0:25288:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787787574.092790:0:25288:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787787574.092794:0:25288:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069be4232/0x11620bc3f30aafe0 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.092831:0:25288:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000037b4f96d/0x11620bc3f30aafd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8888 expref: 8 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.092847:0:25288:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000037b4f96d/0x11620bc3f30aafd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8888 expref: 8 pid: 24219 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787574.092862:0:25288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f3840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25288:1874630503836160:192.168.204.31@tcp:104: 00000100:00100000:1.0:1787787574.092992:0:25288:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d14a23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787574.097557:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787574.097652:0:25288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f3840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25288:1874630503836160:192.168.204.31@tcp:104: 00010000:00010000:1.0:1787787574.097681:0:25288:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000069be4232/0x11620bc3f30aafe0 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787574.097990:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484862848 00000100:00100000:2.0:1787787574.097998:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484862848 00010000:00010000:2.0:1787787574.098036:0:22701:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000037b4f96d/0x11620bc3f30aafd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8888 expref: 9 pid: 24219 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787574.098178:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 21 00000100:00100000:2.0:1787787574.098188:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65d3225-1272-4ba4-9698-bcc15a4206b3+9:2392:x1874630484862848:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787787574.098205:0:22701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787787574.098225:0:22701:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000037b4f96d/0x11620bc3f30aafd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8888 expref: 9 pid: 24219 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787574.098239:0:22701:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000037b4f96d/0x11620bc3f30aafd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8888 expref: 9 pid: 24219 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787574.098279:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037b4f96d/0x11620bc3f30aafd9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8888 expref: 9 pid: 24219 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787574.098306:0:22701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787787574.098311:0:22701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787787574.098317:0:22701:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069be4232/0x11620bc3f30aafe0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787574.098326:0:22701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069be4232/0x11620bc3f30aafe0 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787574.098348:0:22701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787787574.098401:0:25288:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000069be4232/0x11620bc3f30aafe0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787574.098409:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a65d3225-1272-4ba4-9698-bcc15a4206b3+8:2392:x1874630484862848:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 222us (862us total) trans 0 rc 0/0 00010000:00010000:1.0:1787787574.098411:0:25288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069be4232/0x11620bc3f30aafe0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787574.098416:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 21 00010000:00010000:1.0:1787787574.098430:0:25288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000069be4232/0x11620bc3f30aafe0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.098445:0:25288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069be4232/0x11620bc3f30aafe0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.098453:0:25288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069be4232/0x11620bc3f30aafe0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.098461:0:25288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc4297a00 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:1.0:1787787574.098465:0:25288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069be4232/0x11620bc3f30aafe0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.098485:0:25288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069be4232/0x11620bc3f30aafe0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.098497:0:25288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069be4232/0x11620bc3f30aafe0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.098504:0:25288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069be4232/0x11620bc3f30aafe0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787574.098552:0:25288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc36efc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a65d3225-1272-4ba4-9698-bcc15a4206b3+7:2391:x1874630484862720:12345-192.168.204.31@tcp:1:lhsmtool_posix.0 Request processed in 5865us (6477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787574.098559:0:25288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 32 00000100:00100000:2.0:1787787574.105944:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787574.106027:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484863104 00000100:00100000:3.0:1787787574.106036:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484863104 00000100:00100000:3.0:1787787574.106096:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 70 00000100:00100000:3.0:1787787574.106106:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a65d3225-1272-4ba4-9698-bcc15a4206b3+15:18846:x1874630484863104:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787787574.106215:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6910e00/0x11620bc3f30aafe7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787574.106245:0:22716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14a00/0x11620bc3f30aaeba lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8826 expref: 15 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787574.106255:0:22716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6910e00/0x11620bc3f30aafe7 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787574.106301:0:22716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14a00/0x11620bc3f30aaeba lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8826 expref: 15 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787574.106326:0:22716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14a00/0x11620bc3f30aaeba lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8826 expref: 15 pid: 22714 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787787574.106341:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43fa580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22716:1874630503836288:192.168.204.31@tcp:104: 00000100:00100000:3.0:1787787574.106421:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c8cacf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787787574.118553:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787574.118755:0:23473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484863232 00000100:00100000:1.0:1787787574.118765:0:23473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484863232 00010000:00010000:1.0:1787787574.118811:0:23473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14a00/0x11620bc3f30aaeba lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8826 expref: 16 pid: 22714 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787574.118857:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43fa580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22716:1874630503836288:192.168.204.31@tcp:104: 00000100:00100000:1.0:1787787574.118870:0:23473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 22 00000100:00100000:1.0:1787787574.118878:0:23473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+16:2391:x1874630484863232:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787574.118882:0:22716:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6910e00/0x11620bc3f30aafe7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.118894:0:23473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787787574.118901:0:23473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14a00/0x11620bc3f30aaeba lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8826 expref: 16 pid: 22714 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.118913:0:23473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14a00/0x11620bc3f30aaeba lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8826 expref: 16 pid: 22714 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.118936:0:23473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14a00/0x11620bc3f30aaeba lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8826 expref: 16 pid: 22714 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.118953:0:23473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:1.0:1787787574.118959:0:23473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30aaf4d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8857 expref: 15 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.118969:0:23473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6910e00/0x11620bc3f30aafe7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.118976:0:23473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6910e00/0x11620bc3f30aafe7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.118984:0:23473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6910e00/0x11620bc3f30aafe7 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.119011:0:23473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787787574.119056:0:23473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+15:2391:x1874630484863232:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 178us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787574.119069:0:23473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 22 00010000:00010000:0.0:1787787574.119092:0:22716:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6910e00/0x11620bc3f30aafe7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.119099:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6910e00/0x11620bc3f30aafe7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.119412:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15400/0x11620bc3f30aafee lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.119425:0:22716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1200/0x11620bc3f30aafb6 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8873 expref: 15 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.119433:0:22716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15400/0x11620bc3f30aafee lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.119463:0:22716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1200/0x11620bc3f30aafb6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8873 expref: 15 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.119484:0:22716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1200/0x11620bc3f30aafb6 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8873 expref: 15 pid: 22716 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787574.119497:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22716:1874630503836416:192.168.204.31@tcp:104: 00000100:00100000:0.0:1787787574.119554:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c5392cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787787574.132010:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22716:1874630503836416:192.168.204.31@tcp:104: 00010000:00010000:0.0:1787787574.132040:0:22716:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15400/0x11620bc3f30aafee lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787787574.136887:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787574.136948:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484863360 00000100:00100000:0.0:1787787574.136958:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484863360 00010000:00010000:0.0:1787787574.137007:0:22700:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1200/0x11620bc3f30aafb6 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8873 expref: 16 pid: 22716 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787574.137053:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 23 00000100:00100000:0.0:1787787574.137063:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d13f5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+16:2392:x1874630484863360:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787787574.137079:0:22700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787787574.137087:0:22700:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1200/0x11620bc3f30aafb6 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8873 expref: 16 pid: 22716 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.137099:0:22700:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1200/0x11620bc3f30aafb6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8873 expref: 16 pid: 22716 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.137122:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc43e1200/0x11620bc3f30aafb6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8873 expref: 16 pid: 22716 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.137174:0:22700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff986fc3a1d900) 00010000:00010000:0.0:1787787574.137180:0:22700:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15400/0x11620bc3f30aafee lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.137189:0:22700:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15400/0x11620bc3f30aafee lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.137197:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15400/0x11620bc3f30aafee lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.137224:0:22700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787787574.137279:0:22716:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15400/0x11620bc3f30aafee lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787574.137288:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15400/0x11620bc3f30aafee lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787787574.137300:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d13f5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+15:2392:x1874630484863360:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 238us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787574.137308:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 23 00000001:00080000:3.0:1787787574.137584:0:22716:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:3.0:1787787574.137754:0:22716:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000001:00080000:3.0:1787787574.137789:0:22716:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:3.0:1787787574.137863:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc418c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22716:1874630503836544:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787787574.137905:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787574.138463:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c8cacf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787787574.140297:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503836544 00000100:00100000:1.0:1787787574.140313:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503836544 00000100:00100000:1.0:1787787574.140416:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787787574.140427:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22716:x1874630503836544:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787787574.140678:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22716:x1874630503836544:12345-0@lo:1000:mdt00_002.0 Request processed in 158us (2676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787574.140688:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787787574.140765:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc418c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22716:1874630503836544:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787787574.140977:0:22716:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901924 00000100:00100000:0.0:1787787574.141054:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc489a580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22716:1874630503836672:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787787574.141094:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787574.141131:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870c8cacb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787787574.141520:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503836672 00000100:00100000:3.0:1787787574.141532:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503836672 00000100:00100000:3.0:1787787574.141570:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787787574.141578:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc489a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22716:x1874630503836672:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787787574.141704:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc489a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22716:x1874630503836672:12345-0@lo:1000:mdt00_002.0 Request processed in 127us (609us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1787787574.141711:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787787574.142504:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc489a580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22716:1874630503836672:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787787574.142548:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15400/0x11620bc3f30aafee lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.142559:0:22716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15400/0x11620bc3f30aafee lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.142566:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15400/0x11620bc3f30aafee lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.142573:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c7c15400 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787574.142577:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15400/0x11620bc3f30aafee lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.142584:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15400/0x11620bc3f30aafee lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.142601:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff986fc3a1d900) 00010000:00010000:1.0:1787787574.142604:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787787574.142618:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15400/0x11620bc3f30aafee lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.142640:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15400/0x11620bc3f30aafee lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.142838:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aaf46 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.142845:0:22716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aaf46 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.142851:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aaf46 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.142856:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870c0031c00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787574.142858:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aaf46 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.142864:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aaf46 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.142874:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:1.0:1787787574.142876:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787787574.142884:0:22716:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30aaf4d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8857 expref: 18 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.142896:0:22716:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30aaf4d lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8857 expref: 18 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.142905:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30aaf4d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8857 expref: 18 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.142977:0:22716:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031200/0x11620bc3f30aaf4d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8857 expref: 18 pid: 22715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787574.142990:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f3840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22716:1874630503836800:192.168.204.31@tcp:105: 00000100:00100000:1.0:1787787574.143066:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff9870d14a2180 going to sleep for 11 seconds 00000100:00100000:2.0:1787787574.152699:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787574.153246:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484863488 00000100:00100000:3.0:1787787574.153258:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484863488 00000100:00100000:3.0:1787787574.153341:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 12 00000100:00100000:3.0:1787787574.153351:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+19:18845:x1874630484863488:12345-192.168.204.31@tcp:49:bash.0 00000100:00100000:3.0:1787787574.153494:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+19:18845:x1874630484863488:12345-192.168.204.31@tcp:49:bash.0 Request processed in 143us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787574.153501:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 12 00000100:00100000:1.0:1787787574.153791:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f3840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22716:1874630503836800:192.168.204.31@tcp:105: 00010000:00010000:1.0:1787787574.153818:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aaf46 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.153830:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c0031c00/0x11620bc3f30aaf46 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.153865:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aaff5 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.153880:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aaff5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.153891:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aaff5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.153900:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aaff5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.153907:0:22716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aaff5 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.153914:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aaff5 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.153940:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc4297200 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787574.153945:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aaff5 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.153953:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aaff5 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.153966:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:1.0:1787787574.153969:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787574.153973:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aaff5 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.153979:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297200/0x11620bc3f30aaff5 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.153989:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6910e00/0x11620bc3f30aafe7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.153996:0:22716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6910e00/0x11620bc3f30aafe7 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.154002:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6910e00/0x11620bc3f30aafe7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.154007:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6910e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787574.154011:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6910e00/0x11620bc3f30aafe7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.154017:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6910e00/0x11620bc3f30aafe7 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.154037:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:1.0:1787787574.154040:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787787574.154044:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6910e00/0x11620bc3f30aafe7 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.154050:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6910e00/0x11620bc3f30aafe7 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787574.154213:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a65d3225-1272-4ba4-9698-bcc15a4206b3+18:18846:x1874630484863104:12345-192.168.204.31@tcp:57:lhsmtool_posix.0 Request processed in 48108us (48279us total) trans 12884901925 rc 0/0 00000100:00100000:1.0:1787787574.154221:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 70 00000020:00080000:1.0:1787787574.154225:0:22716:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787787574.155096:0:22750:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787787574.155103:0:22750:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787787574.155120:0:22750:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1787787574.155125:0:22750:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1787787574.161031:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787574.161976:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484863616 00000100:00100000:2.0:1787787574.161989:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484863616 00000100:00100000:2.0:1787787574.162059:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 33 00000100:00100000:2.0:1787787574.162070:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+7:18845:x1874630484863616:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:2.0:1787787574.162090:0:24219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787787574.162113:0:24219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009458d7b7/0x11620bc3f30aaffc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c888f expref: -99 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787787574.162195:0:24219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a8f7935, atime: 0x6a8f7933, ctime: 0x6a8f7935, blocks: 0x0 00010000:00010000:2.0:1787787574.162219:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=718s v=(0 0) 00010000:00010000:2.0:1787787574.162224:0:24219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787787574.162234:0:24219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009458d7b7/0x11620bc3f30aaffc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c888f expref: 8 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787574.162251:0:24219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009458d7b7/0x11620bc3f30aaffc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c888f expref: 8 pid: 24219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787574.162276:0:24219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c0030a00, rc 0) 00000100:00100000:2.0:1787787574.162359:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+8:18845:x1874630484863616:12345-192.168.204.31@tcp:101:bash.0 Request processed in 290us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787574.162377:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 33 00000100:00100000:2.0:1787787574.180783:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787574.180831:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787574.181062:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484864000 00000100:00100000:0.0:1787787574.181072:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484864000 00000100:00100000:0.0:1787787574.181132:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 71 00000100:00100000:0.0:1787787574.181158:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+18:18845:x1874630484864000:12345-192.168.204.31@tcp:101:bash.0 00010000:00010000:0.0:1787787574.181184:0:25511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787787574.181204:0:25511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14e00/0x11620bc3f30ab003 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c8896 expref: -99 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.181273:0:25511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30ab00a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.181287:0:25511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30ab00a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.181299:0:25511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30ab00a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.181601:0:25511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c14e00/0x11620bc3f30ab003 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8896 expref: 20 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.181621:0:25511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870c7c15200/0x11620bc3f30ab00a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c8896 expref: 19 pid: 25511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787787574.181630:0:25511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:0.0:1787787574.181633:0:25511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787787574.181636:0:25511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870c7c15200, rc 0) 00000100:00100000:0.0:1787787574.181714:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+19:18845:x1874630484864000:12345-192.168.204.31@tcp:101:bash.0 Request processed in 574us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787574.181722:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 71 00000100:00100000:3.0:1787787574.182961:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484863872 00000100:00100000:3.0:1787787574.182970:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484863872 00000100:00100000:3.0:1787787574.183106:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13 00000100:00100000:3.0:1787787574.183117:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff987101f7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+19:18846:x1874630484863872:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787787574.183422:0:22718:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787787574.183452:0:22718:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901926 00010000:00010000:3.0:1787787574.183490:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6911200/0x11620bc3f30ab011 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787574.183519:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6911200/0x11620bc3f30ab011 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787574.183529:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6911200/0x11620bc3f30ab011 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787574.183538:0:22718:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6911200/0x11620bc3f30ab011 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787574.183545:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6911200/0x11620bc3f30ab011 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787574.183552:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6911200/0x11620bc3f30ab011 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787574.183571:0:22718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787787574.183643:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff987101f7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+21:18846:x1874630484863872:12345-192.168.204.31@tcp:35:lhsmtool_posix.0 Request processed in 528us (2870us total) trans 12884901927 rc 0/0 00000100:00100000:3.0:1787787574.183650:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13 00000020:00080000:3.0:1787787574.183654:0:22718:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787787574.185381:0:24527:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787787574.185404:0:24527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6911200/0x11620bc3f30ab011 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787574.185416:0:24527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9870f6911200 already unused, calling callback (ffffffffc0dd7420) 00010000:00010000:2.0:1787787574.185421:0:24527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6911200/0x11620bc3f30ab011 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787574.185430:0:24527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6911200/0x11620bc3f30ab011 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787574.185447:0:24527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff986fc3a1d900) 00010000:00010000:2.0:1787787574.185450:0:24527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787787574.185455:0:24527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6911200/0x11620bc3f30ab011 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787574.185462:0:24527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6911200/0x11620bc3f30ab011 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787787574.185488:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787574.185490:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787787574.185492:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787787574.191684:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787574.191815:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484864256 00000100:00100000:0.0:1787787574.191825:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484864256 00000100:00100000:0.0:1787787574.191887:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14 00000100:00100000:0.0:1787787574.191898:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed925e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+21:18845:x1874630484864256:12345-192.168.204.31@tcp:35:bash.0 00000001:00080000:0.0:1787787574.192120:0:22717:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000001:00080000:0.0:1787787574.192253:0:22717:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901929 00000100:00100000:0.0:1787787574.192394:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed925e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+24:18845:x1874630484864256:12345-192.168.204.31@tcp:35:bash.0 Request processed in 497us (721us total) trans 12884901930 rc 0/0 00000100:00100000:0.0:1787787574.192403:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14 00000020:00080000:0.0:1787787574.192408:0:22717:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787787574.277622:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1787787574.282066:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484864512 00000100:00100000:2.0:1787787574.282084:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484864512 00000100:00100000:3.0:1787787574.287609:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 72 00000100:00100000:3.0:1787787574.287624:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+24:18856:x1874630484864512:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1787787574.287652:0:22714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787787574.287743:0:22714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6910c00/0x11620bc3f30ab018 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b5cb731f32c889d expref: -99 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787787574.287844:0:22714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787787574.287949:0:22714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6910c00/0x11620bc3f30ab018 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c889d expref: 26 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787574.287983:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff986fc3a1d600) 00010000:00010000:3.0:1787787574.287986:0:22714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787787574.287992:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9870f6910c00/0x11620bc3f30ab018 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x7b5cb731f32c889d expref: 26 pid: 22714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787787574.288007:0:22714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9870f6910c00, rc 0) 00000100:00100000:3.0:1787787574.288200:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+25:18856:x1874630484864512:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 577us (10587us total) trans 12884901931 rc 301/301 00000100:00100000:3.0:1787787574.288209:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 72 00000100:00100000:2.0:1787787574.294075:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1787787574.294578:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484864640 00000100:00100000:1.0:1787787574.294589:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484864640 00000100:00100000:1.0:1787787574.296539:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 73 00000100:00100000:1.0:1787787574.296559:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed927c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+25:18856:x1874630484864640:12345-192.168.204.31@tcp:34:lfs.0 00010000:00010000:1.0:1787787574.296642:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296000/0x11620bc3f30ab026 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.297654:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296000/0x11620bc3f30ab026 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.297727:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296000/0x11620bc3f30ab026 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.297748:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296e00/0x11620bc3f30ab02d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.297773:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296e00/0x11620bc3f30ab02d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.297780:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296e00/0x11620bc3f30ab02d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.297857:0:22715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297e00/0x11620bc3f30ab034 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.297866:0:22715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297e00/0x11620bc3f30ab034 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.297872:0:22715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297e00/0x11620bc3f30ab034 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787787574.297920:0:22715:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297e00/0x11620bc3f30ab034 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.297932:0:22715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296000/0x11620bc3f30ab026 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.297939:0:22715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296000/0x11620bc3f30ab026 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.297945:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296000/0x11620bc3f30ab026 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.297951:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc4296000 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787574.297955:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296000/0x11620bc3f30ab026 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.297962:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296000/0x11620bc3f30ab026 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.297983:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff986fc2a18e00) 00010000:00010000:1.0:1787787574.297985:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787574.297990:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296000/0x11620bc3f30ab026 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.297996:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296000/0x11620bc3f30ab026 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.298009:0:22715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296e00/0x11620bc3f30ab02d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.298015:0:22715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296e00/0x11620bc3f30ab02d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.298019:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296e00/0x11620bc3f30ab02d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.298024:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc4296e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787574.298026:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296e00/0x11620bc3f30ab02d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.298031:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296e00/0x11620bc3f30ab02d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.298037:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9870d0b3a900) 00010000:00010000:1.0:1787787574.298039:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787574.298041:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296e00/0x11620bc3f30ab02d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.298046:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4296e00/0x11620bc3f30ab02d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.298069:0:22715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297e00/0x11620bc3f30ab034 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.298074:0:22715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297e00/0x11620bc3f30ab034 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.298079:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297e00/0x11620bc3f30ab034 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.298083:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff986fc4297e00 already unused, calling callback (ffffffffc19ea4f0) 00010000:00010000:1.0:1787787574.298086:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297e00/0x11620bc3f30ab034 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.298092:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297e00/0x11620bc3f30ab034 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.298100:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff986fc3a1de00) 00010000:00010000:1.0:1787787574.298103:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787787574.298106:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297e00/0x11620bc3f30ab034 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787787574.298111:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff986fc4297e00/0x11620bc3f30ab034 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22715 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787787574.298256:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed927c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a65d3225-1272-4ba4-9698-bcc15a4206b3+25:18856:x1874630484864640:12345-192.168.204.31@tcp:34:lfs.0 Request processed in 1702us (4190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787574.298277:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 73 00000100:00100000:2.0:1787787574.302511:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787574.302721:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484864896 00000100:00100000:0.0:1787787574.302732:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484864896 00000100:00100000:0.0:1787787574.302835:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15 00000100:00100000:0.0:1787787574.302846:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870ed927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+25:18856:x1874630484864896:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:0.0:1787787574.303103:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870ed927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+26:18856:x1874630484864896:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 259us (602us total) trans 12884901932 rc 0/0 00000100:00100000:0.0:1787787574.303112:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15 00000040:00080000:1.0:1787787574.506498:0:23468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787787574.697385:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787787575.661309:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503837056:0@lo:400:kworker.0 00000100:00100000:1.0:1787787575.661379:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787575.661433:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503837568:0@lo:400:kworker.0 00000100:00100000:1.0:1787787575.661459:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787575.661475:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503838080:0@lo:400:kworker.0 00000100:00100000:1.0:1787787575.661499:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787575.661523:0:3656:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1787787575.661529:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3fd2c107-7647-408e-8048-4ef16ee44cbc:3656:1874630503836928:0@lo:400:kworker.0 00000100:00100000:1.0:1787787575.661555:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787575.661578:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e61680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503837440:0@lo:400:kworker.0 00000100:00100000:1.0:1787787575.661598:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787575.661615:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874630503837952:0@lo:400:kworker.0 00000100:00100000:3.0:1787787575.661823:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503837056 00000100:00100000:3.0:1787787575.661831:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503837056 00000100:00100000:3.0:1787787575.661870:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503837568 00000100:00100000:3.0:1787787575.661872:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503837568 00000100:00100000:3.0:1787787575.661886:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787787575.661892:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503837056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787575.661940:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3656:x1874630503837056:12345-0@lo:400:kworker.0 Request processed in 48us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787575.661947:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787787575.661962:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787787575.661967:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503837568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787575.661987:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3656:x1874630503837568:12345-0@lo:400:kworker.0 Request processed in 20us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787575.661992:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787787575.662005:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503838080 00000100:00100000:3.0:1787787575.662008:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503838080 00000100:00100000:3.0:1787787575.662043:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503837440 00000100:00100000:3.0:1787787575.662045:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503837440 00000100:00100000:3.0:1787787575.662059:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787787575.662064:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503838080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787575.662090:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1874630503838080:12345-0@lo:400:kworker.0 Request processed in 26us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787575.662096:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787787575.662104:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787787575.662110:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503837440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787575.662133:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1874630503837440:12345-0@lo:400:kworker.0 Request processed in 23us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787575.662160:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1787787575.662189:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787787575.662228:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc43f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503837184:0@lo:400:kworker.0 00000100:00100000:3.0:1787787575.662269:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787575.662394:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503837696:0@lo:400:kworker.0 00000100:00100000:3.0:1787787575.662417:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787575.662434:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503838208:0@lo:400:kworker.0 00000100:00100000:3.0:1787787575.662454:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787575.662472:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787787575.662478:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870fc3f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503837312:0@lo:400:kworker.0 00000100:00100000:3.0:1787787575.662517:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787575.662538:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e62580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503837824:0@lo:400:kworker.0 00000100:00100000:3.0:1787787575.662559:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787787575.662577:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874630503838336:0@lo:400:kworker.0 00000100:00100000:3.0:1787787575.662611:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787575.662713:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787575.662734:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d4e62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874630503838464:0@lo:400:kworker.0 00000100:00100000:1.0:1787787575.662758:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787575.662785:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503837056:0@lo:400:kworker.0 00000100:00100000:1.0:1787787575.662795:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3656:1874630503837568:0@lo:400:kworker.0 00000100:00100000:1.0:1787787575.662804:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3656:1874630503838080:0@lo:400:kworker.0 00000100:00100000:1.0:1787787575.662830:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e61680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3656:1874630503837440:0@lo:400:kworker.0 00000100:00100000:1.0:1787787575.662850:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503838208 00000100:00100000:1.0:1787787575.662854:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503838208 00000100:00100000:1.0:1787787575.662880:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503838336 00000100:00100000:1.0:1787787575.662883:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503838336 00000100:00100000:1.0:1787787575.662898:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503837952 00000100:00100000:1.0:1787787575.662900:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503837952 00000100:00100000:1.0:1787787575.662912:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503838464 00000100:00100000:1.0:1787787575.662915:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503838464 00000100:00100000:1.0:1787787575.662941:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787787575.662947:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503838208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787575.662981:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874630503838208:12345-0@lo:400:kworker.0 Request processed in 34us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787575.662987:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787787575.663001:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787787575.663007:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874630503838336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787575.663034:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1874630503838336:12345-0@lo:400:kworker.0 Request processed in 28us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787575.663040:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787787575.663053:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787787575.663059:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d4e61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874630503837952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787575.663090:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d4e61a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1874630503837952:12345-0@lo:400:kworker.0 Request processed in 31us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787575.663096:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787787575.663107:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787787575.663113:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d9647840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874630503838464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787787575.663156:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d9647840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3656:x1874630503838464:12345-0@lo:400:kworker.0 Request processed in 26us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787575.663161:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787787575.663730:0:24939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503837184 00000100:00100000:3.0:1787787575.663736:0:24939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503837184 00000100:00100000:3.0:1787787575.663768:0:24939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503837696 00000100:00100000:3.0:1787787575.663771:0:24939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503837696 00000100:00100000:3.0:1787787575.663783:0:24939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503837312 00000100:00100000:3.0:1787787575.663785:0:24939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503837312 00000100:00100000:3.0:1787787575.663794:0:24939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503837824 00000100:00100000:3.0:1787787575.663797:0:24939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503837824 00000100:00100000:3.0:1787787575.663810:0:24939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787787575.663816:0:24939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503837184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787575.663854:0:24939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1874630503837184:12345-0@lo:400:kworker.0 Request processed in 38us (1584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787575.663860:0:24939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787787575.663872:0:24939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787787575.663877:0:24939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503837696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787575.663903:0:24939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503837696:12345-0@lo:400:kworker.0 Request processed in 26us (1485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787575.663909:0:24939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787787575.663920:0:24939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787787575.663926:0:24939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc418c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3653:x1874630503837312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787575.663952:0:24939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc418c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3653:x1874630503837312:12345-0@lo:400:kworker.0 Request processed in 27us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787575.663957:0:24939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787787575.663968:0:24939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787787575.663973:0:24939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503837824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787787575.663998:0:24939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1874630503837824:12345-0@lo:400:kworker.0 Request processed in 25us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787575.664012:0:24939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1787787575.664038:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787787575.664041:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787787575.664043:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787787575.664045:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787787575.664069:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870fc3f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503837312:0@lo:400:kworker.0 00000100:00100000:3.0:1787787575.664079:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e62580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503837824:0@lo:400:kworker.0 00000100:00100000:3.0:1787787575.664087:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3653:1874630503838336:0@lo:400:kworker.0 00000100:00100000:3.0:1787787575.664095:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3653:1874630503837184:0@lo:400:kworker.0 00000100:00100000:3.0:1787787575.664104:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3653:1874630503837696:0@lo:400:kworker.0 00010000:00080000:3.0:1787787575.664114:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870d4e60f00 x1874630503838208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787787575.664123:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3653:1874630503838208:0@lo:400:kworker.0 00000100:00100000:0.0:1787787575.665418:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787787575.665435:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff986fc41cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503838720:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787787575.665486:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787787575.665532:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503836928 00000100:00100000:0.0:1787787575.665538:0:22708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503836928 00000100:00100000:0.0:1787787575.665579:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787787575.665588:0:22708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870f6547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:3656:x1874630503836928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787787575.665631:0:22708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870f6547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3fd2c107-7647-408e-8048-4ef16ee44cbc+24:3656:x1874630503836928:12345-0@lo:400:kworker.0 Request processed in 44us (4074us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787575.665649:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787787575.665697:0:24224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503838720 00000100:00100000:0.0:1787787575.665701:0:24224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503838720 00000100:00100000:0.0:1787787575.665728:0:24224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787787575.665734:0:24224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc43fa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503838720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787787575.665757:0:24224:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787787575.665794:0:24224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc43fa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874630503838720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787575.665812:0:24224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787787575.665857:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc41cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3654:1874630503838720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787787575.666385:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3656:1874630503837952:0@lo:400:kworker.0 00010000:00080000:1.0:1787787575.666408:0:3656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9870d4e62940 x1874630503838464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787787591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787787575.666419:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d4e62940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3656:1874630503838464:0@lo:400:kworker.0 00000100:00100000:1.0:1787787575.666454:0:3656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870ed926580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503838592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787787575.666488:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787575.666510:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff986fc43f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3fd2c107-7647-408e-8048-4ef16ee44cbc:3656:1874630503836928:0@lo:400:kworker.0 00000100:00100000:0.0:1787787575.667089:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503838592 00000100:00100000:0.0:1787787575.667095:0:24223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503838592 00000100:00100000:0.0:1787787575.667134:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787787575.667169:0:24223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870d9644b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3656:x1874630503838592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787787575.667344:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787787575.667446:0:24223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870d9644b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3656:x1874630503838592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 278us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1787787575.667453:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787787575.679087:0:3656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870ed926580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3656:1874630503838592:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787787575.721493:0:22702:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787787576.320528:0:25800:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:0.0:1787787576.681434:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9870d96443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503838848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787787576.681516:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787787576.681699:0:25757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630503838848 00000100:00100000:1.0:1787787576.681707:0:25757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630503838848 00000100:00100000:1.0:1787787576.681767:0:25757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787787576.681787:0:25757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc41cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503838848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787787576.681817:0:25757:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1787787576.681869:0:25757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc41cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874630503838848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787576.681876:0:25757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787787576.682257:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9870d96443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3654:1874630503838848:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787787576.745347:0:24527:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787577.003611:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787577.003706:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787577.003739:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787577.003767:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787577.003787:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787577.003804:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787577.003821:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787577.003840:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787577.003885:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787577.003911:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484865280 00000100:00100000:3.0:1787787577.003921:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484865280 00000100:00100000:3.0:1787787577.003972:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484865792 00000100:00100000:3.0:1787787577.003976:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484865792 00000100:00100000:3.0:1787787577.003990:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484865152 00000100:00100000:3.0:1787787577.003993:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484865152 00000100:00100000:3.0:1787787577.004006:0:25511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484865664 00000100:00100000:3.0:1787787577.004008:0:25511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484865664 00000100:00100000:3.0:1787787577.004024:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 58 00000100:00100000:3.0:1787787577.004033:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+5:2393:x1874630484865280:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787577.004110:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+5:2393:x1874630484865280:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 78us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787577.004118:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 58 00000100:00100000:3.0:1787787577.004134:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 59 00000100:00100000:3.0:1787787577.004179:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb47d838-e4ce-420a-9c06-daf336fc8d65+5:2393:x1874630484865792:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787577.004217:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb47d838-e4ce-420a-9c06-daf336fc8d65+5:2393:x1874630484865792:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 29us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787577.004225:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 59 00000100:00100000:3.0:1787787577.004239:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 60 00000100:00100000:3.0:1787787577.004245:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+26:2393:x1874630484865152:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787577.004287:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a65d3225-1272-4ba4-9698-bcc15a4206b3+26:2393:x1874630484865152:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 42us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787577.004293:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 60 00000100:00100000:3.0:1787787577.004305:0:25511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 61 00000100:00100000:3.0:1787787577.004311:0:25511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb47d838-e4ce-420a-9c06-daf336fc8d65+6:2393:x1874630484865664:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787577.004345:0:25511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb47d838-e4ce-420a-9c06-daf336fc8d65+6:2393:x1874630484865664:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 34us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787577.004351:0:25511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 61 00000100:00100000:3.0:1787787577.004370:0:25288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484865536 00000100:00100000:3.0:1787787577.004374:0:25288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484865536 00000100:00100000:3.0:1787787577.004398:0:25288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484866048 00000100:00100000:3.0:1787787577.004400:0:25288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484866048 00000100:00100000:3.0:1787787577.004411:0:25288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484865408 00000100:00100000:3.0:1787787577.004413:0:25288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484865408 00000100:00100000:3.0:1787787577.004423:0:25288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484865920 00000100:00100000:3.0:1787787577.004425:0:25288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484865920 00000100:00100000:3.0:1787787577.004438:0:25288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 27 00000100:00100000:3.0:1787787577.004444:0:25288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a65d3225-1272-4ba4-9698-bcc15a4206b3+8:2393:x1874630484865536:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787577.004470:0:25288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a65d3225-1272-4ba4-9698-bcc15a4206b3+8:2393:x1874630484865536:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787577.004476:0:25288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 27 00000100:00100000:3.0:1787787577.004488:0:25288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 28 00000100:00100000:3.0:1787787577.004495:0:25288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc2e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb47d838-e4ce-420a-9c06-daf336fc8d65+5:2393:x1874630484866048:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787577.004517:0:25288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc2e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb47d838-e4ce-420a-9c06-daf336fc8d65+5:2393:x1874630484866048:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787577.004523:0:25288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 28 00000100:00100000:3.0:1787787577.004535:0:25288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 29 00000100:00100000:3.0:1787787577.004541:0:25288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870fc3052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a65d3225-1272-4ba4-9698-bcc15a4206b3+5:2393:x1874630484865408:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787577.004564:0:25288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870fc3052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a65d3225-1272-4ba4-9698-bcc15a4206b3+5:2393:x1874630484865408:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 23us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787577.004580:0:25288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 29 00000100:00100000:3.0:1787787577.004592:0:25288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 30 00000100:00100000:3.0:1787787577.004599:0:25288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb47d838-e4ce-420a-9c06-daf336fc8d65+5:2393:x1874630484865920:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1787787577.004634:0:25288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb47d838-e4ce-420a-9c06-daf336fc8d65+5:2393:x1874630484865920:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 35us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787787577.004641:0:25288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 30 00000100:00080000:3.0:1787787577.004669:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787787577.004673:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787787577.004676:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787787577.004678:0:22710:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787787577.007764:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484865024 00000100:00100000:2.0:1787787577.007796:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484865024 00000100:00100000:2.0:1787787577.007935:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 164 00000100:00100000:2.0:1787787577.007948:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff986fc3a2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b13f583f-f513-4656-8252-cd03f2d0eada+13:2393:x1874630484865024:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1787787577.008037:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff986fc3a2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b13f583f-f513-4656-8252-cd03f2d0eada+13:2393:x1874630484865024:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 92us (4437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787787577.008045:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 164 00010000:00010000:2.0:1787787577.769438:0:22703:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787787578.035544:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1787787578.035599:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1787787578.035672:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484866176 00000100:00100000:0.0:1787787578.035683:0:24225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484866176 00002000:00100000:0.0:1787787578.035730:0:24225:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x42:0x0] (0->8) req@ffff9870c327d2c0 x1874630484866176/t0(0) o4->a65d3225-1272-4ba4-9698-bcc15a4206b3@192.168.204.31@tcp:439/0 lens 504/0 e 0 to 0 dl 1787787589 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1787787578.035742:0:24225:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9870c327d2c0 with x1874630484866176 ext(0->8) 00002000:00010000:0.0:1787787578.035748:0:24225:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9870c327d2c0 00000100:00100000:0.0:1787787578.035782:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 0 00000100:00100000:0.0:1787787578.035793:0:24225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+8:2394:x1874630484866176:12345-192.168.204.31@tcp:4:bash.0 00000100:00100000:0.0:1787787578.037015:0:24225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a65d3225-1272-4ba4-9698-bcc15a4206b3+10:2394:x1874630484866176:12345-192.168.204.31@tcp:4:bash.0 Request processed in 1219us (1475us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1787787578.037024:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 0 00002000:00100000:0.0:1787787578.037033:0:24225:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x42:0x0] (0->8) req@ffff9870c327d2c0 x1874630484866176/t12884901895(0) o4->a65d3225-1272-4ba4-9698-bcc15a4206b3@192.168.204.31@tcp:439/0 lens 504/448 e 0 to 0 dl 1787787589 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1787787578.037048:0:24225:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9870c327d2c0 with x1874630484866176 ext(0->8) 00002000:00010000:0.0:1787787578.037052:0:24225:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9870c327d2c0 00000100:00100000:1.0:1787787578.037722:0:25288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874630484866304 00000100:00100000:1.0:1787787578.037730:0:25288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874630484866304 00000100:00100000:1.0:1787787578.037780:0:25288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 34 00000100:00100000:1.0:1787787578.037789:0:25288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9870c327c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a65d3225-1272-4ba4-9698-bcc15a4206b3+10:2394:x1874630484866304:12345-192.168.204.31@tcp:16:kworker.0 00000001:00080000:0.0:1787787578.039360:0:25038:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:0.0:1787787578.039374:0:25038:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00000100:00100000:1.0:1787787578.040363:0:25288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9870c327c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a65d3225-1272-4ba4-9698-bcc15a4206b3+6:2394:x1874630484866304:12345-192.168.204.31@tcp:16:kworker.0 Request processed in 2565us (4754us total) trans 0 rc 0/0 00000100:00100000:1.0:1787787578.040375:0:25288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 34 Debug log: 14411 lines, 14411 kept, 0 dropped, 0 bad.