00010000:00010000:1.0F:1787560826.421333:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0F:1787560826.933551:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862907264:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560826.933646:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0F:1787560826.933898:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862907264 00000100:00100000:2.0:1787560826.933912:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862907264 00000100:00100000:2.0:1787560826.933966:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787560826.933977:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862907264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787560826.934007:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787560826.934054:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862907264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560826.934061:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1787560826.934090:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787560826.934296:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f08f2f56-c18f-4579-88a9-05007f76ffc9:3626:1874392862907520:0@lo:400:kworker.0 00000100:00100000:0.0:1787560826.934331:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560826.934355:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862908032:0@lo:400:kworker.0 00000100:00100000:0.0:1787560826.934379:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560826.934397:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862908544:0@lo:400:kworker.0 00000100:00100000:0.0:1787560826.934416:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560826.934460:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1787560826.934467:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862907392:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787560826.934489:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560826.934504:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862907904:0@lo:400:kworker.0 00000100:00100000:0.0:1787560826.934542:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560826.934560:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862908416:0@lo:400:kworker.0 00000100:00100000:0.0:1787560826.934582:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560826.934597:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862908928:0@lo:400:kworker.0 00000100:00100000:0.0:1787560826.934627:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560826.934652:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862907520 00000100:00100000:0.0:1787560826.934656:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862907520 00000100:00100000:0.0:1787560826.934684:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787560826.934691:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:3626:x1874392862907520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560826.934739:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:3626:x1874392862907520:12345-0@lo:400:kworker.0 Request processed in 48us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560826.934745:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787560826.934773:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862908032 00000100:00100000:0.0:1787560826.934776:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862908032 00000100:00100000:0.0:1787560826.934807:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862908544 00000100:00100000:0.0:1787560826.934810:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862908544 00000100:00100000:0.0:1787560826.934826:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862908416 00000100:00100000:0.0:1787560826.934829:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862908416 00000100:00100000:0.0:1787560826.934838:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862908928 00000100:00100000:0.0:1787560826.934840:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862908928 00000100:00100000:0.0:1787560826.934854:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787560826.934860:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862908032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560826.934905:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862908032:12345-0@lo:400:kworker.0 Request processed in 45us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560826.934911:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787560826.934925:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787560826.934930:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862908544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560826.934957:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862908544:12345-0@lo:400:kworker.0 Request processed in 27us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560826.934963:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787560826.934974:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787560826.934981:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874392862908416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560826.935006:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874392862908416:12345-0@lo:400:kworker.0 Request processed in 26us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560826.935012:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787560826.935023:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787560826.935029:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862908928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560826.935055:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862908928:12345-0@lo:400:kworker.0 Request processed in 26us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560826.935060:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787560826.935084:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862907776:0@lo:400:kworker.0 00000100:00100000:0.0:1787560826.935114:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560826.935132:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862908288:0@lo:400:kworker.0 00000100:00100000:0.0:1787560826.935151:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560826.935166:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874392862908800:0@lo:400:kworker.0 00000100:00100000:0.0:1787560826.935186:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560826.935226:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862907264:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560826.935242:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787560826.935247:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862907648:0@lo:400:kworker.0 00000100:00100000:0.0:1787560826.935270:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560826.935285:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862908160:0@lo:400:kworker.0 00000100:00100000:0.0:1787560826.935305:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560826.935323:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862908672:0@lo:400:kworker.0 00000100:00100000:0.0:1787560826.935342:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560826.935368:0:18389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862907648 00000100:00100000:0.0:1787560826.935372:0:18389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862907648 00000100:00100000:0.0:1787560826.935400:0:18389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862908160 00000100:00100000:0.0:1787560826.935403:0:18389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862908160 00000100:00100000:0.0:1787560826.935420:0:18389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787560826.935426:0:18389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862907648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560826.935502:0:18389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862907648:12345-0@lo:400:kworker.0 Request processed in 75us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560826.935508:0:18389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787560826.935522:0:18389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787560826.935528:0:18389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862908160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560826.935555:0:18389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862908160:12345-0@lo:400:kworker.0 Request processed in 27us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560826.935569:0:18389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787560826.935588:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862908800 00000100:00100000:0.0:1787560826.935591:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862908800 00000100:00100000:0.0:1787560826.935624:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862908672 00000100:00100000:0.0:1787560826.935627:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862908672 00000100:00100000:0.0:1787560826.935640:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787560826.935646:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874392862908800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560826.935676:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874392862908800:12345-0@lo:400:kworker.0 Request processed in 30us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560826.935681:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787560826.935691:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787560826.935697:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862908672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560826.935721:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862908672:12345-0@lo:400:kworker.0 Request processed in 24us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560826.935726:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787560826.935743:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862907392 00000100:00100000:0.0:1787560826.935746:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862907392 00000100:00100000:0.0:1787560826.935769:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787560826.935776:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862907392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787560826.935794:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787560826.935822:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862907392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (1332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560826.935829:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787560826.935865:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862907392:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787560826.935877:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862908416:0@lo:400:kworker.0 00010000:00080000:0.0:1787560826.935901:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2f45880 x1874392862908928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560826.935912:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862908928:0@lo:400:kworker.0 00000100:00100000:0.0:1787560826.935922:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f08f2f56-c18f-4579-88a9-05007f76ffc9:3626:1874392862907520:0@lo:400:kworker.0 00000100:00100000:0.0:1787560826.935932:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862908032:0@lo:400:kworker.0 00000100:00100000:0.0:1787560826.935942:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862908544:0@lo:400:kworker.0 00000100:00100000:0.0:1787560826.935973:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862907648:0@lo:400:kworker.0 00000100:00100000:0.0:1787560826.935981:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862908160:0@lo:400:kworker.0 00010000:00080000:0.0:1787560826.935990:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2f47100 x1874392862908672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560826.935999:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862908672:0@lo:400:kworker.0 00000100:00100000:0.0:1787560826.936008:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874392862908800:0@lo:400:kworker.0 00000100:00080000:2.0:1787560826.936294:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787560826.936300:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787560826.936302:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0F:1787560826.936874:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787560826.936902:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3240e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862909056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560826.936949:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560826.936995:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862907904 00000100:00100000:3.0:1787560826.937001:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862907904 00000100:00100000:3.0:1787560826.937042:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862907776 00000100:00100000:3.0:1787560826.937045:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862907776 00000100:00100000:3.0:1787560826.937057:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862908288 00000100:00100000:3.0:1787560826.937060:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862908288 00000100:00100000:3.0:1787560826.937072:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787560826.937079:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862907904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560826.937121:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862907904:12345-0@lo:400:kworker.0 Request processed in 42us (2578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560826.937127:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787560826.937142:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787560826.937148:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862907776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560826.937182:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862907776:12345-0@lo:400:kworker.0 Request processed in 35us (2067us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560826.937188:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787560826.937199:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787560826.937205:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862908288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560826.937248:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862908288:12345-0@lo:400:kworker.0 Request processed in 44us (2096us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560826.937254:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1787560826.937287:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787560826.937290:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787560826.937314:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862907776:0@lo:400:kworker.0 00000100:00100000:3.0:1787560826.937324:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862908288:0@lo:400:kworker.0 00000100:00100000:2.0:1787560826.937484:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862909056 00000100:00100000:2.0:1787560826.937489:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862909056 00000100:00100000:2.0:1787560826.937521:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787560826.937529:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862909056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787560826.937542:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787560826.937582:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862909056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560826.937588:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787560826.937631:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3240e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862909056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787560826.938003:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862907904:0@lo:400:kworker.0 00000100:00100000:1.0:1787560827.444696:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862909184:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787560827.444792:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560827.444857:0:18389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862909184 00000100:00100000:1.0:1787560827.444868:0:18389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862909184 00000100:00100000:1.0:1787560827.444924:0:18389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787560827.444934:0:18389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862909184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787560827.444969:0:18389:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787560827.445020:0:18389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862909184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560827.445028:0:18389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787560827.445081:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862909184:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787560827.445952:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787560827.452950:0:17153:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:2.0:1787560827.452973:0:17153:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9caff3251300 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:2.0:1787560827.452978:0:17153:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cafc8744d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9caff3251180 00000020:00080000:2.0:1787560827.452981:0:17153:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cafc8744800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9caff513ca00 00010000:00010000:0.0:1787560827.453684:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f355bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560827.453699:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f355bd lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560827.453706:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f355bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560827.453712:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb002176200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560827.453735:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f355bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560827.453742:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f355bd lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560827.453759:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cafd8703800) 00010000:00010000:0.0:1787560827.453762:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560827.453766:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f355bd lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560827.453773:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176200/0x4642c20bf2f355bd lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19968 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787560827.453946:0:17213:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00000020:00080000:1.0:1787560827.454023:0:17213:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1787560827.454236:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3241880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862909312:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787560827.454391:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560827.454644:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862909312 00000100:00100000:2.0:1787560827.454653:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862909312 00000100:00100000:2.0:1787560827.454704:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787560827.454724:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862909312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787560827.454762:0:17179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1787560827.454819:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862909312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560827.454826:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787560827.455228:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3241880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862909312:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787560828.468573:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560828.979749:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862909440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787560828.979833:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560828.979939:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862909440 00000100:00100000:2.0:1787560828.979948:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862909440 00000100:00100000:2.0:1787560828.980024:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787560828.980037:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862909440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787560828.980072:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787560828.980128:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862909440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560828.980136:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787560828.980186:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862909440:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787560828.980300:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560829.035304:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560829.035402:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853391744 00000100:00100000:0.0:1787560829.035416:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853391744 00000100:00100000:0.0:1787560829.035542:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 65 00000100:00100000:0.0:1787560829.035555:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5945945-1487-49fd-bee0-0dcced27d086+13:15590:x1874392853391744:12345-192.168.203.29@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787560829.035699:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5945945-1487-49fd-bee0-0dcced27d086+13:15590:x1874392853391744:12345-192.168.203.29@tcp:60:lhsmtool_posix.0 Request processed in 147us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560829.035708:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 65 00000100:00080000:3.0:1787560829.036996:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560829.040123:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560829.044216:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853391872 00000100:00100000:1.0:1787560829.044233:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853391872 00000100:00100000:1.0:1787560829.044318:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 66 00000100:00100000:1.0:1787560829.044328:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5945945-1487-49fd-bee0-0dcced27d086+5:15590:x1874392853391872:12345-192.168.203.29@tcp:60:lhsmtool_posix.0 00000100:00080000:0.0:1787560829.044427:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787560829.044511:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5945945-1487-49fd-bee0-0dcced27d086+5:15590:x1874392853391872:12345-192.168.203.29@tcp:60:lhsmtool_posix.0 Request processed in 182us (4399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560829.044520:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 66 00000100:00100000:0.0:1787560829.054807:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560829.054983:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853392128 00000100:00100000:3.0:1787560829.055003:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853392128 00000100:00100000:3.0:1787560829.055098:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:3.0:1787560829.055114:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a5945945-1487-49fd-bee0-0dcced27d086+13:15590:x1874392853392128:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787560829.055506:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a5945945-1487-49fd-bee0-0dcced27d086+14:15590:x1874392853392128:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 394us (711us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1787560829.055529:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:0.0:1787560829.448857:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560829.448922:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560829.449057:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853392384 00000100:00100000:1.0:1787560829.449072:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853392384 00000100:00100000:1.0:1787560829.449182:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 37 00000100:00100000:1.0:1787560829.449195:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5945945-1487-49fd-bee0-0dcced27d086+5:2405:x1874392853392384:12345-192.168.203.29@tcp:400:kworker.0 00000100:00080000:0.0:1787560829.449843:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787560829.449939:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5945945-1487-49fd-bee0-0dcced27d086+5:2405:x1874392853392384:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 122us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560829.449966:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 37 00000100:00100000:3.0:1787560829.450276:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853392256 00000100:00100000:3.0:1787560829.450284:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853392256 00000100:00100000:3.0:1787560829.450343:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 176 00000100:00100000:3.0:1787560829.450353:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b1eeed-a176-422e-91d7-2f6f77b2967a+13:2405:x1874392853392256:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560829.450416:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6b1eeed-a176-422e-91d7-2f6f77b2967a+13:2405:x1874392853392256:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 65us (1581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560829.450424:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 176 00000100:00100000:0.0:1787560829.459656:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560829.459706:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560829.459752:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560829.459792:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560829.459984:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853392640 00000100:00100000:1.0:1787560829.459999:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853392640 00000100:00100000:1.0:1787560829.460097:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853392768 00000100:00100000:1.0:1787560829.460101:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853392768 00000100:00100000:1.0:1787560829.460134:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 91 00000100:00100000:1.0:1787560829.460149:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1b0149ea-e230-42a7-990a-2401127b7ffb+6:2405:x1874392853392640:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560829.460255:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1b0149ea-e230-42a7-990a-2401127b7ffb+6:2405:x1874392853392640:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 110us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560829.460265:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 91 00000100:00100000:1.0:1787560829.460285:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 92 00000100:00100000:1.0:1787560829.460291:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1b0149ea-e230-42a7-990a-2401127b7ffb+5:2405:x1874392853392768:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560829.460321:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1b0149ea-e230-42a7-990a-2401127b7ffb+5:2405:x1874392853392768:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 29us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560829.460327:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 92 00000100:00100000:3.0:1787560829.460836:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853392512 00000100:00100000:3.0:1787560829.460845:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853392512 00000100:00100000:2.0:1787560829.460900:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853392896 00000100:00100000:3.0:1787560829.460908:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:2.0:1787560829.460909:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853392896 00000100:00100000:3.0:1787560829.460933:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5945945-1487-49fd-bee0-0dcced27d086+5:2401:x1874392853392512:12345-192.168.203.29@tcp:9:kworker.0 00000100:00100000:2.0:1787560829.460957:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 34 00000020:00000080:3.0:1787560829.460964:0:18685:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f352f3 00000100:00100000:2.0:1787560829.460970:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1b0149ea-e230-42a7-990a-2401127b7ffb+5:2401:x1874392853392896:12345-192.168.203.29@tcp:9:kworker.0 00000100:00080000:3.0:1787560829.460989:0:18685:0:(import.c:65:import_set_state_nolock()) ffff9caec2fce800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1787560829.460990:0:18683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f3532b 00000100:00080000:2.0:1787560829.461010:0:18683:0:(import.c:65:import_set_state_nolock()) ffff9caec2fcb800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787560829.461063:0:18685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000001:00000004:2.0:1787560829.461072:0:18683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1787560829.461255:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1b0149ea-e230-42a7-990a-2401127b7ffb+2:2401:x1874392853392896:12345-192.168.203.29@tcp:9:kworker.0 Request processed in 289us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560829.461273:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 34 00000100:00080000:0.0:1787560829.461288:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787560829.461294:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787560829.461298:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787560829.461300:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787560829.461483:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560829.461491:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560829.461839:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5945945-1487-49fd-bee0-0dcced27d086+2:2401:x1874392853392512:12345-192.168.203.29@tcp:9:kworker.0 Request processed in 906us (2196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560829.461847:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:0.0:1787560829.465572:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560829.467533:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853393024 00000100:00100000:2.0:1787560829.467555:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853393024 00000100:00080000:0.0:1787560829.467669:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787560829.467686:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 35 00000100:00100000:2.0:1787560829.467700:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1b0149ea-e230-42a7-990a-2401127b7ffb+5:2401:x1874392853393024:12345-192.168.203.29@tcp:9:kworker.0 00000020:00000080:2.0:1787560829.467750:0:18683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f35332 00000100:00080000:2.0:1787560829.467762:0:18683:0:(import.c:65:import_set_state_nolock()) ffff9cafc58ba000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787560829.467830:0:18683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1787560829.468033:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1b0149ea-e230-42a7-990a-2401127b7ffb+2:2401:x1874392853393024:12345-192.168.203.29@tcp:9:kworker.0 Request processed in 335us (2475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560829.468043:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 35 00010000:00010000:0.0:1787560829.468181:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560829.492152:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560830.518034:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560831.542274:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560832.051714:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560832.051751:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862909568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560832.051863:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560832.051969:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862909568 00000100:00100000:3.0:1787560832.051983:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862909568 00000100:00100000:3.0:1787560832.052089:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787560832.052108:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff4b9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862909568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787560832.052157:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:0.0:1787560832.055726:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787560832.055808:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f08f2f56-c18f-4579-88a9-05007f76ffc9:3623:1874392862909696:0@lo:400:kworker.0 00000100:00100000:0.0:1787560832.055929:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560832.056004:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560832.056011:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862909824:0@lo:400:kworker.0 00000100:00100000:0.0:1787560832.056047:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560832.056095:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862909824 00000100:00100000:0.0:1787560832.056105:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862909824 00000100:00100000:0.0:1787560832.056175:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787560832.056187:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862909824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560832.056262:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862909824:12345-0@lo:400:kworker.0 Request processed in 76us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560832.056271:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787560832.056326:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862909824:0@lo:400:kworker.0 00000100:00100000:0.0:1787560832.056416:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787560832.056426:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862910208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787560832.056484:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560832.056539:0:18686:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1787560832.056551:0:18686:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1787560832.056728:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862910208 00000100:00100000:0.0:1787560832.056733:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862910208 00000100:00080000:0.0:1787560832.056772:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787560832.056862:0:20517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787560832.056871:0:20517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862910208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787560832.056893:0:20517:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787560832.056940:0:20517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862910208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560832.056946:0:20517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787560832.056980:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862910208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787560832.057032:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862909696 00000100:00100000:0.0:1787560832.057036:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862909696 00000100:00100000:0.0:1787560832.057086:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787560832.057094:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:3623:x1874392862909696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560832.057135:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:3623:x1874392862909696:12345-0@lo:400:kworker.0 Request processed in 43us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560832.057142:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787560832.057177:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f08f2f56-c18f-4579-88a9-05007f76ffc9:3623:1874392862909696:0@lo:400:kworker.0 00000100:00100000:0.0:1787560832.057202:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcaab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862910080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787560832.057231:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560832.057253:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787560832.057261:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862909952:0@lo:400:kworker.0 00000100:00100000:0.0:1787560832.057288:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560832.057317:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862910080 00000100:00100000:0.0:1787560832.057328:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862910080 00000100:00100000:0.0:1787560832.057361:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787560832.057368:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862910080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787560832.057394:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787560832.057479:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862910080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560832.057485:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1787560832.057501:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560832.057524:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcaab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862910080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787560832.057563:0:19050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862909952 00000100:00100000:0.0:1787560832.057566:0:19050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862909952 00000100:00100000:0.0:1787560832.057618:0:19050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787560832.057625:0:19050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862909952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560832.057664:0:19050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862909952:12345-0@lo:400:kworker.0 Request processed in 39us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560832.057671:0:19050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787560832.057685:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560832.057702:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862909952:0@lo:400:kworker.0 00000100:00100000:3.0:1787560832.068158:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff4b9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862909568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 16041us (16278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560832.068178:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787560832.069403:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862909568:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787560832.072597:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862910592:0@lo:400:kworker.0 00000100:00100000:1.0:1787560832.072702:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560832.072752:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862911104:0@lo:400:kworker.0 00000100:00100000:1.0:1787560832.072784:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560832.072814:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787560832.072820:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862910464:0@lo:400:kworker.0 00000100:00100000:1.0:1787560832.072875:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560832.072899:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862910976:0@lo:400:kworker.0 00000100:00100000:1.0:1787560832.072922:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560832.072963:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862910592 00000100:00100000:1.0:1787560832.072974:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862910592 00000100:00100000:1.0:1787560832.073034:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862911104 00000100:00100000:1.0:1787560832.073038:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862911104 00000100:00100000:1.0:1787560832.073071:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862910976 00000100:00100000:1.0:1787560832.073074:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862910976 00000100:00100000:1.0:1787560832.073094:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787560832.073105:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874392862910592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560832.073177:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874392862910592:12345-0@lo:400:kworker.0 Request processed in 73us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560832.073186:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787560832.073205:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787560832.073212:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862911104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560832.073242:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862911104:12345-0@lo:400:kworker.0 Request processed in 31us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560832.073249:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787560832.073264:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787560832.073304:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862910336:0@lo:400:kworker.0 00000100:00100000:0.0:1787560832.073347:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560832.073366:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4abc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862910848:0@lo:400:kworker.0 00000100:00100000:2.0:1787560832.073376:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874392862910720:0@lo:400:kworker.0 00000100:00100000:0.0:1787560832.073393:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560832.073423:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560832.073492:0:18389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862910464 00000100:00100000:2.0:1787560832.073496:0:18389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862910464 00000100:00100000:2.0:1787560832.073529:0:18389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787560832.073536:0:18389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862910464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560832.073581:0:18389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862910464:12345-0@lo:400:kworker.0 Request processed in 36us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560832.073588:0:18389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787560832.073609:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862910336 00000100:00100000:2.0:1787560832.073613:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862910336 00000100:00100000:2.0:1787560832.073629:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862910848 00000100:00100000:2.0:1787560832.073631:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862910848 00000100:00100000:2.0:1787560832.073644:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862910720 00000100:00100000:2.0:1787560832.073646:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862910720 00000100:00100000:2.0:1787560832.073660:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787560832.073666:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862910336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560832.073702:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862910336:12345-0@lo:400:kworker.0 Request processed in 37us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560832.073719:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787560832.073732:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787560832.073738:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862910848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560832.073767:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862910848:12345-0@lo:400:kworker.0 Request processed in 29us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560832.073773:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787560832.073783:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787560832.073789:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874392862910720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560832.073819:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874392862910720:12345-0@lo:400:kworker.0 Request processed in 30us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560832.073825:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787560832.073869:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4abf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874392862910720:0@lo:400:kworker.0 00000100:00100000:2.0:1787560832.073906:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862910336:0@lo:400:kworker.0 00010000:00080000:2.0:1787560832.073920:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec4abc700 x1874392862910848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560832.073931:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4abc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862910848:0@lo:400:kworker.0 00000100:00100000:1.0:1787560832.074520:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862910976:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787560832.074591:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787560832.074597:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787560832.074663:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862910976:12345-0@lo:400:kworker.0 Request processed in 152us (1738us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560832.074666:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862910464:0@lo:400:kworker.0 00000100:00100000:1.0:1787560832.074673:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787560832.074690:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4abca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862910976:0@lo:400:kworker.0 00000100:00100000:0.0:1787560832.074717:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862910592:0@lo:400:kworker.0 00010000:00080000:0.0:1787560832.074731:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec4abc380 x1874392862911104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560832.074741:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4abc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862911104:0@lo:400:kworker.0 00000040:00080000:2.0:1787560832.372580:0:17927:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787560832.564048:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862911232:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787560832.564166:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787560832.564462:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560832.565296:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862911232 00000100:00100000:0.0:1787560832.565311:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862911232 00000100:00100000:0.0:1787560832.565386:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787560832.565400:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862911232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787560832.565469:0:17179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787560832.565763:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862911232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 365us (1595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560832.565772:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787560832.565837:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862911232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560832.577661:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560832.577700:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862911360:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787560832.577815:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560832.577921:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862911360 00000100:00100000:2.0:1787560832.577932:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862911360 00000100:00100000:2.0:1787560832.578008:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787560832.578020:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862911360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787560832.578099:0:17178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1787560832.578158:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862911360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560832.578166:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787560832.578319:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862911360:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1787560833.439070:0:20554:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 04:40:31 (1787560831) 00010000:00010000:1.0:1787560833.590276:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787560833.594930:0:17153:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:2.0:1787560833.594951:0:17153:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00080000:1.0:1787560833.595423:0:17213:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:1.0:1787560833.595487:0:17213:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000100:00100000:1.0:1787560834.099875:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787560834.099920:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862911488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787560834.100051:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560834.107100:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862911488 00000100:00100000:0.0:1787560834.107134:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862911488 00000100:00100000:1.0:1787560834.112118:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787560834.112144:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4abe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862911488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787560834.112364:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787560834.113061:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4abe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862911488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 792us (12874us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560834.113073:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787560834.113237:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862911488:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787560834.114377:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787560834.558982:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560834.559033:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560834.559172:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853393152 00000100:00100000:0.0:1787560834.559187:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853393152 00000100:00100000:0.0:1787560834.559282:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 178 00000100:00100000:0.0:1787560834.559294:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+13:2403:x1874392853393152:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560834.559403:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+13:2403:x1874392853393152:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 110us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560834.559412:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 178 00000100:00100000:3.0:1787560834.561096:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853393280 00000100:00100000:3.0:1787560834.561112:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853393280 00000100:00100000:3.0:1787560834.561289:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 99 00000100:00100000:3.0:1787560834.561303:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5945945-1487-49fd-bee0-0dcced27d086+13:2403:x1874392853393280:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560834.561458:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5945945-1487-49fd-bee0-0dcced27d086+13:2403:x1874392853393280:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 131us (2395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560834.561469:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 99 00000100:00080000:0.0:1787560834.562426:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560834.571758:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560834.571802:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560834.571825:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560834.571852:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560834.571888:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853393536 00000100:00100000:1.0:1787560834.571901:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853393536 00000100:00100000:1.0:1787560834.571994:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 39 00000100:00100000:1.0:1787560834.572007:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4abc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5945945-1487-49fd-bee0-0dcced27d086+5:2402:x1874392853393536:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560834.572119:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4abc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5945945-1487-49fd-bee0-0dcced27d086+5:2402:x1874392853393536:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 114us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560834.572127:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 39 00000100:00100000:1.0:1787560834.572161:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853393792 00000100:00100000:1.0:1787560834.572164:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853393792 00000100:00100000:1.0:1787560834.572211:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853393408 00000100:00100000:1.0:1787560834.572215:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853393408 00000100:00100000:1.0:1787560834.572235:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853393664 00000100:00100000:1.0:1787560834.572238:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853393664 00000100:00100000:1.0:1787560834.572270:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 100 00000100:00100000:1.0:1787560834.572277:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b0149ea-e230-42a7-990a-2401127b7ffb+5:2402:x1874392853393792:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560834.572311:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b0149ea-e230-42a7-990a-2401127b7ffb+5:2402:x1874392853393792:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 34us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560834.572318:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 100 00000100:00100000:1.0:1787560834.572330:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 101 00000100:00100000:1.0:1787560834.572336:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5945945-1487-49fd-bee0-0dcced27d086+5:2402:x1874392853393408:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560834.572368:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5945945-1487-49fd-bee0-0dcced27d086+5:2402:x1874392853393408:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 32us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560834.572374:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 101 00000100:00100000:1.0:1787560834.572387:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 102 00000100:00100000:1.0:1787560834.572393:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b0149ea-e230-42a7-990a-2401127b7ffb+6:2402:x1874392853393664:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560834.572418:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1b0149ea-e230-42a7-990a-2401127b7ffb+6:2402:x1874392853393664:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 26us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560834.572424:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 102 00000100:00080000:1.0:1787560834.572479:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787560834.572483:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787560834.572486:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787560834.614144:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787560835.456187:0:17206:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787560835.456198:0:17206:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787560835.456219:0:17206:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787560835.456229:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1787560835.637111:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787560835.639454:0:18679:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1b0149ea-e230-42a7-990a-2401127b7ffb 00000020:00000080:2.0:1787560835.639463:0:18679:0:(genops.c:885:class_export_put()) final put ffff9caec2fcd800/1b0149ea-e230-42a7-990a-2401127b7ffb 00000001:00100000:2.0:1787560835.641796:0:19498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1b0149ea-e230-42a7-990a-2401127b7ffb 00000020:00000080:2.0:1787560835.641806:0:19498:0:(genops.c:885:class_export_put()) final put ffff9cafc58bd000/1b0149ea-e230-42a7-990a-2401127b7ffb 00000001:00100000:2.0:1787560835.641895:0:19498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a5945945-1487-49fd-bee0-0dcced27d086 00000020:00000080:2.0:1787560835.641899:0:19498:0:(genops.c:885:class_export_put()) final put ffff9caec429b000/a5945945-1487-49fd-bee0-0dcced27d086 00000020:00000080:0.0:1787560835.642967:0:15403:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec2fcd800/1b0149ea-e230-42a7-990a-2401127b7ffb for lustre-OST0000 00000020:00000080:0.0:1787560835.643023:0:15403:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafc58bd000/1b0149ea-e230-42a7-990a-2401127b7ffb for lustre-OST0001 00000020:00000080:0.0:1787560835.643041:0:15403:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec429b000/a5945945-1487-49fd-bee0-0dcced27d086 for lustre-OST0001 00000020:00000080:0.0:1787560835.643059:0:15403:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec2fcb800 for lustre-OST0000 00000020:00000080:0.0:1787560835.643064:0:15403:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cafc58ba000 for lustre-OST0001 00000020:00000080:0.0:1787560835.643068:0:15403:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec2fce800 for lustre-OST0001 00010000:00010000:1.0:1787560836.662377:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560837.171670:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560837.171697:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862911616:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560837.171775:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560837.172088:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862911616 00000100:00100000:3.0:1787560837.172097:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862911616 00000100:00100000:3.0:1787560837.172145:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787560837.172155:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862911616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787560837.172183:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787560837.172225:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862911616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560837.172232:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787560837.172250:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787560837.172258:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862911744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560837.172281:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560837.172331:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862911616:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560837.172598:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560837.172608:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862911872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787560837.172638:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787560837.173174:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787560837.173189:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862911744 00000100:00100000:1.0:1787560837.173195:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862911744 00000100:00100000:1.0:1787560837.173231:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862911872 00000100:00100000:1.0:1787560837.173247:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862911872 00000100:00100000:1.0:1787560837.173262:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787560837.173269:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862911744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787560837.173284:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787560837.173322:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862911744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560837.173329:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787560837.173341:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787560837.173346:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862911872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787560837.173360:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787560837.173384:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862911872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560837.173390:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787560837.173422:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862911744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787560837.173700:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862911872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787560837.173824:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862912000:0@lo:400:kworker.0 00000100:00100000:2.0:1787560837.173865:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560837.173904:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560837.173909:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862912128:0@lo:400:kworker.0 00000100:00100000:2.0:1787560837.173934:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560837.173960:0:18389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862912128 00000100:00100000:2.0:1787560837.173964:0:18389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862912128 00000100:00100000:2.0:1787560837.173993:0:18389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787560837.174000:0:18389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862912128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560837.174036:0:18389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862912128:12345-0@lo:400:kworker.0 Request processed in 36us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560837.174049:0:18389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787560837.174079:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862912128:0@lo:400:kworker.0 00000100:00100000:2.0:1787560837.174118:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862912000 00000100:00100000:2.0:1787560837.174121:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862912000 00000100:00100000:2.0:1787560837.174145:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787560837.174151:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:3625:x1874392862912000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560837.174183:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:3625:x1874392862912000:12345-0@lo:400:kworker.0 Request processed in 33us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560837.174189:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787560837.174225:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862912000:0@lo:400:kworker.0 00000100:00100000:2.0:1787560837.174253:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862912256:0@lo:400:kworker.0 00000100:00100000:2.0:1787560837.174292:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560837.174334:0:19050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862912256 00000100:00100000:2.0:1787560837.174337:0:19050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862912256 00000100:00100000:2.0:1787560837.174366:0:19050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787560837.174373:0:19050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862912256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560837.174423:0:19050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862912256:12345-0@lo:400:kworker.0 Request processed in 36us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560837.174457:0:19050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1787560837.174703:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787560837.174707:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787560837.174742:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862912256:0@lo:400:kworker.0 00000100:00100000:3.0:1787560837.175975:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787560837.176059:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787560837.176073:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862912768:0@lo:400:kworker.0 00000100:00100000:1.0:1787560837.176122:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560837.176158:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862912768 00000100:00100000:1.0:1787560837.176163:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862912768 00000100:00100000:1.0:1787560837.176207:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787560837.176215:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862912768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560837.176257:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862912768:12345-0@lo:400:kworker.0 Request processed in 43us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560837.176264:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787560837.176299:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862912768:0@lo:400:kworker.0 00000100:00100000:1.0:1787560837.176329:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862912640:0@lo:400:kworker.0 00000100:00100000:1.0:1787560837.176367:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560837.176387:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787560837.176393:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862912512:0@lo:400:kworker.0 00000100:00100000:1.0:1787560837.176454:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560837.176493:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862912640 00000100:00100000:1.0:1787560837.176497:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862912640 00000100:00100000:1.0:1787560837.176525:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787560837.176532:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874392862912640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560837.176577:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874392862912640:12345-0@lo:400:kworker.0 Request processed in 45us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560837.176583:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787560837.176609:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862912640:0@lo:400:kworker.0 00000100:00080000:1.0:1787560837.176632:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560837.177197:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862912512 00000100:00100000:2.0:1787560837.177203:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862912512 00000100:00100000:2.0:1787560837.177247:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787560837.177254:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862912512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560837.177303:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862912512:12345-0@lo:400:kworker.0 Request processed in 49us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560837.177321:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787560837.177352:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862912512:0@lo:400:kworker.0 00000100:00100000:3.0:1787560837.178103:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862912384:0@lo:400:kworker.0 00000100:00100000:3.0:1787560837.178146:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560837.178225:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862912384 00000100:00100000:1.0:1787560837.178229:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862912384 00000100:00100000:1.0:1787560837.178301:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787560837.178310:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862912384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560837.178379:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862912384:12345-0@lo:400:kworker.0 Request processed in 70us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560837.178385:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787560837.178470:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862912384:0@lo:400:kworker.0 00000100:00100000:0.0:1787560837.178982:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862913152:0@lo:400:kworker.0 00000100:00100000:0.0:1787560837.179014:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560837.179249:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560837.179257:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862912896:0@lo:400:kworker.0 00000100:00100000:3.0:1787560837.179315:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862913024:0@lo:400:kworker.0 00000100:00100000:0.0:1787560837.179487:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560837.179814:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862913152 00000100:00100000:2.0:1787560837.179822:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862913152 00000100:00100000:2.0:1787560837.179875:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787560837.179883:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862913152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560837.179945:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862913152:12345-0@lo:400:kworker.0 Request processed in 63us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560837.179952:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1787560837.179972:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787560837.180215:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2f45180 x1874392862913152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560837.180230:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862913152:0@lo:400:kworker.0 00000100:00100000:1.0:1787560837.181681:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862913024 00000100:00100000:1.0:1787560837.181695:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862913024 00000100:00100000:1.0:1787560837.181754:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787560837.181775:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862913024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560837.182077:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862913024:12345-0@lo:400:kworker.0 Request processed in 94us (2380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560837.182087:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1787560837.182110:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560837.182213:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862913024:0@lo:400:kworker.0 00000100:00100000:2.0:1787560837.183068:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560837.183152:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862912896 00000100:00100000:3.0:1787560837.183161:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862912896 00000100:00080000:2.0:1787560837.183267:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787560837.187611:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787560837.187638:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862912896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560837.189073:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862912896:12345-0@lo:400:kworker.0 Request processed in 1444us (6002us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560837.189085:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:2.0:1787560837.189605:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2f46a00 x1874392862912896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560837.189622:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862912896:0@lo:400:kworker.0 00000100:00100000:3.0:1787560837.565706:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560837.565745:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560837.565928:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560837.566000:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853393920 00000100:00100000:1.0:1787560837.566011:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853393920 00000100:00100000:1.0:1787560837.566069:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 180 00000100:00100000:1.0:1787560837.566079:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+13:2405:x1874392853393920:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560837.566146:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+13:2405:x1874392853393920:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 69us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560837.566155:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 180 00000100:00100000:3.0:1787560837.575959:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560837.576860:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853394176 00000100:00100000:0.0:1787560837.576873:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853394176 00000100:00100000:0.0:1787560837.576942:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853394432 00000100:00100000:0.0:1787560837.576945:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853394432 00000100:00100000:0.0:1787560837.576968:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 109 00000100:00100000:0.0:1787560837.576977:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5945945-1487-49fd-bee0-0dcced27d086+5:2405:x1874392853394176:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560837.577067:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5945945-1487-49fd-bee0-0dcced27d086+5:2405:x1874392853394176:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 90us (11320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560837.577090:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 109 00000100:00100000:0.0:1787560837.577108:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 110 00000100:00100000:0.0:1787560837.577114:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b0149ea-e230-42a7-990a-2401127b7ffb+6:2405:x1874392853394432:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560837.577137:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b0149ea-e230-42a7-990a-2401127b7ffb+6:2405:x1874392853394432:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 24us (11210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560837.577143:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 110 00000100:00080000:2.0:1787560837.578757:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787560837.578766:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787560837.582731:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560837.582792:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560837.583137:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853394304 00000100:00100000:2.0:1787560837.583150:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853394304 00000100:00100000:2.0:1787560837.583227:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 41 00000100:00100000:2.0:1787560837.583238:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5945945-1487-49fd-bee0-0dcced27d086+5:2405:x1874392853394304:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560837.583308:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5945945-1487-49fd-bee0-0dcced27d086+5:2405:x1874392853394304:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 72us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560837.583315:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 41 00000100:00080000:3.0:1787560837.583578:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560837.583876:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853394048 00000100:00100000:0.0:1787560837.583882:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853394048 00000100:00100000:0.0:1787560837.583936:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853394560 00000100:00100000:0.0:1787560837.583940:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853394560 00000100:00100000:0.0:1787560837.583965:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 111 00000100:00100000:0.0:1787560837.583973:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5945945-1487-49fd-bee0-0dcced27d086+13:2405:x1874392853394048:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560837.584027:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5945945-1487-49fd-bee0-0dcced27d086+13:2405:x1874392853394048:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 55us (8080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560837.584034:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 111 00000100:00100000:0.0:1787560837.584050:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 112 00000100:00100000:0.0:1787560837.584057:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b0149ea-e230-42a7-990a-2401127b7ffb+5:2405:x1874392853394560:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560837.584079:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b0149ea-e230-42a7-990a-2401127b7ffb+5:2405:x1874392853394560:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 24us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560837.584084:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 112 00000100:00080000:3.0:1787560837.584244:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787560837.584247:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560837.683822:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787560837.683852:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862913408:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787560837.683861:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560837.683939:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560837.683985:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec4abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862913280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787560837.684010:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560837.684234:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862913408 00000100:00100000:0.0:1787560837.684244:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862913408 00000100:00100000:0.0:1787560837.684298:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862913280 00000100:00100000:0.0:1787560837.684302:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862913280 00000100:00100000:0.0:1787560837.684319:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787560837.684336:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862913408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787560837.684372:0:17179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1787560837.684424:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862913408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560837.684454:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787560837.684472:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787560837.684479:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862913280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787560837.684496:0:17179:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787560837.684525:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862913280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 46us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560837.684540:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787560837.684581:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862913408:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787560837.684592:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec4abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862913280:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560838.364949:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560838.365119:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853394816 00000100:00100000:2.0:1787560838.365133:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853394816 00000100:00100000:2.0:1787560838.365225:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:2.0:1787560838.365240:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeaba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a5945945-1487-49fd-bee0-0dcced27d086+13:16351:x1874392853394816:12345-192.168.203.29@tcp:35:umount.0 00000001:00080000:2.0:1787560838.365661:0:17176:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1787560838.365756:0:17176:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:2.0:1787560838.365921:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeaba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a5945945-1487-49fd-bee0-0dcced27d086+16:16351:x1874392853394816:12345-192.168.203.29@tcp:35:umount.0 Request processed in 682us (990us total) trans 8589934626 rc 0/0 00000100:00100000:2.0:1787560838.365932:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 13 00000020:00080000:2.0:1787560838.365938:0:17176:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787560838.379731:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560838.379794:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560838.380915:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560838.391995:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560838.392065:0:19050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853395328 00000100:00100000:1.0:1787560838.392078:0:19050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853395328 00000100:00100000:1.0:1787560838.392152:0:19050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 36 00000100:00100000:1.0:1787560838.392163:0:19050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5945945-1487-49fd-bee0-0dcced27d086+5:2401:x1874392853395328:12345-192.168.203.29@tcp:9:umount.0 00000020:00000080:1.0:1787560838.392213:0:19050:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f352ec 00000100:00080000:1.0:1787560838.392225:0:19050:0:(import.c:65:import_set_state_nolock()) ffff9caec429d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787560838.392300:0:19050:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1787560838.392732:0:19050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5945945-1487-49fd-bee0-0dcced27d086+2:2401:x1874392853395328:12345-192.168.203.29@tcp:9:umount.0 Request processed in 567us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560838.392742:0:19050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 36 00010000:00010000:1.0:1787560838.392956:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560838.397477:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853395072 00000100:00100000:3.0:1787560838.397501:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853395072 00000100:00100000:3.0:1787560838.397793:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853394944 00000100:00100000:3.0:1787560838.397798:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853394944 00000100:00100000:3.0:1787560838.397816:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853395200 00000100:00100000:3.0:1787560838.397819:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853395200 00000100:00100000:3.0:1787560838.397843:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:3.0:1787560838.397931:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2f47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+15:2402:x1874392853395072:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560838.397951:0:17160:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560838.397999:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f352d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060042 expref: 15 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560838.398024:0:17160:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560838.398119:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2f47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+14:2402:x1874392853395072:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 266us (18403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560838.398128:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:1.0:1787560838.398153:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:3.0:1787560838.398166:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:1.0:1787560838.398170:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafefdc9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6b1eeed-a176-422e-91d7-2f6f77b2967a+13:2402:x1874392853394944:12345-192.168.203.29@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787560838.398180:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec4abd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+13:2402:x1874392853395200:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560838.398183:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560838.398193:0:17160:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560838.398199:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffcbff000/0x4642c20bf2f352c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060011 expref: 13 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560838.398211:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafda2f7800/0x4642c20bf2f35355 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460600f8 expref: 13 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560838.398213:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787560838.398228:0:17160:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560838.398244:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafefdc9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6b1eeed-a176-422e-91d7-2f6f77b2967a+11:2402:x1874392853394944:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 81us (18449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560838.398253:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:3.0:1787560838.398257:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec4abd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6b1eeed-a176-422e-91d7-2f6f77b2967a+11:2402:x1874392853395200:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 79us (17346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560838.398281:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:1.0:1787560838.407220:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560838.407386:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853396224 00000100:00100000:2.0:1787560838.407402:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853396224 00000100:00100000:2.0:1787560838.407510:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 67 00000100:00100000:2.0:1787560838.407523:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5945945-1487-49fd-bee0-0dcced27d086+16:2401:x1874392853396224:12345-192.168.203.29@tcp:39:umount.0 00000020:00000080:2.0:1787560838.407588:0:18203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f352de 00000020:00010000:2.0:1787560838.407671:0:18203:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9caec4299800: total 0 00000100:00080000:2.0:1787560838.407678:0:18203:0:(import.c:65:import_set_state_nolock()) ffff9caec429f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787560838.407719:0:18203:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000020:00010000:1.0:1787560838.407990:0:17162:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9caec4299800: total 0 00010000:00010000:1.0:1787560838.408062:0:17162:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9caec4299800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1787560838.408106:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cafe14b4300) 00010000:00010000:1.0:1787560838.408111:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560838.408120:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f7400/0x4642c20bf2f353c5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060106 expref: 17 pid: 18203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560838.408149:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafe14b4800) 00010000:00010000:1.0:1787560838.408152:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787560838.408157:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6400/0x4642c20bf2f35404 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060114 expref: 16 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560838.408170:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:1.0:1787560838.408187:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787560838.408192:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48c00/0x4642c20bf2f355ee lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601b5 expref: 15 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560838.408208:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cafd8703800) 00010000:00010000:1.0:1787560838.408211:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787560838.408214:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177800/0x4642c20bf2f35593 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060192 expref: 14 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560838.408231:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cafe14b4f00) 00010000:00010000:1.0:1787560838.408233:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787560838.408237:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafda2f6c00/0x4642c20bf2f353a9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460600ff expref: 13 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560838.408251:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cafe14b4400) 00010000:00010000:1.0:1787560838.408253:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787560838.408257:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49800/0x4642c20bf2f35489 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606013e expref: 12 pid: 18203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560838.408272:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:1.0:1787560838.408274:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787560838.408278:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ff400/0x4642c20bf2f35538 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606017d expref: 11 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560838.408289:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9caec1e6b900) 00010000:00010000:1.0:1787560838.408292:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787560838.408295:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfe400/0x4642c20bf2f35507 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060168 expref: 10 pid: 17175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560838.408322:0:17162:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9caec4299800, canceled 8 locks, left on hash table 0. 00010000:00010000:1.0:1787560838.408336:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560838.408338:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560838.408340:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560838.408520:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5945945-1487-49fd-bee0-0dcced27d086+6:2401:x1874392853396224:12345-192.168.203.29@tcp:39:umount.0 Request processed in 999us (1319us total) trans 8589934627 rc 0/0 00000100:00100000:2.0:1787560838.408543:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 67 00000100:00100000:1.0:1787560838.423128:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560838.423301:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853396352 00000100:00100000:0.0:1787560838.423317:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853396352 00000100:00100000:0.0:1787560838.423420:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 68 00000100:00100000:0.0:1787560838.423492:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5945945-1487-49fd-bee0-0dcced27d086+5:2401:x1874392853396352:12345-192.168.203.29@tcp:39:umount.0 00000020:00000080:0.0:1787560838.423560:0:17175:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f352e5 00000100:00080000:0.0:1787560838.423584:0:17175:0:(import.c:65:import_set_state_nolock()) ffff9caec4039000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787560838.423631:0:17175:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1787560838.423949:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5945945-1487-49fd-bee0-0dcced27d086+3:2401:x1874392853396352:12345-192.168.203.29@tcp:39:umount.0 Request processed in 516us (839us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787560838.423959:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 68 00010000:00010000:2.0:1787560838.424726:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560838.708098:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560839.221132:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560839.221165:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862913536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787560839.221266:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560839.221392:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862913536 00000100:00100000:1.0:1787560839.221403:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862913536 00000100:00100000:1.0:1787560839.221532:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787560839.221546:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862913536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787560839.221588:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787560839.221649:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862913536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560839.221657:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1787560839.221828:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560839.221874:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862913536:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787560839.731890:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560840.758562:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560840.772259:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560840.772305:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560840.772500:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560840.773264:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853396480 00000100:00100000:2.0:1787560840.773280:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853396480 00000100:00100000:2.0:1787560840.773374:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853396736 00000100:00100000:2.0:1787560840.773378:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853396736 00000100:00100000:2.0:1787560840.773393:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853396608 00000100:00100000:2.0:1787560840.773395:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853396608 00000100:00100000:2.0:1787560840.773594:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:2.0:1787560840.773619:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6b1eeed-a176-422e-91d7-2f6f77b2967a+12:2402:x1874392853396480:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560840.773639:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560840.773665:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca48800/0x4642c20bf2f35308 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060081 expref: 12 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560840.773689:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560840.773758:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6b1eeed-a176-422e-91d7-2f6f77b2967a+11:2402:x1874392853396480:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 144us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560840.773766:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:2.0:1787560840.773787:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:2.0:1787560840.773793:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaa8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6b1eeed-a176-422e-91d7-2f6f77b2967a+10:2402:x1874392853396736:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560840.773802:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560840.773811:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafda2f7600/0x4642c20bf2f3534e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460600f1 expref: 10 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560840.773821:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560840.773962:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaa8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6b1eeed-a176-422e-91d7-2f6f77b2967a+9:2402:x1874392853396736:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 168us (1656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560840.773969:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:2.0:1787560840.773983:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:2.0:1787560840.773989:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcaa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6b1eeed-a176-422e-91d7-2f6f77b2967a+8:2402:x1874392853396608:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560840.773997:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560840.774007:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafda2f6600/0x4642c20bf2f3530f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460600b2 expref: 8 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560840.774029:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560840.774048:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcaa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6b1eeed-a176-422e-91d7-2f6f77b2967a+7:2402:x1874392853396608:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 59us (1549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560840.774055:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:1.0:1787560840.785286:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560840.785877:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853396992 00000100:00100000:2.0:1787560840.785891:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853396992 00000100:00100000:2.0:1787560840.785997:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 69 00000100:00100000:2.0:1787560840.786012:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffba2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1b0149ea-e230-42a7-990a-2401127b7ffb+6:2401:x1874392853396992:12345-192.168.203.29@tcp:39:umount.0 00000020:00000080:2.0:1787560840.786071:0:19968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f35324 00000020:00010000:2.0:1787560840.786082:0:19968:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9caec4038000: total 0 00000100:00080000:2.0:1787560840.786087:0:19968:0:(import.c:65:import_set_state_nolock()) ffff9caec4038800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787560840.786123:0:19968:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000020:00010000:1.0:1787560840.786137:0:17161:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9caec4038000: total 0 00010000:00010000:1.0:1787560840.786142:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560840.786209:0:17161:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9caec4038000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787560840.786262:0:17161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafe14b4800) 00010000:00010000:1.0:1787560840.786266:0:17161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787560840.786276:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48000/0x4642c20bf2f35412 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606011b expref: 5 pid: 18203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560840.786325:0:17161:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9caec4038000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787560840.786339:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560840.786340:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560840.786342:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560840.786390:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffba2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1b0149ea-e230-42a7-990a-2401127b7ffb+3:2401:x1874392853396992:12345-192.168.203.29@tcp:39:umount.0 Request processed in 381us (1118us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1787560840.786399:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 69 00000100:00080000:3.0:1787560840.790044:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560840.804699:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560840.805083:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853397120 00000100:00100000:0.0:1787560840.805097:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853397120 00000100:00080000:3.0:1787560840.805160:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787560840.805196:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 70 00000100:00100000:0.0:1787560840.805210:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffba2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b0149ea-e230-42a7-990a-2401127b7ffb+5:2401:x1874392853397120:12345-192.168.203.29@tcp:39:umount.0 00000020:00000080:0.0:1787560840.805267:0:17173:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f3531d 00000100:00080000:0.0:1787560840.805278:0:17173:0:(import.c:65:import_set_state_nolock()) ffff9cafc58bf800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787560840.805985:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1787560840.806085:0:17173:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1787560840.806291:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffba2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1b0149ea-e230-42a7-990a-2401127b7ffb+3:2401:x1874392853397120:12345-192.168.203.29@tcp:39:umount.0 Request processed in 1082us (1602us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787560840.807775:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 70 00000100:00100000:0.0:1787560840.919169:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560840.919297:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853397376 00000100:00100000:2.0:1787560840.919313:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853397376 00000100:00100000:2.0:1787560840.919733:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 181 00000100:00100000:2.0:1787560840.919749:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+7:2401:x1874392853397376:12345-192.168.203.29@tcp:251:umount.0 00000020:00000080:2.0:1787560840.919817:0:17166:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f352bb 00000020:00010000:2.0:1787560840.919829:0:17166:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9caec2d3b000: total 0 00000100:00080000:2.0:1787560840.919835:0:17166:0:(import.c:65:import_set_state_nolock()) ffff9caec2d3d000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787560840.919957:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6b1eeed-a176-422e-91d7-2f6f77b2967a+3:2401:x1874392853397376:12345-192.168.203.29@tcp:251:umount.0 Request processed in 212us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560840.919966:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 181 00000020:00010000:0.0:1787560840.924863:0:17928:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9caec2d3b000: total 0 00010000:00010000:0.0:1787560840.924986:0:17928:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9caec2d3b000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787560840.925056:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafda2f7c00/0x4642c20bf2f352c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606000a expref: 2 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560840.925081:0:17928:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9caec2d3b000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1787560840.925094:0:17928:0:(genops.c:885:class_export_put()) final put ffff9caec2d3b000/a6b1eeed-a176-422e-91d7-2f6f77b2967a 00010000:00010000:0.0:1787560840.925117:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560840.925120:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560840.925122:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787560840.925780:0:15403:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec2d3b000/a6b1eeed-a176-422e-91d7-2f6f77b2967a for MGS 00000020:00000080:3.0:1787560840.925840:0:15403:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec2d3d000 for MGS 00010000:00010000:1.0:1787560841.785778:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560842.293935:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862913664:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560842.294034:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560842.294101:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff7694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862914176:0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.294131:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560842.294158:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff7696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862914688:0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.294178:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560842.294205:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff7696680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862915200:0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.294232:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560842.294258:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1787560842.294264:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862913792:0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.294294:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560842.294317:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff7694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862914304:0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.294340:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560842.294358:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff7695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862914816:0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.294378:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560842.294395:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff7696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874392862915328:0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.294417:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560842.294485:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff4b99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862914048:0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.294533:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560842.294555:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff7695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862914560:0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.294578:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560842.294594:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff7697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862915072:0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.294612:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560842.294632:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1787560842.294638:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862913920:0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.294663:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560842.294681:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff7694000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862914432:0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.294707:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560842.294724:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff7696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862914944:0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.294745:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560842.294765:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff7697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862915456:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787560842.294786:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560842.294815:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862913664 00000100:00100000:0.0:1787560842.294822:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862913664 00000100:00100000:0.0:1787560842.294870:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862915456 00000100:00100000:0.0:1787560842.294873:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862915456 00000100:00100000:0.0:1787560842.294894:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787560842.294902:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff7695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862913664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787560842.294932:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787560842.294976:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff7695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862913664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560842.294983:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787560842.295003:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787560842.295010:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862915456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787560842.295027:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787560842.295058:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862915456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560842.295063:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787560842.295082:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862914176 00000100:00100000:0.0:1787560842.295085:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862914176 00000100:00100000:0.0:1787560842.295104:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862914688 00000100:00100000:0.0:1787560842.295107:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862914688 00000100:00100000:0.0:1787560842.295116:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862914048 00000100:00100000:0.0:1787560842.295118:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862914048 00000100:00100000:0.0:1787560842.295130:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862914560 00000100:00100000:0.0:1787560842.295133:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862914560 00000100:00100000:0.0:1787560842.295144:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787560842.295150:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff7697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862914176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.295195:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff7697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862914176:12345-0@lo:400:kworker.0 Request processed in 45us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560842.295203:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787560842.295215:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787560842.295221:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff7695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862914688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.295250:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff7695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862914688:12345-0@lo:400:kworker.0 Request processed in 29us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560842.295255:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787560842.295266:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787560842.295270:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862914048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.295307:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862914048:12345-0@lo:400:kworker.0 Request processed in 36us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560842.295313:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787560842.295324:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787560842.295330:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862914560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.295352:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862914560:12345-0@lo:400:kworker.0 Request processed in 23us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560842.295357:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787560842.295378:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862913792 00000100:00100000:0.0:1787560842.295381:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862913792 00000100:00100000:0.0:1787560842.295406:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787560842.295411:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:3625:x1874392862913792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.295461:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:3625:x1874392862913792:12345-0@lo:400:kworker.0 Request processed in 49us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560842.295466:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787560842.295510:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862915200 00000100:00100000:0.0:1787560842.295515:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862915200 00000100:00100000:0.0:1787560842.295536:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862914304 00000100:00100000:0.0:1787560842.295538:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862914304 00000100:00100000:0.0:1787560842.295548:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862914816 00000100:00100000:0.0:1787560842.295551:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862914816 00000100:00100000:0.0:1787560842.295560:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862915328 00000100:00100000:0.0:1787560842.295562:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862915328 00000100:00100000:0.0:1787560842.295571:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862915072 00000100:00100000:0.0:1787560842.295573:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862915072 00000100:00100000:0.0:1787560842.295584:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862914944 00000100:00100000:0.0:1787560842.295586:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862914944 00000100:00100000:0.0:1787560842.295599:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787560842.295605:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff7695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862915200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.295637:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff7695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862915200:12345-0@lo:400:kworker.0 Request processed in 32us (1404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560842.295643:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787560842.295656:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787560842.295662:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff7697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862914304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.295687:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff7697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862914304:12345-0@lo:400:kworker.0 Request processed in 26us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560842.295694:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787560842.295706:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787560842.295712:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff7694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862914816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.295737:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff7694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862914816:12345-0@lo:400:kworker.0 Request processed in 26us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560842.295743:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787560842.295754:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787560842.295760:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff7694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874392862915328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.295795:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff7694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1874392862915328:12345-0@lo:400:kworker.0 Request processed in 35us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560842.295801:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787560842.295813:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787560842.295819:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862915072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.295846:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862915072:12345-0@lo:400:kworker.0 Request processed in 27us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560842.295851:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787560842.295863:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787560842.295869:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862914944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.295895:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862914944:12345-0@lo:400:kworker.0 Request processed in 26us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560842.295900:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787560842.295935:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862913920 00000100:00100000:0.0:1787560842.295940:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862913920 00000100:00100000:0.0:1787560842.295964:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862914432 00000100:00100000:0.0:1787560842.295967:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862914432 00000100:00100000:0.0:1787560842.295979:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787560842.295985:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862913920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.296017:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862913920:12345-0@lo:400:kworker.0 Request processed in 32us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560842.296023:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787560842.296034:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787560842.296040:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafefdc3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862914432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.296067:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafefdc3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862914432:12345-0@lo:400:kworker.0 Request processed in 27us (1359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560842.296082:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787560842.296354:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862913792:0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.296369:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff7694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862914304:0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.296379:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff7695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862914816:0@lo:400:kworker.0 00010000:00080000:0.0:1787560842.296391:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caff7696a00 x1874392862915328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560842.296402:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff7696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874392862915328:0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.296419:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862913664:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560842.296453:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff7694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862914176:0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.296465:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff7696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862914688:0@lo:400:kworker.0 00000100:00100000:0.0:1787560842.296475:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff7696680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862915200:0@lo:400:kworker.0 00000100:00080000:3.0:1787560842.296848:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787560842.296863:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787560842.296865:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787560842.296867:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787560842.297761:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787560842.297790:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862915584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787560842.297841:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560842.299168:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862913920:0@lo:400:kworker.0 00000100:00100000:1.0:1787560842.299186:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff7694000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862914432:0@lo:400:kworker.0 00000100:00100000:1.0:1787560842.299200:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff7696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862914944:0@lo:400:kworker.0 00000100:00100000:1.0:1787560842.299225:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff7697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862915456:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787560842.299242:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff4b99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862914048:0@lo:400:kworker.0 00000100:00100000:1.0:1787560842.299252:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff7695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862914560:0@lo:400:kworker.0 00010000:00080000:1.0:1787560842.299265:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caff7697480 x1874392862915072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560842.299275:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff7697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862915072:0@lo:400:kworker.0 00000100:00100000:3.0:1787560842.299454:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862915584 00000100:00100000:3.0:1787560842.299462:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862915584 00000100:00100000:3.0:1787560842.299527:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787560842.299538:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffba2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862915584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787560842.299561:0:18687:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787560842.299835:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffba2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862915584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 298us (1992us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560842.299843:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787560842.300818:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862915584:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1787560842.613207:0:17927:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:3.0:1787560842.698295:0:20749:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1787560842.711008:0:20749:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1787560842.711068:0:20749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec2168000/0x4642c20bf2f34e7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34e85 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.711082:0:20749:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec2168000/0x4642c20bf2f34e7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f34e85 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.711089:0:20749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec2168000/0x4642c20bf2f34e7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f34e85 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.711096:0:20749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9caec2168000/0x4642c20bf2f34e7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f34e85 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.711111:0:20749:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787560842.711116:0:20749:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787560842.711138:0:20749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787560842.711142:0:20749:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787560842.711160:0:20749:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787560842.711183:0:20749:0:(import.c:65:import_set_state_nolock()) ffff9cafd0868000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787560842.711218:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874392862915712:0@lo:39:umount.0 00000100:00100000:3.0:1787560842.711283:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560842.711337:0:18203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862915712 00000100:00100000:3.0:1787560842.711345:0:18203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862915712 00000100:00100000:3.0:1787560842.711389:0:18203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787560842.711398:0:18203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1874392862915712:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787560842.711425:0:18203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34eaf 00000100:00080000:3.0:1787560842.711453:0:18203:0:(import.c:65:import_set_state_nolock()) ffff9cafd086f000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787560842.711533:0:18203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3622:x1874392862915712:12345-0@lo:39:umount.0 Request processed in 135us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560842.711541:0:18203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:3.0:1787560842.711551:0:18203:0:(genops.c:885:class_export_put()) final put ffff9caec2fc4000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1787560842.711579:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560842.711585:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caec2168000/0x4642c20bf2f34e7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f34e85 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.711593:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168000 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560842.711597:0:17928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caec2168000/0x4642c20bf2f34e7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f34e85 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.711606:0:17928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caec2168000/0x4642c20bf2f34e7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f34e85 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560842.711613:0:17928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caec2168000/0x4642c20bf2f34e7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f34e85 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560842.711620:0:17928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787560842.711629:0:17928:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787560842.711631:0:17928:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787560842.711662:0:17928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caec2168000/0x4642c20bf2f34e7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f34e85 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.711669:0:17928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560842.711694:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caec2168000/0x4642c20bf2f34e7e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f34e85 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.711701:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caec2168000/0x4642c20bf2f34e7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f34e85 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.711713:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560842.711715:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560842.711717:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787560842.711729:0:15403:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec2fc4000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787560842.712142:0:15403:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cafd086f000 for lustre-MDT0000 00000100:00100000:1.0:1787560842.712159:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787560842.712177:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2007b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f08f2f56-c18f-4579-88a9-05007f76ffc9:3626:1874392862915840:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787560842.712194:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafd0868000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787560842.712202:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874392862915712:0@lo:39:umount.0 00000100:00100000:1.0:1787560842.712220:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787560842.712228:0:20749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787560842.712232:0:20749:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787560842.712237:0:20749:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787560842.713931:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560842.713957:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862915840 00000100:00100000:2.0:1787560842.713968:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862915840 00000100:00100000:2.0:1787560842.714033:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787560842.714043:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffba2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+24:3626:x1874392862915840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787560842.714058:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560842.714077:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cb0021fee00/0x4642c20bf2f34e85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4642c20bf2f34e7e expref: 24 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560842.714093:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560842.714163:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffba2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+23:3626:x1874392862915840:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (1943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560842.714171:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787560842.714221:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2007b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f08f2f56-c18f-4579-88a9-05007f76ffc9:3626:1874392862915840:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787560842.715371:0:20749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb002177c00/0x4642c20bf2f34dcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34dd6 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.715385:0:20749:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb002177c00/0x4642c20bf2f34dcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f34dd6 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.715393:0:20749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb002177c00/0x4642c20bf2f34dcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f34dd6 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.715419:0:20749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9cb002177c00/0x4642c20bf2f34dcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f34dd6 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.715465:0:20749:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560842.715473:0:20749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f351e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f351e9 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.715480:0:20749:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f351e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f351e9 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.715487:0:20749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f351e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f351e9 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.715493:0:20749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f351e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f351e9 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.715521:0:20749:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787560842.715537:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787560842.715543:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cb002177c00/0x4642c20bf2f34dcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f34dd6 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.715550:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb002177c00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560842.715554:0:17928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cb002177c00/0x4642c20bf2f34dcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f34dd6 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.715563:0:17928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cb002177c00/0x4642c20bf2f34dcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f34dd6 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560842.715571:0:17928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cb002177c00/0x4642c20bf2f34dcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f34dd6 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560842.715582:0:17928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787560842.715585:0:17928:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1787560842.715611:0:17928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cb002177c00/0x4642c20bf2f34dcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f34dd6 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.715617:0:17928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560842.715633:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cb002177c00/0x4642c20bf2f34dcf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f34dd6 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.715639:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cb002177c00/0x4642c20bf2f34dcf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f34dd6 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.715649:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560842.715652:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f351e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f351e9 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.715657:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ffe00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560842.715660:0:17928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f351e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f351e9 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.715665:0:17928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f351e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f351e9 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560842.715670:0:17928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f351e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f351e9 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560842.715675:0:17928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787560842.715677:0:17928:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787560842.715679:0:17928:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787560842.715698:0:17928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f351e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f351e9 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.715704:0:17928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560842.715723:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f351e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f351e9 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.715729:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffe00/0x4642c20bf2f351e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f351e9 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.715737:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560842.715739:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560842.715741:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560842.715749:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787560842.715764:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862915968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560842.715804:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787560842.715823:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f08f2f56-c18f-4579-88a9-05007f76ffc9:3624:1874392862916096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560842.715876:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787560842.716688:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560842.717200:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862916096 00000100:00100000:0.0:1787560842.717210:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862916096 00000100:00100000:0.0:1787560842.717323:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787560842.717334:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffba2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f08f2f56-c18f-4579-88a9-05007f76ffc9+23:3624:x1874392862916096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787560842.717349:0:17160:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560842.717366:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cb0021ff800/0x4642c20bf2f351e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4642c20bf2f351e2 expref: 23 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560842.717380:0:17160:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560842.717396:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560842.717420:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffba2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f08f2f56-c18f-4579-88a9-05007f76ffc9+22:3624:x1874392862916096:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (1544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560842.717460:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787560842.717508:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f08f2f56-c18f-4579-88a9-05007f76ffc9:3624:1874392862916096:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787560842.721547:0:20749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35386 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3538d expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.721564:0:20749:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35386 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f3538d expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.721570:0:20749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35386 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f3538d expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.721576:0:20749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35386 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f3538d expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.721596:0:20749:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560842.721603:0:20749:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb002177a00/0x4642c20bf2f34dc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34dc8 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.721629:0:20749:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb002177a00/0x4642c20bf2f34dc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f34dc8 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.721635:0:20749:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb002177a00/0x4642c20bf2f34dc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f34dc8 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.721642:0:20749:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9cb002177a00/0x4642c20bf2f34dc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f34dc8 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.721657:0:20749:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787560842.721661:0:20749:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1787560842.721666:0:20749:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1787560842.721700:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787560842.721706:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35386 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f3538d expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.721712:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49e00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560842.721715:0:17928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35386 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f3538d expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.721723:0:17928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35386 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f3538d expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560842.721729:0:17928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35386 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f3538d expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560842.721735:0:17928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787560842.721737:0:17928:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787560842.721738:0:17928:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787560842.721997:0:17928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35386 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f3538d expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.722005:0:17928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560842.722033:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35386 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f3538d expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.722040:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35386 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f3538d expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.722053:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560842.722057:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cb002177a00/0x4642c20bf2f34dc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f34dc8 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.722062:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb002177a00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560842.722065:0:17928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cb002177a00/0x4642c20bf2f34dc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f34dc8 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.722072:0:17928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cb002177a00/0x4642c20bf2f34dc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f34dc8 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560842.722078:0:17928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cb002177a00/0x4642c20bf2f34dc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f34dc8 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560842.722083:0:17928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787560842.722085:0:17928:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787560842.722087:0:17928:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787560842.722100:0:17928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cb002177a00/0x4642c20bf2f34dc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f34dc8 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.722106:0:17928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560842.722119:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cb002177a00/0x4642c20bf2f34dc1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f34dc8 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.722131:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cb002177a00/0x4642c20bf2f34dc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f34dc8 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560842.722143:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560842.722145:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560842.722146:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560842.722167:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862916352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787560842.722225:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1787560842.722263:0:20749:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1787560842.722268:0:20749:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1787560842.722273:0:20749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787560842.722279:0:20749:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1787560842.722285:0:20749:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9caec429e000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787560842.722291:0:20749:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9caec2fc8000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787560842.722295:0:20749:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9cafeabcb800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787560842.722299:0:20749:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9cafeabcd000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787560842.722306:0:20749:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9caec4038000 1b0149ea-e230-42a7-990a-2401127b7ffb 192.168.203.29@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:3.0:1787560842.722312:0:20749:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9caec4299800 a5945945-1487-49fd-bee0-0dcced27d086 192.168.203.29@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:3.0:1787560842.722316:0:20749:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9caec2d00000) has exports, disconnecting them 00000020:00080000:3.0:1787560842.722321:0:20749:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9caec429e000), last request at 1787560842 00000020:00000080:3.0:1787560842.722328:0:20749:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f351b1 00000100:00080000:3.0:1787560842.722344:0:20749:0:(import.c:65:import_set_state_nolock()) ffff9caec429c800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787560842.722388:0:20749:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9caec429e000): rc 0 00000020:00000080:3.0:1787560842.722391:0:20749:0:(genops.c:885:class_export_put()) final put ffff9caec429e000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1787560842.722407:0:20749:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9caec2fc8000), last request at 1787560842 00000020:00000080:3.0:1787560842.722410:0:20749:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f3504c 00000100:00080000:3.0:1787560842.722416:0:20749:0:(import.c:65:import_set_state_nolock()) ffff9caec2fcc000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1787560842.722450:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec429e000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787560842.722489:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec429c800 for lustre-MDT0000 00010000:00010000:3.0:1787560842.722516:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787560842.722525:0:20749:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9caec2fc8000): rc 0 00000020:00000080:3.0:1787560842.722527:0:20749:0:(genops.c:885:class_export_put()) final put ffff9caec2fc8000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1787560842.722534:0:20749:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9cafeabcb800), last request at 1787560760 00000020:00000080:3.0:1787560842.722538:0:20749:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34f9d 00000100:00080000:3.0:1787560842.722541:0:20749:0:(import.c:65:import_set_state_nolock()) ffff9cafeabc8800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1787560842.722550:0:15403:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec2fc8000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787560842.722573:0:15403:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec2fcc000 for lustre-MDT0000 00010000:00010000:3.0:1787560842.722581:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787560842.722588:0:20749:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cafeabcb800): rc 0 00000020:00000080:3.0:1787560842.722590:0:20749:0:(genops.c:885:class_export_put()) final put ffff9cafeabcb800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1787560842.722597:0:20749:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9cafeabcd000), last request at 1787560760 00000020:00000080:3.0:1787560842.722601:0:20749:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34f42 00000100:00080000:3.0:1787560842.722604:0:20749:0:(import.c:65:import_set_state_nolock()) ffff9cafeabcc000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1787560842.722614:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafeabcb800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787560842.722640:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cafeabc8800 for lustre-MDT0000 00010000:00010000:3.0:1787560842.722649:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1787560842.722656:0:20749:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:3.0:1787560842.722737:0:20749:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cafeabcd000): rc 0 00000004:00000080:3.0:1787560842.722743:0:20749:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb6db41a3fae0 00000100:00080000:3.0:1787560842.723282:0:20749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787560842.723287:0:20749:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00100000:1.0:1787560842.723699:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f08f2f56-c18f-4579-88a9-05007f76ffc9:3624:1874392862916224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560842.723765:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787560842.725114:0:20749:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787560842.725149:0:20749:0:(import.c:65:import_set_state_nolock()) ffff9caffba9c000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787560842.725204:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862916480:0@lo:39:umount.0 00000100:00100000:3.0:1787560842.725262:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560842.725319:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862916480 00000100:00100000:3.0:1787560842.725326:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862916480 00000100:00100000:3.0:1787560842.725369:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787560842.725378:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1874392862916480:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787560842.725405:0:17179:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34fc7 00000100:00080000:3.0:1787560842.725413:0:17179:0:(import.c:65:import_set_state_nolock()) ffff9cafeabca800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787560842.725454:0:17179:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1787560842.725591:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3622:x1874392862916480:12345-0@lo:39:umount.0 Request processed in 212us (329us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1787560842.725598:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00010000:3.0:1787560842.725624:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560842.726922:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560842.726941:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862916352 00000100:00100000:1.0:1787560842.726948:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862916352 00000100:00100000:1.0:1787560842.726995:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862916224 00000100:00100000:1.0:1787560842.726998:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862916224 00000100:00100000:1.0:1787560842.727017:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787560842.727026:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2007b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+23:3625:x1874392862916352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560842.727040:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787560842.727057:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862915968 00010000:00010000:1.0:1787560842.727062:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cb0021ff600/0x4642c20bf2f34dc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4642c20bf2f34dc1 expref: 23 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560842.727065:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862915968 00010000:00010000:1.0:1787560842.727082:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560842.727105:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787560842.727114:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffba2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f08f2f56-c18f-4579-88a9-05007f76ffc9+23:3624:x1874392862916224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787560842.727124:0:17160:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560842.727137:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafda2f6000/0x4642c20bf2f3538d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4642c20bf2f35386 expref: 23 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560842.727146:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2007b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+23:3625:x1874392862916352:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (4918us total) trans 0 rc 0/0 00010000:00010000:0.0:1787560842.727151:0:17160:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560842.727158:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787560842.727178:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787560842.727186:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafefdca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:3625:x1874392862915968:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560842.727194:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffba2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f08f2f56-c18f-4579-88a9-05007f76ffc9+21:3624:x1874392862916224:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (3427us total) trans 0 rc 0/0 00010000:00010000:1.0:1787560842.727195:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787560842.727205:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1787560842.727209:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cb0021fe400/0x4642c20bf2f34dd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4642c20bf2f34dcf expref: 21 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560842.727222:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560842.727252:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f08f2f56-c18f-4579-88a9-05007f76ffc9:3624:1874392862916224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560842.727268:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafefdca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f08f2f56-c18f-4579-88a9-05007f76ffc9+19:3625:x1874392862915968:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (9870us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560842.727276:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787560842.727365:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862916352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560842.727374:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862915968:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787560842.727407:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffba9c000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787560842.727415:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862916480:0@lo:39:umount.0 00000100:00080000:0.0:1787560842.728812:0:20749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787560842.728823:0:20749:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1787560842.728847:0:20749:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787560842.728919:0:20749:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787560842.728947:0:20749:0:(import.c:65:import_set_state_nolock()) ffff9caec3380800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787560842.728965:0:20749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787560842.728967:0:20749:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1787560842.728973:0:20749:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787560842.729037:0:20749:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787560842.729046:0:20749:0:(import.c:65:import_set_state_nolock()) ffff9caec32fd800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787560842.729090:0:20749:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9caec2d00000) has no exports 00010000:00010000:3.0:1787560842.732514:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560842.732753:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862916608:0@lo:9:umount.0 00000100:00100000:0.0:1787560842.732847:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560842.732896:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862916736:0@lo:9:umount.0 00000100:00100000:0.0:1787560842.732922:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560842.732963:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862916608 00000100:00100000:0.0:1787560842.732970:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862916608 00000100:00100000:0.0:1787560842.733024:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862916736 00000100:00100000:0.0:1787560842.733028:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862916736 00000100:00100000:0.0:1787560842.733054:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787560842.733064:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1874392862916608:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787560842.733089:0:18684:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f35092 00000100:00080000:0.0:1787560842.733098:0:18684:0:(import.c:65:import_set_state_nolock()) ffff9caec231b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787560842.733148:0:18684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1787560842.733265:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3622:x1874392862916608:12345-0@lo:9:umount.0 Request processed in 203us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560842.733272:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787560842.733287:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787560842.733292:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1874392862916736:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787560842.733304:0:18684:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f351f0 00000100:00080000:0.0:1787560842.733321:0:18684:0:(import.c:65:import_set_state_nolock()) ffff9caec2d3e000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787560842.733343:0:18684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1787560842.733422:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3622:x1874392862916736:12345-0@lo:9:umount.0 Request processed in 130us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560842.733446:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:0.0:1787560842.733465:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787560842.733490:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec3380800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787560842.733516:0:3622:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787560842.733519:0:3622:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787560842.733523:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862916608:0@lo:9:umount.0 00000100:00080000:0.0:1787560842.733546:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec32fd800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787560842.733558:0:3622:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00010000:00010000:3.0:1787560842.733561:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787560842.733561:0:3622:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787560842.733565:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862916736:0@lo:9:umount.0 00000020:00080000:3.0:1787560842.741801:0:20749:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9caec2d00000) has no exports 00010000:00010000:0.0:1787560842.803598:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560842.804667:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862916864:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787560842.804742:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560842.804998:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862916864 00000100:00100000:2.0:1787560842.805005:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862916864 00000100:00100000:2.0:1787560842.805049:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787560842.805058:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3626:x1874392862916864:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1787560842.805066:0:17178:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787560842.805152:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3626:x1874392862916864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (418us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787560842.805159:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000020:00000080:3.0:1787560842.809353:0:20749:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34e1c 00000020:00000080:3.0:1787560842.809368:0:20749:0:(genops.c:885:class_export_put()) final put ffff9caec3387800/lustre-QMT0000_UUID 00000020:01000000:3.0:1787560842.809506:0:20749:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787560842.809641:0:20749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787560842.809654:0:20749:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787560842.809659:0:20749:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9caec2d019b8) has no exports 00000100:02020000:1.0:1787560842.809712:0:3626:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000020:00000080:0.0:1787560842.810161:0:20749:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34e15 00000020:00000080:0.0:1787560842.810168:0:20749:0:(genops.c:885:class_export_put()) final put ffff9caec21e9800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787560842.810311:0:15403:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec3387800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787560842.810401:0:15403:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec21e9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00080000:1.0:1787560842.819270:0:3626:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787560842.819280:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9caffbb0b800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787560842.819285:0:3626:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000020:00000080:0.0:1787560842.819819:0:20749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787560842.820022:0:20749:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787560842.820031:0:20749:0:(genops.c:885:class_export_put()) final put ffff9caffba9f000/lustre-QMT0000_UUID 00000020:00000080:0.0:1787560842.820035:0:20749:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffba9f000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787560842.820047:0:20749:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00080000:1.0:1787560842.841855:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9caffbb0b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787560842.841872:0:3626:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 479 00000100:00080000:1.0:1787560842.841883:0:3626:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9caffbb0b800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787560842.841924:0:3626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffba2c000 x1874392862916992/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787560842.842048:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862916992:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787560842.842130:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560842.842638:0:18389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862916992 00000100:00100000:1.0:1787560842.842648:0:18389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862916992 00000100:00100000:1.0:1787560842.842774:0:18389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787560842.842784:0:18389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3622:x1874392862916992:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1787560842.842807:0:18389:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787560842.845914:0:18389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3622:x1874392862916992:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 3121us (3774us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787560842.845930:0:18389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1787560842.846009:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffbb0b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787560842.846015:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787560842.846019:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862916992:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:0.0:1787560843.829192:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560844.851967:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787560844.854058:0:17907:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787560844.854074:0:17907:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:1.0:1787560844.854080:0:17907:0:(genops.c:885:class_export_put()) final put ffff9cafc68d2000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787560844.854158:0:17907:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1b0149ea-e230-42a7-990a-2401127b7ffb 00000001:00080000:1.0:1787560844.854169:0:17907:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:1.0:1787560844.854172:0:17907:0:(genops.c:885:class_export_put()) final put ffff9cafc58b9800/1b0149ea-e230-42a7-990a-2401127b7ffb 00000001:00100000:1.0:1787560844.854178:0:17907:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a5945945-1487-49fd-bee0-0dcced27d086 00000001:00080000:1.0:1787560844.854182:0:17907:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:1.0:1787560844.854184:0:17907:0:(genops.c:885:class_export_put()) final put ffff9caec403b800/a5945945-1487-49fd-bee0-0dcced27d086 00000020:00000080:2.0:1787560844.855872:0:15403:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafc68d2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1787560844.856014:0:15403:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafc58b9800/1b0149ea-e230-42a7-990a-2401127b7ffb for lustre-MDT0001 00000020:00000080:2.0:1787560844.856051:0:15403:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec403b800/a5945945-1487-49fd-bee0-0dcced27d086 for lustre-MDT0001 00000020:00000080:2.0:1787560844.856080:0:15403:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cafeabca800 for lustre-MDT0001 00000020:00000080:2.0:1787560844.856087:0:15403:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cafc58bf800 for lustre-MDT0001 00000020:00000080:2.0:1787560844.856091:0:15403:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec4039000 for lustre-MDT0001 00000001:00100000:1.0:1787560844.857524:0:17153:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787560844.857534:0:17153:0:(genops.c:885:class_export_put()) final put ffff9cafeabcd000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1787560844.857624:0:17153:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1b0149ea-e230-42a7-990a-2401127b7ffb 00000001:00080000:1.0:1787560844.857635:0:17153:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:1.0:1787560844.857639:0:17153:0:(genops.c:885:class_export_put()) final put ffff9caec4038000/1b0149ea-e230-42a7-990a-2401127b7ffb 00000020:00000080:0.0:1787560844.860216:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafeabcd000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1787560844.860296:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cafeabcc000 for lustre-MDT0000 00000001:00100000:1.0:1787560844.860549:0:17153:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a5945945-1487-49fd-bee0-0dcced27d086 00000001:00080000:1.0:1787560844.860558:0:17153:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:1.0:1787560844.860565:0:17153:0:(genops.c:885:class_export_put()) final put ffff9caec4299800/a5945945-1487-49fd-bee0-0dcced27d086 00000001:00100000:3.0:1787560844.862759:0:18679:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787560844.862772:0:18679:0:(genops.c:885:class_export_put()) final put ffff9caec231e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787560844.866063:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec4038000/1b0149ea-e230-42a7-990a-2401127b7ffb for lustre-MDT0000 00000020:00000080:0.0:1787560844.866140:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec4038800 for lustre-MDT0000 00000020:00000080:0.0:1787560844.869508:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec4299800/a5945945-1487-49fd-bee0-0dcced27d086 for lustre-MDT0000 00000020:00000080:0.0:1787560844.869567:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec429f800 for lustre-MDT0000 00000001:00100000:3.0:1787560844.871602:0:18679:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a5945945-1487-49fd-bee0-0dcced27d086 00000020:00000080:3.0:1787560844.871615:0:18679:0:(genops.c:885:class_export_put()) final put ffff9caec429a000/a5945945-1487-49fd-bee0-0dcced27d086 00000020:00000080:2.0:1787560844.875176:0:15403:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec231e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787560844.875295:0:15403:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec231b800 for lustre-OST0000 00000020:00000080:0.0:1787560844.875666:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec429a000/a5945945-1487-49fd-bee0-0dcced27d086 for lustre-OST0000 00000020:00000080:0.0:1787560844.875753:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec429d000 for lustre-OST0000 00010000:00010000:0.0:1787560845.878023:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560846.899991:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787560847.411943:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787560847.411952:0:15403:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787560847.411956:0:15403:0:(import.c:65:import_set_state_nolock()) ffff9caffbb0b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787560847.411966:0:15403:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 562 00000100:00080000:2.0:1787560847.411974:0:15403:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787560847.411983:0:15403:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9caffbb0b800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787560847.412193:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862917376:0@lo:400:kworker.0 00000100:00100000:1.0:1787560847.412286:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560847.414183:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862917120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787560847.414291:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560847.414364:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787560847.414373:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862917248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787560847.414424:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560847.414539:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862917120 00000100:00100000:3.0:1787560847.414550:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862917120 00000100:00100000:3.0:1787560847.414622:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862917248 00000100:00100000:3.0:1787560847.414626:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862917248 00000100:00100000:3.0:1787560847.414648:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787560847.414659:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3baf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862917120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787560847.414701:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787560847.414759:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3baf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862917120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560847.414766:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787560847.414788:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787560847.414794:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862917248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787560847.414813:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787560847.414840:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862917248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560847.414846:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1787560847.414864:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787560847.414869:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787560847.414918:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862917248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787560847.414934:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862917120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787560847.414985:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862917376 00000100:00100000:3.0:1787560847.414990:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862917376 00000100:00100000:3.0:1787560847.416203:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787560847.416222:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffdf55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+19:3625:x1874392862917376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560847.416325:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffdf55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f08f2f56-c18f-4579-88a9-05007f76ffc9+19:3625:x1874392862917376:12345-0@lo:400:kworker.0 Request processed in 109us (4039us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560847.416351:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787560847.416590:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862917376:0@lo:400:kworker.0 00000100:00100000:2.0:1787560847.416816:0:15403:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafc46e9f80 x1874392862917504/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787560847.416931:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874392862917760:0@lo:400:kworker.0 00000100:00100000:2.0:1787560847.416987:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560847.417111:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862917504:0@lo:38:kworker.0 00000100:00100000:1.0:1787560847.417150:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560847.417212:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862917504 00000100:00100000:1.0:1787560847.417219:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862917504 00000100:00100000:1.0:1787560847.417256:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787560847.417263:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffba2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1874392862917504:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1787560847.417285:0:17179:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787560847.419839:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787560847.419858:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862917888:0@lo:400:kworker.0 00000100:00100000:2.0:1787560847.419929:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560847.419974:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862917760 00000100:00100000:2.0:1787560847.419983:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862917760 00000100:00100000:2.0:1787560847.420094:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862917888 00000100:00100000:2.0:1787560847.420097:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862917888 00000100:00100000:2.0:1787560847.420141:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787560847.420152:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862917888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560847.420234:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862917888:12345-0@lo:400:kworker.0 Request processed in 84us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560847.420243:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787560847.420263:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787560847.420268:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3623:x1874392862917760:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787560847.420274:0:17173:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787560847.420300:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3623:x1874392862917760:12345-0@lo:400:kworker.0 Request processed in 31us (3315us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787560847.420306:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:2.0:1787560847.420350:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cafc46eaa00 x1874392862917888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560847.420367:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862917888:0@lo:400:kworker.0 00000100:00080000:2.0:1787560847.420381:0:3623:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787560847.420386:0:3623:0:(import.c:65:import_set_state_nolock()) ffff9caec403a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787560847.420390:0:3623:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1787560847.420496:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862917632:0@lo:400:kworker.0 00000100:00100000:3.0:1787560847.420534:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560847.420563:0:19968:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862917632 00000100:00100000:3.0:1787560847.420567:0:19968:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862917632 00000100:00100000:3.0:1787560847.420590:0:19968:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787560847.420595:0:19968:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3626:x1874392862917632:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787560847.420600:0:19968:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787560847.420626:0:19968:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3626:x1874392862917632:12345-0@lo:400:kworker.0 Request processed in 30us (93us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787560847.420632:0:19968:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1787560847.420660:0:3626:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787560847.420663:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9caffbb08800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787560847.420667:0:3626:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787560847.420672:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9caffbb08800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787560847.420676:0:3626:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 480 00000100:00080000:3.0:1787560847.420683:0:3626:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9caffbb08800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560847.420707:0:3626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caec3bace00 x1874392862918016/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787560847.420735:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862917632:0@lo:400:kworker.0 00000100:00100000:3.0:1787560847.420834:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862918272:0@lo:400:kworker.0 00000100:00100000:3.0:1787560847.420858:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560847.420877:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787560847.420883:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862918144:0@lo:400:kworker.0 00000100:00100000:3.0:1787560847.420915:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560847.420946:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862918272 00000100:00100000:3.0:1787560847.420950:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862918272 00000100:00100000:3.0:1787560847.420977:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862918144 00000100:00100000:3.0:1787560847.420980:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862918144 00000100:00100000:3.0:1787560847.420995:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787560847.421862:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862918272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560847.421954:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862918272:12345-0@lo:400:kworker.0 Request processed in 953us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560847.421965:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787560847.424563:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787560847.424591:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3626:x1874392862918144:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787560847.424604:0:17174:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787560847.424721:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3626:x1874392862918144:12345-0@lo:400:kworker.0 Request processed in 138us (3803us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787560847.424729:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1787560847.424803:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787560847.424857:0:3626:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787560847.424864:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9caec4299000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787560847.424868:0:3626:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787560847.424875:0:3626:0:(import.c:65:import_set_state_nolock()) ffff9caec4299000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787560847.424880:0:3626:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 515 00000100:00080000:3.0:1787560847.424889:0:3626:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9caec4299000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560847.424931:0:3626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caec407f100 x1874392862918400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787560847.424954:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862918144:0@lo:400:kworker.0 00010000:00080000:3.0:1787560847.425330:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec407dc00 x1874392862918272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560847.425345:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862918272:0@lo:400:kworker.0 00000100:00100000:3.0:1787560847.426638:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874392862918016:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1787560847.426742:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560847.426787:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1874392862918400:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1787560847.426811:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560847.426858:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862918016 00000100:00100000:3.0:1787560847.426870:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862918016 00000100:00100000:3.0:1787560847.426914:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862918400 00000100:00100000:3.0:1787560847.426918:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862918400 00000100:00100000:3.0:1787560847.426935:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787560847.426943:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1874392862918016:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1787560847.426968:0:17173:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787560847.429346:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1874392862918016:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 2386us (2589us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787560847.429369:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787560847.429419:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787560847.429427:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1874392862918400:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1787560847.429476:0:17173:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787560847.429527:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1874392862918400:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 100us (2715us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787560847.429534:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1787560847.429617:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffbb08800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787560847.429625:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787560847.429630:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874392862918016:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1787560847.429666:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec4299000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787560847.429670:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787560847.429674:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1874392862918400:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1787560847.430274:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffba2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1874392862917504:12345-0@lo:38:kworker.0 Request processed in 13008us (13121us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787560847.430284:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1787560847.430563:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffbb0b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787560847.430569:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787560847.430572:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862917504:0@lo:38:kworker.0 00000100:00080000:2.0:1787560847.455115:0:3623:0:(import.c:65:import_set_state_nolock()) ffff9caec403a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787560847.455132:0:3623:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 496 00000100:00080000:2.0:1787560847.455146:0:3623:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9caec403a800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560847.455200:0:3623:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafc46e9500 x1874392862918528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787560847.455239:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874392862917760:0@lo:400:kworker.0 00000100:00100000:3.0:1787560847.455619:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1874392862918528:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787560847.455713:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560847.455842:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862918528 00000100:00100000:0.0:1787560847.455853:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862918528 00000100:00100000:0.0:1787560847.455907:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787560847.455917:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1874392862918528:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1787560847.455942:0:17175:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787560847.456013:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1874392862918528:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 96us (300us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787560847.456022:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1787560847.457967:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec403a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787560847.457981:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787560847.457987:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1874392862918528:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:0.0:1787560847.924673:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787560848.446693:0:19498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787560848.446715:0:19498:0:(genops.c:885:class_export_put()) final put ffff9caec2d3c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787560848.446830:0:15403:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec2d3c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787560848.446925:0:15403:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec2d3e000 for lustre-OST0001 00000020:01000000:0.0:1787560848.883625:0:20749:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9caec21094e0 - data ffff9caec18f71b0/ffff9caff766b000 00000020:01000000:0.0:1787560848.883805:0:20749:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9caec327e1e0 - data ffff9cb0000ca438/ffff9caff509fc00 00000001:00000004:0.0:1787560848.889966:0:20749:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00010000:00010000:3.0:1787560848.947746:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787560848.965263:0:20749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787560848.965276:0:20749:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787560848.965297:0:20749:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9caec3bafb80 x1874392862916480/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787560852 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560848.965332:0:20749:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1787560848.972811:0:20749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787560848.972822:0:20749:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:1.0:1787560848.973394:0:20749:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787560848.973399:0:20749:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787560848.975178:0:17197:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787560848.975188:0:17197:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:2.0:1787560848.975203:0:17197:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1787560848.976131:0:20749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787560848.976139:0:20749:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:1.0:1787560848.976165:0:20749:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787560848.976169:0:20749:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787560848.976702:0:17199:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787560848.976708:0:17199:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:2.0:1787560848.976721:0:17199:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1787560848.978145:0:20749:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34de4 00000020:00000080:1.0:1787560848.978160:0:20749:0:(genops.c:885:class_export_put()) final put ffff9caec3381000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787560848.980204:0:20749:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34df9 00000020:00000080:1.0:1787560848.980219:0:20749:0:(genops.c:885:class_export_put()) final put ffff9caec3212000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787560848.980229:0:20749:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1787560848.980234:0:20749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787560848.980245:0:20749:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787560848.980250:0:20749:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9cafeabd19b8) has no exports 00000020:00000080:2.0:1787560848.980722:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec3381000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787560848.980734:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec3212000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1787560848.981235:0:20749:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787560848.981250:0:20749:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34e5b 00000020:00000080:1.0:1787560848.981260:0:20749:0:(genops.c:885:class_export_put()) final put ffff9cafffe05800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787560848.981272:0:20749:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787560848.981278:0:20749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787560848.981286:0:20749:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787560848.981290:0:20749:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9caffb994d28) has no exports 00000020:00000080:1.0:1787560848.981312:0:20749:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34e54 00000020:00000080:1.0:1787560848.981316:0:20749:0:(genops.c:885:class_export_put()) final put ffff9cafc81ec800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787560848.981646:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafffe05800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787560848.981656:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafc81ec800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787560848.982006:0:20749:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787560848.982011:0:20749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787560848.982018:0:20749:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1787560848.982025:0:20749:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787560848.982028:0:20749:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787560848.982120:0:20749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787560848.982131:0:20749:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787560848.982139:0:20749:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34e46 00000020:00000080:1.0:1787560848.982146:0:20749:0:(genops.c:885:class_export_put()) final put ffff9caec21ed800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787560848.983822:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec32fd800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787560848.983841:0:8:0:(genops.c:885:class_export_put()) final put ffff9caec21e8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787560848.983845:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec21e8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1787560848.983856:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787560848.984123:0:20749:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787560848.984131:0:20749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787560848.984144:0:20749:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787560848.984149:0:20749:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9caec2d03370) has no exports 00000020:00000080:1.0:1787560848.984159:0:20749:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34e3f 00000020:00000080:1.0:1787560848.984168:0:20749:0:(genops.c:885:class_export_put()) final put ffff9caec21ea000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787560848.984863:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec21ed800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1787560848.985850:0:20749:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787560848.985857:0:20749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787560848.985862:0:20749:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:1.0:1787560848.985871:0:20749:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787560848.985875:0:20749:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787560848.986314:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec21ea000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787560848.986726:0:20749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787560848.986739:0:20749:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1787560848.986761:0:20749:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787560848.986770:0:20749:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34e31 00000020:00000080:1.0:1787560848.986783:0:20749:0:(genops.c:885:class_export_put()) final put ffff9caec21ec800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787560848.986809:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec3380800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787560848.986817:0:8:0:(genops.c:885:class_export_put()) final put ffff9caec21e9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787560848.986820:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec21e9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787560848.986825:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787560848.987306:0:20749:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1787560848.987311:0:20749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787560848.987317:0:20749:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787560848.987322:0:20749:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9cafeabd3370) has no exports 00000020:00000080:3.0:1787560848.987399:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec21ec800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1787560848.987632:0:20749:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34e2a 00000020:00000080:1.0:1787560848.987653:0:20749:0:(genops.c:885:class_export_put()) final put ffff9caffba9e800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787560848.988004:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffba9e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787560849.011673:0:20749:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1787560849.011687:0:20749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787560849.011693:0:20749:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787560849.011704:0:20749:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787560849.011771:0:20749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787560849.011788:0:20749:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787560849.011824:0:20749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787560849.011828:0:20749:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787560849.011835:0:20749:0:(genops.c:885:class_export_put()) final put ffff9caec3387000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787560849.011841:0:20749:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec3387000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787560849.011853:0:20749:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787560849.011990:0:20749:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34e00 00000020:00000080:2.0:1787560849.011998:0:20749:0:(genops.c:885:class_export_put()) final put ffff9caec3211000/lustre-MDD0000_UUID 00000020:01000000:2.0:1787560849.012004:0:20749:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787560849.012008:0:20749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787560849.012014:0:20749:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787560849.012019:0:20749:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9caec2d04d28) has no exports 00000020:00000080:2.0:1787560849.012044:0:20749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787560849.012047:0:20749:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787560849.012051:0:20749:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34e07 00000020:00000080:2.0:1787560849.012055:0:20749:0:(genops.c:885:class_export_put()) final put ffff9caec3212800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787560849.012067:0:20749:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9caffff56000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787560849.012071:0:20749:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9caffff56000 3 00000020:01000004:2.0:1787560849.012075:0:20749:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9caffff56000 from lustre-MDT0000 00000020:00000080:2.0:1787560849.012095:0:20749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787560849.012098:0:20749:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787560849.012101:0:20749:0:(genops.c:885:class_export_put()) final put ffff9caffba98800/lustre-MDT0000_UUID 00000020:00000080:2.0:1787560849.012103:0:20749:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffba98800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787560849.012109:0:20749:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787560849.012136:0:20749:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1787560849.012140:0:20749:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787560849.012143:0:20749:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787560849.012145:0:20749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787560849.012148:0:20749:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787560849.012155:0:20749:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9caec2f9c000 f08f2f56-c18f-4579-88a9-05007f76ffc9 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787560849.012161:0:20749:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9cafeabd4d28) has exports, disconnecting them 00000020:00080000:2.0:1787560849.012165:0:20749:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9caec2f9c000), last request at 1787560742 00000020:00000080:2.0:1787560849.012179:0:20749:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34dac 00000020:00010000:2.0:1787560849.012183:0:20749:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9caec2f9c000: total 2 00000100:00080000:2.0:1787560849.012187:0:20749:0:(import.c:65:import_set_state_nolock()) ffff9caec2f9c800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787560849.012206:0:20749:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9caec2f9c000): rc 0 00000020:00080000:2.0:1787560849.012210:0:20749:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9cafeabd4d28) has no exports 00000020:00000080:3.0:1787560849.012284:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caffba9c000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787560849.012294:0:8:0:(genops.c:885:class_export_put()) final put ffff9caec3385800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787560849.012296:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec3385800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1787560849.012303:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787560849.012387:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec3211000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787560849.012391:0:8:0:(genops.c:885:class_export_put()) final put ffff9caffba9d800/lustre-MDD0000_UUID 00000020:00000080:3.0:1787560849.012393:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffba9d800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787560849.012405:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1787560849.012475:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec3212800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1787560849.012516:0:17166:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9cafeab2d800:17166] 0 exiting: rc = 1 00000100:00100000:2.0:1787560849.015724:0:17167:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9cafe3ecb400:17167] 1 exiting: rc = 0 00000100:00100000:2.0:1787560849.015880:0:17168:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9cafe3ecac00:17168] 2 exiting: rc = 0 00000100:00100000:3.0:1787560849.016013:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016025:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016032:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016040:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016046:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016053:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016060:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016066:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016072:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016080:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016086:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016093:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016099:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016105:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016111:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016118:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016123:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016130:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016136:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016143:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016148:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016154:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016160:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016166:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016172:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016178:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016184:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016190:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016196:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016202:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016209:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016225:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016231:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016239:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016246:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016251:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016257:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016263:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016269:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016275:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016281:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016286:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016292:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016297:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016303:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016308:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016313:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016319:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016325:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016332:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016339:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016345:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016352:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016358:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016364:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016370:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016377:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016384:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016390:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016396:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016401:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016407:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016414:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560849.016420:0:20749:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1787560849.017962:0:20749:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9caec3881000/0x4642c20bf2f34ecb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x4642c20bf2f34ec4 expref: 14 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560849.018014:0:20749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caec3881000/0x4642c20bf2f34ecb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x4642c20bf2f34ec4 expref: 14 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560849.018034:0:20749:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9caec3880a00/0x4642c20bf2f34dba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x4642c20bf2f34db3 expref: 13 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560849.018044:0:20749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caec3880a00/0x4642c20bf2f34dba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x4642c20bf2f34db3 expref: 13 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560849.018054:0:20749:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9caec3881a00/0x4642c20bf2f34ee7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x4642c20bf2f34ee0 expref: 12 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560849.018062:0:20749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caec3881a00/0x4642c20bf2f34ee7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x4642c20bf2f34ee0 expref: 12 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560849.018072:0:20749:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9cb0021fec00/0x4642c20bf2f34f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x4642c20bf2f34f81 expref: 11 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560849.018081:0:20749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cb0021fec00/0x4642c20bf2f34f88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x4642c20bf2f34f81 expref: 11 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560849.018090:0:20749:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9cb0021ff000/0x4642c20bf2f3500d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x4642c20bf2f35006 expref: 10 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560849.018098:0:20749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cb0021ff000/0x4642c20bf2f3500d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x4642c20bf2f35006 expref: 10 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560849.018106:0:20749:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9caec3880200/0x4642c20bf2f35037 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x4642c20bf2f35030 expref: 9 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560849.018126:0:20749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caec3880200/0x4642c20bf2f35037 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x4642c20bf2f35030 expref: 9 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560849.018135:0:20749:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9caffcbff200/0x4642c20bf2f35172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x4642c20bf2f3516b expref: 8 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560849.018142:0:20749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffcbff200/0x4642c20bf2f35172 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x4642c20bf2f3516b expref: 8 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560849.018150:0:20749:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9cafda2f7a00/0x4642c20bf2f3519c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x4642c20bf2f35195 expref: 7 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560849.018157:0:20749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafda2f7a00/0x4642c20bf2f3519c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x4642c20bf2f35195 expref: 7 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560849.018168:0:20749:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9caffca48a00/0x4642c20bf2f351db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x4642c20bf2f351d4 expref: 6 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560849.018176:0:20749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca48a00/0x4642c20bf2f351db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x4642c20bf2f351d4 expref: 6 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560849.018187:0:20749:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9cb002177400/0x4642c20bf2f34ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x4642c20bf2f34ed2 expref: 5 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560849.018196:0:20749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cb002177400/0x4642c20bf2f34ed9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x4642c20bf2f34ed2 expref: 5 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560849.018208:0:20749:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9caffca48e00/0x4642c20bf2f35363 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x4642c20bf2f3535c expref: 4 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560849.018228:0:20749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca48e00/0x4642c20bf2f35363 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x4642c20bf2f3535c expref: 4 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560849.018237:0:20749:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f35371 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x4642c20bf2f3536a expref: 3 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560849.018245:0:20749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f35371 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x4642c20bf2f3536a expref: 3 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560849.018254:0:20749:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9caffca49000/0x4642c20bf2f3537f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x4642c20bf2f35378 expref: 2 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560849.018262:0:20749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca49000/0x4642c20bf2f3537f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x4642c20bf2f35378 expref: 2 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:1.0:1787560849.023730:0:17162:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9caec2f9c000: total 0 00010000:00010000:1.0:1787560849.023832:0:17162:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9caec2f9c000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1787560849.023851:0:17162:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9caec2f9c000, canceled 0 locks, left on hash table 0. 00000020:00000080:1.0:1787560849.023863:0:17162:0:(genops.c:885:class_export_put()) final put ffff9caec2f9c000/f08f2f56-c18f-4579-88a9-05007f76ffc9 00010000:00010000:1.0:1787560849.023948:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560849.023951:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560849.023954:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787560849.026684:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec2f9c000/f08f2f56-c18f-4579-88a9-05007f76ffc9 for MGS 00000020:00000080:3.0:1787560849.026767:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec2f9c800 for MGS 00010000:00010000:3.0:1787560849.975255:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560850.999704:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787560851.060148:0:20749:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9caec1ee2ea0 - data ffff9caec1837438/ffff9caff53b3800 00000020:01000000:3.0:1787560851.060368:0:20749:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9caec39589c0 - data ffff9cb0001bcaf8/ffff9caff3149400 00000020:00000080:3.0:1787560851.061026:0:20749:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34d90 00000020:00000080:3.0:1787560851.061038:0:20749:0:(genops.c:885:class_export_put()) final put ffff9caec402f800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787560851.061068:0:20749:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9caffff56000 from MGS, refs=2 00000020:01000004:3.0:1787560851.061073:0:20749:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9caffff56000 2 00000020:01000004:3.0:1787560851.061077:0:20749:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9caffff56000 from MGS 00000020:00000080:3.0:1787560851.061103:0:20749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787560851.061112:0:20749:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1787560851.061115:0:20749:0:(genops.c:885:class_export_put()) final put ffff9caec402b800/MGS 00000020:00000080:3.0:1787560851.061118:0:20749:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec402b800/MGS for MGS 00000020:01000000:3.0:1787560851.061144:0:20749:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1787560851.061233:0:20749:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1787560851.061238:0:20749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787560851.061246:0:20749:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787560851.061255:0:20749:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9caec2fc2000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787560851.061262:0:20749:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9caec2fb0000) has exports, disconnecting them 00000020:00080000:3.0:1787560851.061269:0:20749:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9caec2fc2000), last request at 1787560743 00000020:00000080:3.0:1787560851.061274:0:20749:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34e93 00000020:00080000:3.0:1787560851.061285:0:20749:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9caec2fc2000): rc 0 00000020:00000080:3.0:1787560851.061291:0:20749:0:(genops.c:885:class_export_put()) final put ffff9caec2fc2000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787560851.062962:0:15403:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec402f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787560851.062994:0:15403:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec2fc2000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1787560851.063036:0:20749:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1787560851.063042:0:20749:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787560851.063047:0:20749:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787560851.063054:0:20749:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787560851.063297:0:20749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787560851.063309:0:20749:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1787560851.063317:0:20749:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9caffff56000 1 00000020:00000080:1.0:1787560851.063325:0:20749:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34d82 00000020:00000080:1.0:1787560851.063336:0:20749:0:(genops.c:885:class_export_put()) final put ffff9caec402d800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1787560851.063343:0:20749:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1787560851.063350:0:20749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787560851.063356:0:20749:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787560851.063362:0:20749:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9caff490b370) has no exports 00000020:00000080:2.0:1787560851.066286:0:15403:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cafd0868000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787560851.066313:0:15403:0:(genops.c:885:class_export_put()) final put ffff9caffc904000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787560851.066318:0:15403:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffc904000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787560851.066339:0:15403:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1787560851.066506:0:15403:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec402d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787560851.160940:0:20749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787560851.160958:0:20749:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787560851.160965:0:20749:0:(genops.c:885:class_export_put()) final put ffff9caffff53000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787560851.160971:0:20749:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffff53000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787560851.160983:0:20749:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787560851.161255:0:20749:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9caffff50000 00000020:02000400:0.0:1787560851.161338:0:20749:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1787560852.019708:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787560852.531740:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787560852.531750:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:2.0:1787560852.531750:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862918656:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787560852.531755:0:8:0:(import.c:65:import_set_state_nolock()) ffff9caffbb0b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787560852.531762:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 566 00000100:00080000:3.0:1787560852.531768:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787560852.531777:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9caffbb0b800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560852.531804:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caec407d880 x1874392862918912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787560852.531843:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787560852.531855:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787560852.531857:0:8:0:(import.c:65:import_set_state_nolock()) ffff9caffbb08800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787560852.531861:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 566 00000100:00080000:3.0:1787560852.531864:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:2.0:1787560852.531867:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787560852.531868:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9caffbb08800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560852.531879:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caec3badc00 x1874392862919296/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787560852.531940:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787560852.531947:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f08f2f56-c18f-4579-88a9-05007f76ffc9:3623:1874392862918784:0@lo:400:kworker.0 00000400:00000100:2.0:1787560852.531971:0:3623:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874392862918784 offset 0 length 224: 4 00000100:00100000:2.0:1787560852.532001:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862918912:0@lo:38:kworker.0 00000100:00100000:2.0:1787560852.532031:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787560852.532502:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787560852.532507:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787560852.532509:0:8:0:(import.c:65:import_set_state_nolock()) ffff9caec403a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787560852.532514:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 566 00000100:00080000:3.0:1787560852.532516:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787560852.532530:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9caec403a800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560852.532550:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffcbbaa00 x1874392862919424/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787560852.532577:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787560852.532580:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787560852.532582:0:8:0:(import.c:65:import_set_state_nolock()) ffff9caec4299000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787560852.532586:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 566 00000100:00080000:3.0:1787560852.532589:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787560852.532593:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9caec4299000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560852.532605:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffcbb9180 x1874392862919680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787560852.532637:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874392862919808:0@lo:400:kworker.0 00000100:00100000:3.0:1787560852.532681:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560852.532707:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787560852.532713:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862919552:0@lo:400:kworker.0 00000100:00100000:3.0:1787560852.532736:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560852.532762:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862919040:0@lo:400:kworker.0 00000100:00100000:3.0:1787560852.532789:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560852.532819:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787560852.532826:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862919168:0@lo:400:kworker.0 00000100:00100000:3.0:1787560852.533317:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560852.533359:0:18686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862918656 00000100:00100000:3.0:1787560852.533371:0:18686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862918656 00000100:00100000:3.0:1787560852.533494:0:18686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787560852.533507:0:18686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862918656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787560852.533567:0:18686:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787560852.533623:0:18686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862918656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (1756us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560852.533631:0:18686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787560852.533665:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862918912 00000100:00100000:3.0:1787560852.533670:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862918912 00000100:00100000:3.0:1787560852.533707:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787560852.533714:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1874392862918912:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787560852.533739:0:17178:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787560852.536594:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874392862919296:0@lo:38:kworker.0 00000100:00100000:2.0:1787560852.536718:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560852.536778:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1874392862919424:0@lo:38:kworker.0 00000100:00100000:2.0:1787560852.536803:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560852.536841:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1874392862919680:0@lo:38:kworker.0 00000100:00100000:2.0:1787560852.536866:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560852.536921:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862919808 00000100:00100000:2.0:1787560852.536934:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862919808 00000100:00100000:2.0:1787560852.536999:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862919552 00000100:00100000:2.0:1787560852.537003:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862919552 00000100:00100000:2.0:1787560852.537018:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862919296 00000100:00100000:2.0:1787560852.537022:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862919296 00000100:00100000:2.0:1787560852.537032:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862919424 00000100:00100000:2.0:1787560852.537056:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862919424 00000100:00100000:2.0:1787560852.537068:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862919680 00000100:00100000:2.0:1787560852.537071:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862919680 00000100:00100000:2.0:1787560852.537085:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787560852.537096:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874392862919808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560852.537178:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874392862919808:12345-0@lo:400:kworker.0 Request processed in 84us (4496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560852.537186:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787560852.537206:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787560852.537212:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862919552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560852.537258:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862919552:12345-0@lo:400:kworker.0 Request processed in 46us (4521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560852.537264:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787560852.537296:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787560852.537301:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1874392862919296:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787560852.537327:0:17175:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787560852.537366:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1874392862919296:12345-0@lo:38:kworker.0 Request processed in 63us (649us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787560852.537373:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787560852.537404:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787560852.537409:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1874392862919424:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787560852.537481:0:17175:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787560852.537538:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1874392862919424:12345-0@lo:38:kworker.0 Request processed in 127us (733us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787560852.537545:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787560852.537557:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787560852.537589:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1874392862919680:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787560852.537601:0:17175:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787560852.537627:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1874392862919680:12345-0@lo:38:kworker.0 Request processed in 39us (760us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787560852.537634:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:2.0:1787560852.537696:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9caffcbbb100 x1874392862919552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560852.537718:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862919552:0@lo:400:kworker.0 00010000:00080000:2.0:1787560852.537734:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9caffcbb8700 x1874392862919808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560852.537744:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874392862919808:0@lo:400:kworker.0 00000100:00080000:2.0:1787560852.537811:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffbb08800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787560852.537818:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787560852.537834:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3badc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874392862919296:0@lo:38:kworker.0 00000100:00080000:2.0:1787560852.537844:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec403a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787560852.537847:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787560852.537866:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1874392862919424:0@lo:38:kworker.0 00000100:00080000:2.0:1787560852.537877:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec4299000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787560852.537881:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787560852.537884:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1874392862919680:0@lo:38:kworker.0 00000100:00100000:0.0:1787560852.538521:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862919040 00000100:00100000:0.0:1787560852.538531:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862919040 00000100:00100000:0.0:1787560852.538584:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862919168 00000100:00100000:0.0:1787560852.538589:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862919168 00000100:00100000:0.0:1787560852.538635:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787560852.538645:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862919040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560852.538726:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862919040:12345-0@lo:400:kworker.0 Request processed in 83us (5936us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560852.538733:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787560852.538749:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787560852.538755:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862919168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560852.538786:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862919168:12345-0@lo:400:kworker.0 Request processed in 31us (5469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560852.538791:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787560852.539068:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862918656:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787560852.540109:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787560852.540133:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862919936:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560852.540213:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560852.540266:0:20517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862919936 00000100:00100000:0.0:1787560852.540275:0:20517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862919936 00000100:00100000:0.0:1787560852.540327:0:20517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787560852.540337:0:20517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862919936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787560852.540382:0:20517:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787560852.540462:0:20517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862919936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 123us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560852.540469:0:20517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787560852.540521:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862919936:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787560852.546831:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787560852.546850:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787560852.546854:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787560852.551167:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862919168:0@lo:400:kworker.0 00000100:00100000:2.0:1787560852.551192:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862919040:0@lo:400:kworker.0 00000100:00100000:3.0:1787560852.579668:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1874392862918912:12345-0@lo:38:kworker.0 Request processed in 45936us (47618us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787560852.579690:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1787560852.579791:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffbb0b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787560852.579798:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787560852.579803:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862918912:0@lo:38:kworker.0 00000040:00080000:3.0:1787560852.855642:0:17927:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787560853.046868:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560854.074183:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560855.092255:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787560855.436006:0:20951:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1787560855.454652:0:20951:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1787560855.454712:0:20951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3881c00/0x4642c20bf2f34f81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34f88 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560855.454725:0:20951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3881c00/0x4642c20bf2f34f81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f34f88 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560855.454733:0:20951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3881c00/0x4642c20bf2f34f81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f34f88 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560855.454741:0:20951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9caec3881c00/0x4642c20bf2f34f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f34f88 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560855.454765:0:20951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787560855.454770:0:20951:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787560855.454792:0:20951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787560855.454797:0:20951:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787560855.454803:0:20951:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787560855.454809:0:20951:0:(import.c:65:import_set_state_nolock()) ffff9caffbb08800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1787560855.454813:0:20951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787560855.454815:0:20951:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787560855.454818:0:20951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787560855.455698:0:20951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f34ee0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34ee7 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560855.455713:0:20951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f34ee0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f34ee7 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560855.455720:0:20951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f34ee0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f34ee7 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560855.455741:0:20951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f34ee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f34ee7 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560855.455757:0:20951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787560855.455763:0:20951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbfea00/0x4642c20bf2f351d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f351db expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560855.455771:0:20951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbfea00/0x4642c20bf2f351d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f351db expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560855.455777:0:20951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbfea00/0x4642c20bf2f351d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f351db expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560855.455784:0:20951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9caffcbfea00/0x4642c20bf2f351d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f351db expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560855.455806:0:20951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787560855.455813:0:20951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7000/0x4642c20bf2f35378 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3537f expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560855.455820:0:20951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7000/0x4642c20bf2f35378 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f3537f expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560855.455825:0:20951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7000/0x4642c20bf2f35378 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f3537f expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560855.455831:0:20951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7000/0x4642c20bf2f35378 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f3537f expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560855.455849:0:20951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1787560855.455855:0:20951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec2168600/0x4642c20bf2f34ed2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f34ed9 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560855.455862:0:20951:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec2168600/0x4642c20bf2f34ed2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f34ed9 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560855.455869:0:20951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec2168600/0x4642c20bf2f34ed2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f34ed9 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560855.455874:0:20951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9caec2168600/0x4642c20bf2f34ed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f34ed9 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560855.455881:0:20951:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:0.0:1787560855.455884:0:20951:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1787560855.455908:0:20951:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1787560855.455913:0:20951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1787560855.455917:0:20951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787560855.455923:0:20951:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1787560855.455932:0:20951:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9cafc58bb000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787560855.455937:0:20951:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9caec231d000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787560855.455942:0:20951:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9caec2fb3370) has exports, disconnecting them 00000020:00080000:0.0:1787560855.455946:0:20951:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9cafc58bb000), last request at 1787560852 00000020:00000080:0.0:1787560855.455953:0:20951:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f351c6 00000100:00080000:0.0:1787560855.455968:0:20951:0:(import.c:65:import_set_state_nolock()) ffff9cafc58b8000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787560855.456015:0:20951:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cafc58bb000): rc 0 00000020:00000080:0.0:1787560855.456017:0:20951:0:(genops.c:885:class_export_put()) final put ffff9cafc58bb000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1787560855.456025:0:20951:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9caec231d000), last request at 1787560852 00000020:00000080:0.0:1787560855.456034:0:20951:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f35061 00000100:00080000:0.0:1787560855.456039:0:20951:0:(import.c:65:import_set_state_nolock()) ffff9caec231b000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787560855.456047:0:20951:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9caec231d000): rc 0 00000020:00000080:0.0:1787560855.456049:0:20951:0:(genops.c:885:class_export_put()) final put ffff9caec231d000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1787560855.456055:0:20951:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb6db41923ae0 00000100:00080000:0.0:1787560855.456070:0:20951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787560855.456079:0:20951:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9cafc46e9880 x1874392862916864/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787560858 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560855.456099:0:20951:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1787560855.456115:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862916864:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1787560855.456898:0:20951:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787560855.456904:0:20951:0:(import.c:65:import_set_state_nolock()) ffff9caffbb0b800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:3.0:1787560855.457006:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787560855.457015:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caec3881c00/0x4642c20bf2f34f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f34f88 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560855.457038:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881c00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560855.457042:0:17928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caec3881c00/0x4642c20bf2f34f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f34f88 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560855.457050:0:17928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caec3881c00/0x4642c20bf2f34f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f34f88 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560855.457057:0:17928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caec3881c00/0x4642c20bf2f34f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f34f88 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560855.457062:0:17928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787560855.457065:0:17928:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787560855.457068:0:17928:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787560855.457108:0:17928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caec3881c00/0x4642c20bf2f34f81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f34f88 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560855.457114:0:17928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560855.457146:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caec3881c00/0x4642c20bf2f34f81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f34f88 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560855.457153:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caec3881c00/0x4642c20bf2f34f81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f34f88 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560855.457165:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787560855.457168:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f34ee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f34ee7 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560855.457173:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021fe000 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560855.457176:0:17928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f34ee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f34ee7 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560855.457187:0:17928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f34ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f34ee7 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560855.457193:0:17928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f34ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f34ee7 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560855.457198:0:17928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787560855.457200:0:17928:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1787560855.457202:0:17928:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1787560855.457216:0:17928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f34ee0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f34ee7 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560855.457221:0:17928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560855.457237:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f34ee0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f34ee7 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560855.457244:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe000/0x4642c20bf2f34ee0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f34ee7 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560855.457253:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787560855.457256:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caffcbfea00/0x4642c20bf2f351d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f351db expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560855.457262:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbfea00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560855.457264:0:17928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caffcbfea00/0x4642c20bf2f351d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f351db expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560855.457271:0:17928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caffcbfea00/0x4642c20bf2f351d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f351db expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560855.457286:0:17928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caffcbfea00/0x4642c20bf2f351d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f351db expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560855.457292:0:17928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787560855.457294:0:17928:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787560855.457295:0:17928:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787560855.457307:0:17928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caffcbfea00/0x4642c20bf2f351d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f351db expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560855.457312:0:17928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560855.457318:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caffcbfea00/0x4642c20bf2f351d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f351db expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560855.457324:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caffcbfea00/0x4642c20bf2f351d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f351db expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560855.457337:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787560855.457341:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7000/0x4642c20bf2f35378 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f3537f expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560855.457346:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7000 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560855.457349:0:17928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7000/0x4642c20bf2f35378 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f3537f expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560855.457355:0:17928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7000/0x4642c20bf2f35378 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f3537f expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560855.457361:0:17928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7000/0x4642c20bf2f35378 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f3537f expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560855.457376:0:17928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787560855.457378:0:17928:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787560855.457380:0:17928:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787560855.457394:0:17928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7000/0x4642c20bf2f35378 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f3537f expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560855.457399:0:17928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560855.457405:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7000/0x4642c20bf2f35378 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f3537f expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560855.457421:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7000/0x4642c20bf2f35378 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f3537f expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560855.457460:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560855.457464:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caec2168600/0x4642c20bf2f34ed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f34ed9 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560855.457470:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec2168600 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560855.457473:0:17928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caec2168600/0x4642c20bf2f34ed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f34ed9 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560855.457480:0:17928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caec2168600/0x4642c20bf2f34ed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f34ed9 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560855.457486:0:17928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caec2168600/0x4642c20bf2f34ed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f34ed9 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560855.457491:0:17928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787560855.457493:0:17928:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787560855.457494:0:17928:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787560855.457514:0:17928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caec2168600/0x4642c20bf2f34ed2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f34ed9 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560855.457520:0:17928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560855.457525:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caec2168600/0x4642c20bf2f34ed2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f34ed9 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560855.457531:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caec2168600/0x4642c20bf2f34ed2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4642c20bf2f34ed9 expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560855.457542:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560855.457544:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560855.457546:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560855.457554:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787560855.457564:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafc58bb000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1787560855.457608:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec231d000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1787560855.457630:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cafc58b8000 for lustre-MDT0001 00000020:00000080:3.0:1787560855.457634:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec231b000 for lustre-MDT0001 00000100:00100000:3.0:1787560855.457651:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862920448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787560855.457735:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560855.457787:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787560855.457794:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862920064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787560855.457817:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560855.457833:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862920576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787560855.457852:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560855.457879:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f08f2f56-c18f-4579-88a9-05007f76ffc9:3623:1874392862920192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787560855.457902:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560855.457920:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560855.457932:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f08f2f56-c18f-4579-88a9-05007f76ffc9:3623:1874392862920320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787560855.457955:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560855.457986:0:17929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862920448 00000100:00100000:3.0:1787560855.457995:0:17929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862920448 00000100:00100000:3.0:1787560855.458028:0:17929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862920064 00000100:00100000:3.0:1787560855.458030:0:17929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862920064 00000100:00100000:3.0:1787560855.458037:0:17929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862920576 00000100:00100000:3.0:1787560855.458039:0:17929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862920576 00000100:00100000:3.0:1787560855.458046:0:17929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862920192 00000100:00100000:3.0:1787560855.458048:0:17929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862920192 00000100:00100000:3.0:1787560855.458054:0:17929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862920320 00000100:00100000:3.0:1787560855.458056:0:17929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862920320 00000100:00100000:3.0:1787560855.458067:0:17929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787560855.458076:0:17929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3625:x1874392862920448:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787560855.458084:0:17929:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787560855 with bad export cookie 5062822287694319020 00000100:00100000:2.0:1787560855.458732:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787560855.458739:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3625:x1874392862920064:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787560855.458752:0:17158:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787560855 with bad export cookie 5062822287694319020 00000100:00100000:2.0:1787560855.458825:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3625:x1874392862920064:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (1007us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787560855.458833:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787560855.458855:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787560855.458869:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3625:x1874392862920576:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787560855.458874:0:17158:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787560855 with bad export cookie 5062822287694319020 00000100:00100000:2.0:1787560855.458900:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3625:x1874392862920576:12345-0@lo:103:ldlm_bl.0 Request processed in 39us (1047us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787560855.458906:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787560855.458917:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787560855.458921:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3623:x1874392862920192:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787560855.458925:0:17158:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787560855 with bad export cookie 5062822287694319020 00000100:00100000:2.0:1787560855.458952:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3623:x1874392862920192:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (1050us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787560855.458958:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787560855.458969:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787560855.458973:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafefdc8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3623:x1874392862920320:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787560855.458978:0:17158:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787560855 with bad export cookie 5062822287694319020 00000100:00100000:2.0:1787560855.459001:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafefdc8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3623:x1874392862920320:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (1044us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787560855.459008:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787560855.459524:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787560855.463008:0:20951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787560855.463016:0:20951:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1787560855.463037:0:20951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787560855.463096:0:20951:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787560855.463124:0:20951:0:(import.c:65:import_set_state_nolock()) ffff9caffcbc6800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787560855.463141:0:20951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787560855.463143:0:20951:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1787560855.463160:0:20951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787560855.463214:0:20951:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787560855.463223:0:20951:0:(import.c:65:import_set_state_nolock()) ffff9cafc5251800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787560855.463259:0:20951:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9caec2fb3370) has no exports 00000100:00080000:2.0:1787560855.467284:0:3623:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.129@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787560855.467294:0:3623:0:(import.c:65:import_set_state_nolock()) ffff9cafd80ed800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1787560855.467299:0:3623:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.129@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:0.0:1787560855.468579:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862920704:0@lo:9:umount.0 00000100:00100000:0.0:1787560855.468659:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560855.468694:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862920832:0@lo:9:umount.0 00000100:00100000:0.0:1787560855.468717:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560855.468759:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862920704 00000100:00100000:0.0:1787560855.468777:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862920704 00000100:00100000:0.0:1787560855.468853:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862920832 00000100:00100000:0.0:1787560855.468857:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862920832 00000100:00100000:0.0:1787560855.468885:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787560855.468894:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1874392862920704:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787560855.468930:0:18685:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f3508b 00000100:00080000:0.0:1787560855.468940:0:18685:0:(import.c:65:import_set_state_nolock()) ffff9caec231c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787560855.468988:0:18685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1787560855.469227:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3622:x1874392862920704:12345-0@lo:9:umount.0 Request processed in 333us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560855.469234:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787560855.469250:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787560855.469257:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1874392862920832:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787560855.469269:0:18685:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f351f7 00000100:00080000:0.0:1787560855.469275:0:18685:0:(import.c:65:import_set_state_nolock()) ffff9caec2d39000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787560855.469300:0:18685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1787560855.470043:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3622:x1874392862920832:12345-0@lo:9:umount.0 Request processed in 782us (1320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560855.470052:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1787560855.470082:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787560855.470086:0:17169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787560855.470131:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffcbc6800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787560855.470149:0:3622:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787560855.470152:0:3622:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787560855.470156:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862920704:0@lo:9:umount.0 00000100:00080000:0.0:1787560855.470167:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafc5251800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787560855.470184:0:3622:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787560855.470185:0:3622:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787560855.470187:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862920832:0@lo:9:umount.0 00010000:00010000:1.0:1787560855.486314:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560855.486602:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560855.486692:0:17929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3625:x1874392862920448:12345-0@lo:103:ldlm_bl.0 Request processed in 28610us (28952us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787560855.486705:0:17929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1787560855.486818:0:3625:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.129@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787560855.519629:0:3623:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.129@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1787560855.519633:0:3623:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787560855.519643:0:3623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9caec407ce00 x1874392862918784/t0(0) o400->MGC192.168.203.129@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787560868 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560855.519657:0:3623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9caffcbbad80 x1874392862920448/t0(0) o103->MGC192.168.203.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787560871 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560855.519665:0:3623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9caffcbb8a80 x1874392862920064/t0(0) o103->MGC192.168.203.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787560871 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560855.519673:0:3623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9caffcbb9f80 x1874392862920576/t0(0) o103->MGC192.168.203.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787560871 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560855.520405:0:3623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9caffcbb8e00 x1874392862920192/t0(0) o103->MGC192.168.203.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787560871 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560855.520427:0:3623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9caffcbba680 x1874392862920320/t0(0) o103->MGC192.168.203.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787560871 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787560855.520926:0:3623:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787560855.520930:0:3623:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787560855.520931:0:3623:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787560855.522596:0:3623:0:(import.c:65:import_set_state_nolock()) ffff9cafd80ed800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787560855.522610:0:3623:0:(import.c:510:import_select_connection()) MGC192.168.203.129@tcp: connect to NID 0@lo last attempt 461 00000100:00080000:2.0:1787560855.522620:0:3623:0:(import.c:624:import_select_connection()) MGC192.168.203.129@tcp: import ffff9cafd80ed800 using connection 192.168.203.129@tcp/0@lo 00000100:00080000:1.0:1787560855.522690:0:3625:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9cafd80ed800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:1.0:1787560855.523105:0:3623:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffba2ed80 x1874392862920960/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787560855.523173:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f08f2f56-c18f-4579-88a9-05007f76ffc9:3622:1874392862920960:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:2.0:1787560855.523232:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874392862920960 offset 0 length 520: 4 00000100:00100000:1.0:1787560855.523427:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f08f2f56-c18f-4579-88a9-05007f76ffc9:3623:1874392862920192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560855.523465:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f08f2f56-c18f-4579-88a9-05007f76ffc9:3623:1874392862918784:0@lo:400:kworker.0 00000100:00100000:1.0:1787560855.523498:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f08f2f56-c18f-4579-88a9-05007f76ffc9:3623:1874392862920320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560855.523653:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862920576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560855.523660:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862920448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560855.523674:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f08f2f56-c18f-4579-88a9-05007f76ffc9:3625:1874392862920064:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1787560855.531161:0:20951:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9caec2fb3370) has no exports 00000020:01000000:2.0:1787560855.626486:0:20951:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cafefb236c0 - data ffff9cb0000b6000/ffff9caec420b400 00000020:01000000:2.0:1787560855.626663:0:20951:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cafc523ff60 - data ffff9cb00033f1b0/ffff9cafc47be400 00000001:00000004:3.0:1787560855.641500:0:20951:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1787560855.698865:0:20951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787560855.698872:0:20951:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787560855.698880:0:20951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787560855.701455:0:20951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787560855.701462:0:20951:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1787560855.701531:0:20951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787560855.701534:0:20951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787560855.703559:0:17915:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787560855.703569:0:17915:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1787560855.703605:0:17915:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1787560855.704329:0:20951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787560855.704348:0:20951:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1787560855.704364:0:20951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787560855.704367:0:20951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787560855.704845:0:17917:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787560855.704850:0:17917:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1787560855.704869:0:17917:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1787560855.708844:0:20951:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34ef5 00000020:00000080:0.0:1787560855.708869:0:20951:0:(genops.c:885:class_export_put()) final put ffff9caff3109800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787560855.709588:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caff3109800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1787560855.710097:0:20951:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34f0a 00000020:00000080:0.0:1787560855.710106:0:20951:0:(genops.c:885:class_export_put()) final put ffff9caff310c000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787560855.710153:0:20951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1787560855.710160:0:20951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787560855.710169:0:20951:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787560855.710173:0:20951:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9caec2fb19b8) has no exports 00000004:01000000:0.0:1787560855.710344:0:20951:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787560855.710354:0:20951:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34f5e 00000020:00000080:0.0:1787560855.710359:0:20951:0:(genops.c:885:class_export_put()) final put ffff9cafc6e88800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787560855.711868:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caff310c000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1787560855.711995:0:20951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1787560855.712001:0:20951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787560855.712011:0:20951:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787560855.712016:0:20951:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9cafef9f8000) has no exports 00000020:00000080:0.0:1787560855.712024:0:20951:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34f57 00000020:00000080:0.0:1787560855.712031:0:20951:0:(genops.c:885:class_export_put()) final put ffff9cafd9a77800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1787560855.712383:0:20951:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1787560855.712388:0:20951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787560855.712402:0:20951:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1787560855.712415:0:20951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787560855.712418:0:20951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787560855.712473:0:20951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787560855.712480:0:20951:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787560855.712486:0:20951:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34f49 00000020:00000080:0.0:1787560855.712491:0:20951:0:(genops.c:885:class_export_put()) final put ffff9caffcbc2000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787560855.712494:0:20951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1787560855.712497:0:20951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787560855.712500:0:20951:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787560855.712502:0:20951:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9cafef9fcd28) has no exports 00000020:00000080:0.0:1787560855.712506:0:20951:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34f3b 00000020:00000080:0.0:1787560855.712509:0:20951:0:(genops.c:885:class_export_put()) final put ffff9caffcbc1800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1787560855.712827:0:20951:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1787560855.712830:0:20951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787560855.712832:0:20951:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1787560855.712835:0:20951:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787560855.712837:0:20951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787560855.713089:0:20951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787560855.713095:0:20951:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1787560855.713106:0:20951:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1787560855.713111:0:20951:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34f2d 00000020:00000080:0.0:1787560855.713116:0:20951:0:(genops.c:885:class_export_put()) final put ffff9caffcbc7800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787560855.713121:0:20951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1787560855.713125:0:20951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787560855.713128:0:20951:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787560855.713131:0:20951:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9caffb993370) has no exports 00000020:00000080:0.0:1787560855.713135:0:20951:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34f26 00000020:00000080:0.0:1787560855.713137:0:20951:0:(genops.c:885:class_export_put()) final put ffff9caffbb0e000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787560855.714190:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafc6e88800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1787560855.714206:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafd9a77800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787560855.714214:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cafc5251800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1787560855.714221:0:36:0:(genops.c:885:class_export_put()) final put ffff9caffcbc3000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787560855.714223:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffcbc3000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1787560855.714231:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787560855.714329:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffcbc2000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1787560855.714341:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffcbc1800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787560855.714349:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caffcbc6800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1787560855.714353:0:36:0:(genops.c:885:class_export_put()) final put ffff9caffcbc0800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787560855.714355:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffcbc0800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1787560855.714359:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787560855.714384:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffcbc7800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1787560855.714390:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffbb0e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1787560855.714553:0:20951:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1787560855.714573:0:20951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787560855.714577:0:20951:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787560855.714582:0:20951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787560855.714636:0:20951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787560855.714645:0:20951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787560855.714677:0:20951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787560855.714759:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caffbb0b800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1787560855.714767:0:36:0:(genops.c:885:class_export_put()) final put ffff9caffbb0a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787560855.714770:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffbb0a800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1787560855.714774:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787560855.715011:0:20951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787560855.715015:0:20951:0:(genops.c:885:class_export_put()) final put ffff9cafc7c51000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787560855.715017:0:20951:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafc7c51000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1787560855.715024:0:20951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787560855.715139:0:20951:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34f11 00000020:00000080:1.0:1787560855.715146:0:20951:0:(genops.c:885:class_export_put()) final put ffff9caff310e000/lustre-MDD0001_UUID 00000020:01000000:1.0:1787560855.715161:0:20951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1787560855.715165:0:20951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787560855.715169:0:20951:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787560855.715175:0:20951:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9cafef9f99b8) has no exports 00000020:00000080:1.0:1787560855.715196:0:20951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787560855.715202:0:20951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1787560855.715206:0:20951:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34f18 00000020:00000080:1.0:1787560855.715209:0:20951:0:(genops.c:885:class_export_put()) final put ffff9caff310f000/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1787560855.715219:0:20951:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cafc6f14000 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1787560855.715222:0:20951:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cafc6f14000 2 00000020:01000004:1.0:1787560855.715225:0:20951:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cafc6f14000 from lustre-MDT0001 00000020:00000080:1.0:1787560855.715250:0:20951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787560855.715253:0:20951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1787560855.715255:0:20951:0:(genops.c:885:class_export_put()) final put ffff9caff310a000/lustre-MDT0001_UUID 00000020:00000080:1.0:1787560855.715258:0:20951:0:(genops.c:844:class_export_destroy()) destroying export ffff9caff310a000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1787560855.715268:0:20951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1787560855.715293:0:20951:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1787560855.715296:0:20951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1787560855.715298:0:20951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787560855.715302:0:20951:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787560855.715315:0:20951:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9cafd8c2b000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787560855.715320:0:20951:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9cafef9fb370) has exports, disconnecting them 00000020:00080000:1.0:1787560855.715324:0:20951:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9cafd8c2b000), last request at 1787560760 00000020:00000080:1.0:1787560855.715327:0:20951:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34f96 00000020:00080000:1.0:1787560855.715350:0:20951:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cafd8c2b000): rc 0 00000020:00000080:1.0:1787560855.715353:0:20951:0:(genops.c:885:class_export_put()) final put ffff9cafd8c2b000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1787560855.715424:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caff310e000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1787560855.715429:0:36:0:(genops.c:885:class_export_put()) final put ffff9caff310d800/lustre-MDD0001_UUID 00000020:00000080:2.0:1787560855.715445:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caff310d800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1787560855.715448:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1787560855.715567:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caff310f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787560855.715571:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafd8c2b000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1787560855.722539:0:20951:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1787560855.722548:0:20951:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787560855.722553:0:20951:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787560855.722560:0:20951:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787560855.722588:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caffbb08800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1787560855.722768:0:20951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787560855.722776:0:20951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1787560855.722782:0:20951:0:(genops.c:885:class_export_put()) final put ffff9cafc6e8d800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1787560855.722796:0:20951:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafc6e8d800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1787560855.722804:0:20951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1787560855.722879:0:20951:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cafc6f14000 1 00000020:00000080:2.0:1787560855.722885:0:20951:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34ebd 00000020:00000080:2.0:1787560855.722891:0:20951:0:(genops.c:885:class_export_put()) final put ffff9caec3b5b000/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1787560855.722900:0:20951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1787560855.722908:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec3b5b000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787560855.722917:0:20951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787560855.722922:0:20951:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787560855.722926:0:20951:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9caec2fb4d28) has no exports 00000020:00000080:3.0:1787560855.903607:0:20951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787560855.903623:0:20951:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1787560855.903630:0:20951:0:(genops.c:885:class_export_put()) final put ffff9cafc6f16000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787560855.903634:0:20951:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafc6f16000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1787560855.903647:0:20951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1787560855.903774:0:20951:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9cafc6f17800 00000020:01000000:3.0:1787560855.903795:0:20951:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787560855.903800:0:20951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787560855.903803:0:20951:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787560855.903807:0:20951:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9caff49099b8) has no exports 00000100:00100000:1.0:1787560855.905665:0:19968:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9caec1ccb800:19968] 4 exiting: rc = 0 00000100:00100000:0.0:1787560855.905842:0:18203:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9cafc47ab800:18203] 3 exiting: rc = 0 00000100:00100000:2.0:1787560855.908458:0:17175:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9caffb87e400:17175] 2 exiting: rc = 0 00000100:00100000:2.0:1787560855.908541:0:17173:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9caffb87f200:17173] 0 exiting: rc = 1 00000100:00100000:2.0:1787560855.908600:0:17174:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9caec21d4a00:17174] 1 exiting: rc = 0 00000100:00100000:1.0:1787560855.909106:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909114:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909119:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909124:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909130:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909134:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909139:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909143:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909149:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909154:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909158:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909163:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909168:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909173:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909178:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909183:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909188:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909193:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909198:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909204:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909209:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909215:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909220:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909225:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909230:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909236:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909257:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909263:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909269:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909275:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909281:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909286:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909291:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909298:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909303:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909308:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909313:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909318:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909324:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909340:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909346:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909351:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909357:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909362:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909368:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909372:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909379:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909387:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909394:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909401:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909414:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909419:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909423:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909451:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909459:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909465:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909471:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909476:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909481:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909487:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909491:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909502:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909509:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.909518:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.917809:0:17177:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9caffb87f400:17177] 1 exiting: rc = 0 00000100:00100000:2.0:1787560855.918097:0:17176:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9caffb87e000:17176] 0 exiting: rc = 1 00000100:00100000:1.0:1787560855.918219:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918228:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918235:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918240:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918245:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918250:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918256:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918261:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918278:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918285:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918290:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918296:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918300:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918306:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918312:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918317:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918323:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918328:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918491:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918497:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918502:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918507:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918512:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918517:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918522:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918528:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918533:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918538:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918544:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918549:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918554:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918572:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918578:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918583:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918589:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918595:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918601:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918606:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918611:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918617:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918622:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918628:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918633:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918638:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918643:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918649:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918654:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918659:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918664:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918669:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918674:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918747:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918752:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918756:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918761:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918766:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918771:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918776:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918781:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918786:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918792:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918798:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918802:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.918808:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560855.919699:0:18389:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9cafc465ae00:18389] 2 exiting: rc = 0 00000100:00100000:2.0:1787560855.919979:0:17179:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9caec1e88200:17179] 1 exiting: rc = 0 00000100:00100000:1.0:1787560855.920174:0:17178:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9caec1e88a00:17178] 0 exiting: rc = 1 00000100:00100000:1.0:1787560855.920232:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920278:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920285:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920294:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920299:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920305:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920311:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920317:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920322:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920328:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920341:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920347:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920369:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920376:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920381:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920388:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920393:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920398:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920412:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920418:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920424:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920454:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920461:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920466:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920488:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920495:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920501:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920506:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920512:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920517:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920522:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920527:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920533:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920539:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920543:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920548:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920573:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920579:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920585:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920591:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920596:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920602:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920607:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920612:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920617:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920622:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920628:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920633:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920652:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920659:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920664:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920669:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920981:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.920994:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.921000:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.921006:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.921012:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.921017:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.921023:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.921028:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.921048:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.921055:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.921061:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560855.921066:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560855.940708:0:17180:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9caec1e88800:17180] 0 exiting: rc = 1 00000100:00100000:3.0:1787560855.940815:0:17181:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9caec1e89600:17181] 1 exiting: rc = 0 00000100:00100000:0.0:1787560855.941479:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941487:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941507:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941513:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941519:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941525:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941530:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941535:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941541:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941546:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941551:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941556:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941561:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941565:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941570:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941576:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941581:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941586:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941591:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941596:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941602:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941607:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941612:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941617:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941622:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941628:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941633:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941637:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941643:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941647:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941652:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941659:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941664:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941671:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941802:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941809:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941814:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941826:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941831:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941835:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941840:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941845:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941850:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941922:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941930:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941935:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941941:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941946:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941951:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941956:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941961:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941966:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941972:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941977:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941983:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941988:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941993:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.941998:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.942003:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.942009:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.942013:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.942018:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.942022:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.942027:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560855.943075:0:17183:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9caec3288400:17183] 1 exiting: rc = 0 00000100:00100000:2.0:1787560855.945561:0:17182:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9cafc2c4ae00:17182] 0 exiting: rc = 1 00000100:00100000:0.0:1787560855.952229:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952239:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952244:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952249:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952253:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952259:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952265:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952270:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952290:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952295:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952299:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952304:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952309:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952313:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952317:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952321:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952325:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952340:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952345:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952349:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952354:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952358:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952362:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952367:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952372:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952376:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952381:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952386:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952391:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952395:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952400:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952415:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952421:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952425:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952452:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952459:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952465:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952471:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952476:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952482:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952488:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952495:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952500:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952514:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952520:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952525:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952530:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952536:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952541:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952547:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952552:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952557:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952562:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952567:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952572:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952578:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952583:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952587:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952592:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952597:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952604:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952609:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952614:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.952620:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.953310:0:17184:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9caffc887e00:17184] 0 exiting: rc = 1 00000100:00100000:3.0:1787560855.953807:0:17185:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9caec3289000:17185] 1 exiting: rc = 0 00000100:00100000:0.0:1787560855.953967:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.953976:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.953982:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.953988:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.953995:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954002:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954008:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954013:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954019:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954025:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954030:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954035:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954040:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954052:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954057:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954062:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954067:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954073:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954078:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954083:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954088:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954092:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954097:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954103:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954107:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954112:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954117:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954122:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954127:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954132:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954137:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954141:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954146:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954151:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954156:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954162:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954168:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954173:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954178:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954183:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954188:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954193:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954199:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954203:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954208:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954213:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954218:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954224:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954235:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954240:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954245:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954250:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954254:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954259:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954264:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954269:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954275:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954280:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954286:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954291:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954295:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954300:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954304:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954309:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.954977:0:17186:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9caec1e88400:17186] 0 exiting: rc = 1 00000100:00100000:0.0:1787560855.955165:0:17187:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9caec3801e00:17187] 1 exiting: rc = 0 00000100:00100000:0.0:1787560855.955333:0:17188:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9caec1e89a00:17188] 2 exiting: rc = 0 00000100:00100000:0.0:1787560855.955382:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955389:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955395:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955423:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955458:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955466:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955472:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955478:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955484:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955489:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955495:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955501:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955507:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955513:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955519:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955525:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955545:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955552:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955558:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955565:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955584:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955591:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955596:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955603:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955609:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955615:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955620:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955627:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955633:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955639:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955645:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955651:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955658:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955664:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955672:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955679:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955686:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955692:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955698:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955705:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955712:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955718:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955724:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955730:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955752:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955758:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955764:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955770:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955776:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955781:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955786:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955800:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955806:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955811:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955816:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955821:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955826:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955831:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955837:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955842:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955848:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955853:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955859:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560855.955865:0:20951:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787560855.968158:0:20951:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787560855.968172:0:20951:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787560855.968177:0:20951:0:(genops.c:885:class_export_put()) final put ffff9cafd80ef800/MDS_uuid 00000020:00000080:0.0:1787560855.968182:0:20951:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafd80ef800/MDS_uuid for MDS 00000020:01000000:0.0:1787560855.968187:0:20951:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787560855.968326:0:20951:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1787560856.126475:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560857.152290:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787560857.652624:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) f08f2f56-c18f-4579-88a9-05007f76ffc9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787560857.652635:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) f08f2f56-c18f-4579-88a9-05007f76ffc9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787560857.652638:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787560857.652642:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787560857.652646:0:36:0:(import.c:65:import_set_state_nolock()) ffff9caec403a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787560857.652653:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 571 00000100:00080000:3.0:1787560857.652658:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787560857.652666:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9caec403a800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560857.652703:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffcbb9c00 x1874392862921088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787560857.652764:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787560857.652769:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787560857.652771:0:36:0:(import.c:65:import_set_state_nolock()) ffff9caec4299000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787560857.652775:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 571 00000100:00080000:3.0:1787560857.652778:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787560857.652782:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9caec4299000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:0.0:1787560857.652880:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787560857.652898:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862921216:0@lo:400:kworker.0 00000400:00000100:0.0:1787560857.652950:0:3624:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874392862921216 offset 0 length 224: 4 00000100:00100000:2.0:1787560857.653035:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1874392862921088:0@lo:38:kworker.0 00000400:00000100:2.0:1787560857.653059:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874392862921088 offset 0 length 520: 4 00000100:00100000:3.0:1787560857.653117:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffcbbb480 x1874392862921344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787560857.653211:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1874392862921344:0@lo:38:kworker.0 00000400:00000100:2.0:1787560857.653232:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874392862921344 offset 0 length 520: 4 00000100:00100000:0.0:1787560857.653350:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874392862921472:0@lo:400:kworker.0 00000400:00000100:0.0:1787560857.653372:0:3624:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874392862921472 offset 0 length 224: 4 00010000:00010000:1.0:1787560858.163697:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560859.193983:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787560859.970529:0:21152:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1787560859.992708:0:21152:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787560859.992822:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3880600/0x4642c20bf2f35030 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35037 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560859.992839:0:21152:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3880600/0x4642c20bf2f35030 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35037 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560859.992865:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3880600/0x4642c20bf2f35030 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f35037 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560859.992872:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9caec3880600/0x4642c20bf2f35030 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f35037 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560859.992947:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787560859.992952:0:21152:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787560859.992977:0:21152:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787560859.992989:0:21152:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9caffcbb9c00 x1874392862921088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787560877 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560859.993004:0:21152:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787560859.993010:0:21152:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787560859.993017:0:21152:0:(import.c:65:import_set_state_nolock()) ffff9caec403a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787560859.993022:0:21152:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787560859.993025:0:21152:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9caffcbb9c00 x1874392862921088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787560877 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560859.993033:0:21152:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787560859.993036:0:21152:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:2.0:1787560859.993155:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1874392862921088:0@lo:38:kworker.0 00000100:00080000:3.0:1787560859.994401:0:21152:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787560859.994413:0:21152:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9caffcbb9500 x1874392862921216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560873 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560859.997519:0:21152:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787560859.997563:0:21152:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787560859.997599:0:21152:0:(import.c:65:import_set_state_nolock()) ffff9caec231d800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787560859.997715:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862921216:0@lo:400:kworker.0 00010000:00010000:1.0:1787560859.997841:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560859.997850:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caec3880600/0x4642c20bf2f35030 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f35037 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560859.997880:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880600 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:1.0:1787560859.997884:0:17161:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caec3880600/0x4642c20bf2f35030 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f35037 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560859.997894:0:17161:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caec3880600/0x4642c20bf2f35030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f35037 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560859.997901:0:17161:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caec3880600/0x4642c20bf2f35030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f35037 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560859.997906:0:17161:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787560859.997909:0:17161:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787560859.997913:0:17161:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787560859.997928:0:17161:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cafd80ed800 00010000:00010000:1.0:1787560859.997932:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caec3880600/0x4642c20bf2f35030 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x4642c20bf2f35037 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560859.997938:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caec3880600/0x4642c20bf2f35030 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x4642c20bf2f35037 expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560859.998054:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1874392862921600:0@lo:39:umount.0 00000400:00000100:2.0:1787560859.998108:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874392862921600 offset 0 length 224: 4 00010000:00010000:0.0:1787560859.998213:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560859.998215:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560859.998217:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560860.212414:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787560860.659640:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) f08f2f56-c18f-4579-88a9-05007f76ffc9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787560860.659659:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) f08f2f56-c18f-4579-88a9-05007f76ffc9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787560860.659662:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787560860.659685:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787560860.659824:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787560860.659849:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862921728:0@lo:400:kworker.0 00000400:00000100:1.0:1787560860.659917:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874392862921728 offset 0 length 224: 4 00010000:00010000:1.0:1787560861.236015:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787560861.749916:0:19498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787560861.749927:0:19498:0:(genops.c:885:class_export_put()) final put ffff9caec2d3a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787560861.750046:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec2d3a800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787560861.750201:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec2d39000 for lustre-OST0001 00000001:00100000:2.0:1787560861.761220:0:18679:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787560861.761242:0:18679:0:(genops.c:885:class_export_put()) final put ffff9caec231f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787560861.761603:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec231f000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787560861.761669:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec231c000 for lustre-OST0000 00010000:00010000:0.0:1787560862.259675:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787560862.708625:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) f08f2f56-c18f-4579-88a9-05007f76ffc9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787560862.708634:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) f08f2f56-c18f-4579-88a9-05007f76ffc9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787560862.708637:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787560862.708640:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787560862.708778:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560862.708798:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874392862921856:0@lo:400:kworker.0 00000400:00000100:0.0:1787560862.708862:0:3625:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874392862921856 offset 0 length 224: 4 00010000:00010000:1.0:1787560863.284963:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560864.309186:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560865.139560:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560855/real 1787560855] req@ffff9caffba2ed80 x1874392862920960/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787560865 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560865.139891:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9caffba2ed80 x1874392862920960/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787560865 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787560865.139912:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafd80ed800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787560865.139941:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787560865.139946:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f08f2f56-c18f-4579-88a9-05007f76ffc9:3622:1874392862920960:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:3.0:1787560865.140393:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) f08f2f56-c18f-4579-88a9-05007f76ffc9->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787560865.140417:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787560865.140420:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cafd80ed800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787560865.140424:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.129@tcp: connect to NID 0@lo last attempt 574 00000100:00080000:3.0:1787560865.140454:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.129@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787560865.140464:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.129@tcp: import ffff9cafd80ed800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560865.140496:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffcbb9f80 x1874392862921984/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787560865.140526:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787560865.140530:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787560865.140643:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862922112:0@lo:400:kworker.0 00000400:00000100:1.0:1787560865.140703:0:3623:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874392862922112 offset 0 length 224: 4 00000100:00100000:0.0:1787560865.141073:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f08f2f56-c18f-4579-88a9-05007f76ffc9:3622:1874392862921984:0@lo:250:kworker.0 00000400:00000100:0.0:1787560865.141097:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874392862921984 offset 0 length 520: 4 00010000:00010000:0.0:1787560865.332119:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560866.355691:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560867.379688:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560868.404202:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560869.235782:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560859/real 1787560859] req@ffff9caffcbbad80 x1874392862921600/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787560869 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560869.235830:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9caffcbbad80 x1874392862921600/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787560869 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787560869.235850:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec231d800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787560869.235931:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1874392862921600:0@lo:39:umount.0 00000100:00080000:3.0:1787560869.238112:0:21152:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787560869.238121:0:21152:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787560869.238128:0:21152:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787560869.240140:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f35006 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3500d expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560869.240159:0:21152:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f35006 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f3500d expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560869.240167:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f35006 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f3500d expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560869.240174:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f35006 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f3500d expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560869.240245:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560869.240252:0:21152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f3536a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35371 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560869.240278:0:21152:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f3536a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35371 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560869.240285:0:21152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f3536a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f35371 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560869.240290:0:21152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f3536a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f35371 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560869.240381:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787560869.240388:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f35006 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f3500d expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560869.245857:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6200 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:1.0:1787560869.245871:0:17928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f35006 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f3500d expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560869.245898:0:17928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f35006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f3500d expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560869.245906:0:17928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f35006 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f3500d expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560869.245911:0:17928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787560869.245914:0:17928:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1787560869.245928:0:17928:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cafd80ed800 00010000:00010000:1.0:1787560869.245932:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f35006 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x4642c20bf2f3500d expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560869.245939:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6200/0x4642c20bf2f35006 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x4642c20bf2f3500d expref: -99 pid: 18678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560869.245986:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560869.245991:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f3536a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f35371 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560869.245997:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49200 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:1.0:1787560869.246000:0:17928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f3536a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f35371 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560869.246008:0:17928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f3536a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f35371 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560869.246014:0:17928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f3536a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f35371 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560869.246020:0:17928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787560869.246023:0:17928:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1787560869.246027:0:17928:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cafd80ed800 00010000:00010000:1.0:1787560869.246030:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f3536a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4642c20bf2f35371 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560869.246037:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560869.246039:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560869.246043:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560869.246874:0:21152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787560869.246893:0:21152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caffca49200/0x4642c20bf2f3536a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4642c20bf2f35371 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560869.246908:0:21152:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1787560869.246916:0:21152:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1787560869.246919:0:21152:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787560869.246954:0:21152:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787560869.246958:0:21152:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787560869.246966:0:21152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787560869.246972:0:21152:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787560869.246977:0:21152:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9caff3248000) has no exports 00000020:00080000:3.0:1787560869.247041:0:21152:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9caff3248000) has no exports 00010000:00010000:1.0:1787560869.249193:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787560869.253857:0:21152:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9caec2109480 - data ffff9cb00027fd80/ffff9caff766bc00 00000020:01000000:3.0:1787560869.254272:0:21152:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cafefb23780 - data ffff9cb0000cf360/ffff9cafc47bbc00 00100000:10000000:3.0:1787560869.266408:0:21152:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787560869.280932:0:21152:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f3501b 00000020:00000080:2.0:1787560869.280945:0:21152:0:(genops.c:885:class_export_put()) final put ffff9caec227f800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1787560869.281001:0:21152:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cafc68d7800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787560869.281006:0:21152:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cafc68d7800 2 00000020:01000004:2.0:1787560869.281009:0:21152:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cafc68d7800 from lustre-OST0000 00000020:00000080:2.0:1787560869.281067:0:21152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787560869.281078:0:21152:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787560869.281082:0:21152:0:(genops.c:885:class_export_put()) final put ffff9caec3383000/lustre-OST0000_UUID 00000020:00000080:2.0:1787560869.281085:0:21152:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec3383000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787560869.281091:0:21152:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787560869.281153:0:21152:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1787560869.281158:0:21152:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787560869.281161:0:21152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787560869.281166:0:21152:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787560869.281172:0:21152:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9caec2fcb000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787560869.281178:0:21152:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff9caff31d4d28) has exports, disconnecting them 00000020:00080000:2.0:1787560869.281183:0:21152:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9caec2fcb000), last request at 1787560777 00000020:00000080:2.0:1787560869.281188:0:21152:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f35045 00000020:00080000:2.0:1787560869.281210:0:21152:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9caec2fcb000): rc 0 00000020:00000080:2.0:1787560869.281216:0:21152:0:(genops.c:885:class_export_put()) final put ffff9caec2fcb000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787560869.289669:0:15403:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec227f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787560869.291483:0:15403:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec2fcb000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1787560869.294531:0:21152:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787560869.294540:0:21152:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787560869.294546:0:21152:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787560869.294554:0:21152:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787560869.294758:0:21152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787560869.294767:0:21152:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1787560869.294774:0:21152:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787560869.294779:0:21152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787560869.294784:0:21152:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787560869.294792:0:21152:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9caec2319000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787560869.294799:0:21152:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff9caffb990000) has exports, disconnecting them 00000020:00080000:3.0:1787560869.294804:0:21152:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9caec2319000), last request at 1787560777 00000020:00000080:3.0:1787560869.294808:0:21152:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f3505a 00000020:00080000:3.0:1787560869.294822:0:21152:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9caec2319000): rc 0 00000020:00000080:3.0:1787560869.294827:0:21152:0:(genops.c:885:class_export_put()) final put ffff9caec2319000/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1787560869.296540:0:15403:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec403a800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787560869.296556:0:15403:0:(genops.c:885:class_export_put()) final put ffff9caec403b000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1787560869.296559:0:15403:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec403b000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1787560869.296583:0:15403:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1787560869.296713:0:15403:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec2319000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1787560869.299890:0:21152:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787560869.299903:0:21152:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787560869.299908:0:21152:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787560869.299916:0:21152:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787560869.299951:0:15403:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec231d800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1787560869.300211:0:21152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787560869.300221:0:21152:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1787560869.300227:0:21152:0:(genops.c:885:class_export_put()) final put ffff9caec2318000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1787560869.300231:0:21152:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec2318000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1787560869.300238:0:21152:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1787560869.300306:0:21152:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cafc68d7800 1 00000020:00000080:0.0:1787560869.300322:0:21152:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34ff8 00000020:00000080:0.0:1787560869.300329:0:21152:0:(genops.c:885:class_export_put()) final put ffff9caec21ee000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787560869.300337:0:21152:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787560869.300346:0:15403:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec21ee000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787560869.300354:0:21152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787560869.300359:0:21152:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787560869.300363:0:21152:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff9caff490cd28) has no exports 00000020:00000080:0.0:1787560869.348504:0:21152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787560869.348521:0:21152:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787560869.348527:0:21152:0:(genops.c:885:class_export_put()) final put ffff9cafc68d0000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787560869.348532:0:21152:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafc68d0000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787560869.348544:0:21152:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787560869.348688:0:21152:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9cafc68d3000 00000020:02000400:0.0:1787560869.348731:0:21152:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787560869.436034:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560870.451858:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787560870.452140:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) f08f2f56-c18f-4579-88a9-05007f76ffc9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787560870.452146:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) f08f2f56-c18f-4579-88a9-05007f76ffc9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787560870.452149:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787560870.452152:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787560870.452219:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560870.452502:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862922240:0@lo:400:kworker.0 00000400:00000100:3.0:1787560870.452562:0:3623:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874392862922240 offset 0 length 224: 4 00010000:00010000:3.0:1787560871.476545:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560872.501417:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787560873.305190:0:21354:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1787560873.323817:0:21354:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1787560873.323953:0:21354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35195 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3519c expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560873.323986:0:21354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35195 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f3519c expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560873.323994:0:21354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35195 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f3519c expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560873.324001:0:21354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35195 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f3519c expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560873.324034:0:21354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787560873.324040:0:21354:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787560873.324067:0:21354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787560873.324079:0:21354:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9caffcbbb480 x1874392862921344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787560877 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787560873.324166:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560873.324174:0:17928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35195 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f3519c expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560873.324181:0:17928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbffa00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560873.324185:0:17928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35195 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f3519c expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560873.324200:0:17928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35195 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f3519c expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560873.324208:0:17928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35195 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f3519c expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560873.324214:0:17928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787560873.324216:0:17928:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787560873.324219:0:17928:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787560873.324234:0:17928:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cafd80ed800 00010000:00010000:3.0:1787560873.324239:0:17928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35195 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4642c20bf2f3519c expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560873.324246:0:17928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35195 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4642c20bf2f3519c expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560873.324258:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560873.324264:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560873.324266:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560873.324309:0:21354:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787560873.324317:0:21354:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787560873.324322:0:21354:0:(import.c:65:import_set_state_nolock()) ffff9caec4299000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787560873.324327:0:21354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787560873.324332:0:21354:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9caffcbbb480 x1874392862921344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787560877 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560873.325266:0:21354:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787560873.325274:0:21354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00100000:0.0:1787560873.325335:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1874392862921344:0@lo:38:kworker.0 00000100:00080000:1.0:1787560873.326246:0:21354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787560873.326257:0:21354:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9caffcbb8a80 x1874392862921472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560873 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560873.326278:0:21354:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cafc46e9880 x1874392862921728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560876 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560873.326323:0:21354:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cafc46eb100 x1874392862921856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560878 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560873.326341:0:21354:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9caffcbba680 x1874392862922112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560881 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560873.326351:0:21354:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9caffcbb8e00 x1874392862922240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560886 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560873.326357:0:21354:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787560873.326364:0:21354:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787560873.326389:0:21354:0:(import.c:65:import_set_state_nolock()) ffff9caffcbc5000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787560873.326874:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862921728:0@lo:400:kworker.0 00000100:00100000:3.0:1787560873.326920:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862922240:0@lo:400:kworker.0 00000100:00100000:3.0:1787560873.326927:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862922112:0@lo:400:kworker.0 00000100:00100000:2.0:1787560873.327092:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874392862921472:0@lo:400:kworker.0 00000100:00100000:0.0:1787560873.327326:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1874392862922368:0@lo:39:umount.0 00000400:00000100:0.0:1787560873.327384:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874392862922368 offset 0 length 224: 4 00000100:00100000:1.0:1787560873.327699:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1874392862921856:0@lo:400:kworker.0 00010000:00010000:3.0:1787560873.524878:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560874.548711:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787560875.573461:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) f08f2f56-c18f-4579-88a9-05007f76ffc9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787560875.573473:0:15403:0:(pinger.c:247:ptlrpc_pinger_process_import()) f08f2f56-c18f-4579-88a9-05007f76ffc9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1787560875.573619:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560876.595634:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560877.619658:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560878.645733:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560879.668929:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560880.502104:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560865/real 1787560865] req@ffff9caffcbb9f80 x1874392862921984/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787560880 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560880.502137:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9caffcbb9f80 x1874392862921984/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787560880 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787560880.502157:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafd80ed800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787560880.502187:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1787560880.502191:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f08f2f56-c18f-4579-88a9-05007f76ffc9:3622:1874392862921984:0@lo:250:kworker.0 00000100:00080000:0.0:1787560880.502295:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) f08f2f56-c18f-4579-88a9-05007f76ffc9->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787560880.502301:0:15403:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1787560880.502303:0:15403:0:(import.c:65:import_set_state_nolock()) ffff9cafd80ed800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787560880.502308:0:15403:0:(import.c:510:import_select_connection()) MGC192.168.203.129@tcp: connect to NID 0@lo last attempt 584 00000100:00080000:0.0:1787560880.502314:0:15403:0:(import.c:589:import_select_connection()) MGC192.168.203.129@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787560880.502320:0:15403:0:(import.c:624:import_select_connection()) MGC192.168.203.129@tcp: import ffff9cafd80ed800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:0.0:1787560880.502354:0:15403:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffbaf7b80 x1874392862922496/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787560880.506340:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f08f2f56-c18f-4579-88a9-05007f76ffc9:3622:1874392862922496:0@lo:250:kworker.0 00000400:00000100:1.0:1787560880.506404:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874392862922496 offset 0 length 520: 4 00010000:00010000:3.0:1787560880.691953:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560881.719142:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560882.739737:0:17162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560883.571624:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560873/real 1787560873] req@ffff9caffba2df80 x1874392862922368/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787560883 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560883.571686:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9caffba2df80 x1874392862922368/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787560883 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787560883.571708:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffcbc5000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787560883.571733:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1874392862922368:0@lo:39:umount.0 00000100:00080000:0.0:1787560883.572321:0:21354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787560883.572326:0:21354:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787560883.572332:0:21354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787560883.575763:0:21354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f3516b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35172 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560883.575782:0:21354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f3516b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35172 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560883.575789:0:21354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f3516b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f35172 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560883.577921:0:21354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f3516b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f35172 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560883.578383:0:21354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787560883.578396:0:21354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffc00/0x4642c20bf2f3535c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35363 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560883.578448:0:21354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffc00/0x4642c20bf2f3535c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35363 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560883.578455:0:21354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffc00/0x4642c20bf2f3535c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f35363 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560883.578461:0:21354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffc00/0x4642c20bf2f3535c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4642c20bf2f35363 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560883.584079:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787560883.584098:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f3516b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f35172 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560883.584111:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49400 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560883.584116:0:17161:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f3516b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f35172 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560883.584127:0:17161:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f3516b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f35172 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560883.584134:0:17161:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f3516b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f35172 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560883.584140:0:17161:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787560883.584142:0:17161:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1787560883.584157:0:17161:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cafd80ed800 00010000:00010000:3.0:1787560883.584162:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f3516b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4642c20bf2f35172 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560883.584168:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f3516b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4642c20bf2f35172 expref: -99 pid: 19497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560883.584186:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560883.584190:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffc00/0x4642c20bf2f3535c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f35363 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560883.584232:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ffc00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560883.584235:0:17161:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffc00/0x4642c20bf2f3535c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4642c20bf2f35363 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560883.584242:0:17161:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffc00/0x4642c20bf2f3535c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f35363 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560883.584248:0:17161:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffc00/0x4642c20bf2f3535c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f35363 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560883.584253:0:17161:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787560883.584255:0:17161:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1787560883.584260:0:17161:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cafd80ed800 00010000:00010000:3.0:1787560883.584262:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffc00/0x4642c20bf2f3535c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4642c20bf2f35363 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560883.584269:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560883.584271:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560883.584273:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560883.586041:0:21354:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787560883.586054:0:21354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cb0021ffc00/0x4642c20bf2f3535c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4642c20bf2f35363 expref: -99 pid: 17170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560883.586078:0:21354:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1787560883.586086:0:21354:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1787560883.586089:0:21354:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1787560883.586128:0:21354:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1787560883.586132:0:21354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1787560883.586143:0:21354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787560883.586150:0:21354:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787560883.586154:0:21354:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9caff324b370) has no exports 00000020:00080000:0.0:1787560883.586180:0:21354:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9caff324b370) has no exports 00010000:00010000:3.0:1787560883.587322:0:17928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787560883.591900:0:21354:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9caec2109d20 - data ffff9cb00022b798/ffff9caec304c400 00000020:01000000:1.0:1787560883.599351:0:21354:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9caec1ee24e0 - data ffff9caec1855bd0/ffff9caec1c87800 00100000:10000000:1.0:1787560883.619359:0:21354:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787560883.633297:0:21354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f35180 00000020:00000080:0.0:1787560883.633309:0:21354:0:(genops.c:885:class_export_put()) final put ffff9caffcbc1000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787560883.633361:0:21354:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9caec231a000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787560883.633365:0:21354:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9caec231a000 2 00000020:01000004:0.0:1787560883.633376:0:21354:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9caec231a000 from lustre-OST0001 00000020:00000080:0.0:1787560883.633415:0:21354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787560883.633427:0:21354:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787560883.633467:0:21354:0:(genops.c:885:class_export_put()) final put ffff9caec227d000/lustre-OST0001_UUID 00000020:00000080:0.0:1787560883.633470:0:21354:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec227d000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787560883.633486:0:21354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1787560883.633873:0:21354:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import f08f2f56-c18f-4579-88a9-05007f76ffc9->MGS 00010000:00010000:0.0:1787560883.633890:0:21354:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caec2169400/0x4642c20bf2f34ec4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f34ecb expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560883.633904:0:21354:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caec2169400/0x4642c20bf2f34ec4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f34ecb expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560883.633912:0:21354:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787560883.633915:0:21354:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1787560883.633919:0:21354:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787560883.633936:0:21354:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cafd80ed800 00010000:00010000:0.0:1787560883.633940:0:21354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caec2169400/0x4642c20bf2f34ec4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4642c20bf2f34ecb expref: -99 pid: 17906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560883.633956:0:21354:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cb002177000/0x4642c20bf2f34db3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4642c20bf2f34dba expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560883.633963:0:21354:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cb002177000/0x4642c20bf2f34db3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4642c20bf2f34dba expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560883.633969:0:21354:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787560883.633971:0:21354:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1787560883.633973:0:21354:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1787560883.633982:0:21354:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cafd80ed800 00010000:00010000:0.0:1787560883.633985:0:21354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cb002177000/0x4642c20bf2f34db3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4642c20bf2f34dba expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787560883.634001:0:21354:0:(import.c:65:import_set_state_nolock()) ffff9cafd80ed800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1787560883.634013:0:21354:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787560883.634016:0:21354:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787560883.634018:0:21354:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787560883.634022:0:21354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787560883.634037:0:21354:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9caffbaf7b80 x1874392862922496/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787560900 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787560883.634054:0:21354:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787560883.634057:0:21354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:1.0:1787560883.634155:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f08f2f56-c18f-4579-88a9-05007f76ffc9:3622:1874392862922496:0@lo:250:kworker.0 10000000:01000000:0.0:1787560883.634262:0:21354:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787560883.634269:0:21354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f34d9e 00000020:00000080:0.0:1787560883.634274:0:21354:0:(genops.c:885:class_export_put()) final put ffff9cafd80eb800/f08f2f56-c18f-4579-88a9-05007f76ffc9 00000020:00000080:3.0:1787560883.634316:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffcbc1000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787560883.634690:0:21354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.129@tcp (flags='') 00000020:00000080:3.0:1787560883.634768:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cafd80eb800/f08f2f56-c18f-4579-88a9-05007f76ffc9 for MGC192.168.203.129@tcp 00000020:00000080:1.0:1787560883.634796:0:21354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787560883.634802:0:21354:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.129@tcp: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787560883.634806:0:21354:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9caff4908000) has no exports 10000000:01000000:3.0:1787560883.634985:0:17170:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1787560883.635059:0:21354:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.129@tcp: client import never connected 00000100:00080000:1.0:1787560883.635062:0:21354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787560883.635065:0:21354:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787560883.635067:0:21354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787560883.635069:0:21354:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787560883.635151:0:21354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787560883.635157:0:21354:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.129@tcp (uuid f08f2f56-c18f-4579-88a9-05007f76ffc9) 00000020:01000000:1.0:1787560883.635163:0:21354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787560883.635166:0:21354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787560883.635170:0:21354:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787560883.635175:0:21354:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9caec429a800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787560883.635181:0:21354:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff9caff324cd28) has exports, disconnecting them 00000020:00080000:1.0:1787560883.635185:0:21354:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9caec429a800), last request at 1787560795 00000020:00000080:1.0:1787560883.635189:0:21354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f351aa 00000020:00080000:1.0:1787560883.635200:0:21354:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9caec429a800): rc 0 00000020:00000080:1.0:1787560883.635204:0:21354:0:(genops.c:885:class_export_put()) final put ffff9caec429a800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787560883.635375:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cafd80ed800 for MGC192.168.203.129@tcp 00000020:00000080:3.0:1787560883.635383:0:8:0:(genops.c:885:class_export_put()) final put ffff9caffff53800/f08f2f56-c18f-4579-88a9-05007f76ffc9 00000020:00000080:3.0:1787560883.635385:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caffff53800/f08f2f56-c18f-4579-88a9-05007f76ffc9 for MGC192.168.203.129@tcp 00000020:01000000:3.0:1787560883.635391:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.129@tcp (f08f2f56-c18f-4579-88a9-05007f76ffc9) 00000020:00000080:3.0:1787560883.637355:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec429a800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787560883.637469:0:21354:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787560883.637483:0:21354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787560883.637487:0:21354:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787560883.637492:0:21354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787560883.637673:0:21354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787560883.637683:0:21354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1787560883.637690:0:21354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787560883.637695:0:21354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787560883.637700:0:21354:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787560883.637709:0:21354:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9caec429b800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787560883.637715:0:21354:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff9caff32499b8) has exports, disconnecting them 00000020:00080000:0.0:1787560883.637719:0:21354:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9caec429b800), last request at 1787560795 00000020:00000080:0.0:1787560883.637724:0:21354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f351bf 00000020:00080000:0.0:1787560883.637738:0:21354:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9caec429b800): rc 0 00000020:00000080:0.0:1787560883.637743:0:21354:0:(genops.c:885:class_export_put()) final put ffff9caec429b800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1787560883.638722:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caec4299000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787560883.638733:0:8:0:(genops.c:885:class_export_put()) final put ffff9caec429c000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787560883.638735:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec429c000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787560883.638741:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787560883.638800:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec429b800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1787560883.643622:0:21354:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787560883.643637:0:21354:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787560883.643642:0:21354:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787560883.643651:0:21354:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787560883.643693:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9caffcbc5000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1787560883.643747:0:17162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1787560883.643872:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1787560883.643935:0:17928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1787560883.644050:0:17156:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9caec2f3f200:17156] 0 exiting: rc = 1 00000100:00100000:1.0:1787560883.654119:0:17157:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9caec2f3f400:17157] 1 exiting: rc = 0 00000100:00100000:3.0:1787560883.654381:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.654911:0:17158:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9caffcae8400:17158] 0 exiting: rc = 1 00000100:00100000:1.0:1787560883.655065:0:17159:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9caffcae8200:17159] 1 exiting: rc = 0 00000100:00100000:1.0:1787560883.655132:0:17929:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9cafc47d5a00:17929] 3 exiting: rc = 0 00000100:00100000:3.0:1787560883.655707:0:17160:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9caff80a5000:17160] 2 exiting: rc = 0 00000100:00100000:1.0:1787560883.655822:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.655829:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.655835:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.655841:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.655846:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.655851:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.655858:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.655864:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.655869:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.655874:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.655880:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.655884:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.655889:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.655894:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.655900:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.655905:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.655910:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.655916:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.655921:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.655926:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.655932:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.655937:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.655942:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.655948:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.655954:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.655961:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.655967:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.655972:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.655977:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.655982:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.655987:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656006:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656011:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656018:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656023:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656029:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656035:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656040:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656045:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656050:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656056:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656061:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656066:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656072:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656077:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656083:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656088:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656094:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656100:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656106:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656111:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656117:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656122:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656128:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656133:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656148:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656154:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656160:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656165:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656170:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656176:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656182:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656188:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787560883.656194:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787560883.657464:0:21354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787560883.657484:0:21354:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1787560883.657499:0:21354:0:(genops.c:885:class_export_put()) final put ffff9caec429e800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1787560883.657505:0:21354:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec429e800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1787560883.657511:0:21354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1787560883.657720:0:21354:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9caec231a000 1 00000020:00000080:1.0:1787560883.657727:0:21354:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4642c20bf2f35164 00000020:00000080:1.0:1787560883.657733:0:21354:0:(genops.c:885:class_export_put()) final put ffff9caec227c800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1787560883.657751:0:21354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1787560883.657756:0:21354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787560883.657760:0:21354:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787560883.657764:0:21354:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff9caffb9919b8) has no exports 00000020:00000080:3.0:1787560883.658574:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec227c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787560883.686885:0:21354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787560883.686902:0:21354:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1787560883.686910:0:21354:0:(genops.c:885:class_export_put()) final put ffff9caec231e000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1787560883.686916:0:21354:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec231e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787560883.686930:0:21354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1787560883.687278:0:21354:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9caec231c800 00000020:01000000:3.0:1787560883.687307:0:21354:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1787560883.687312:0:21354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787560883.687318:0:21354:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787560883.687322:0:21354:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9cafeabd0000) has no exports 00000020:00000080:3.0:1787560883.687360:0:21354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787560883.687375:0:21354:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1787560883.687384:0:21354:0:(genops.c:885:class_export_put()) final put ffff9caec21eb800/OSS_uuid 00000020:00000080:3.0:1787560883.687386:0:21354:0:(genops.c:844:class_export_destroy()) destroying export ffff9caec21eb800/OSS_uuid for OSS 00000020:01000000:3.0:1787560883.687390:0:21354:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1787560883.687640:0:18684:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9cafc47aae00:18684] 1 exiting: rc = 0 00000100:00080000:0.0:1787560883.687654:0:17169:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1787560883.688079:0:18683:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9cafc47ab600:18683] 0 exiting: rc = 1 00000100:00100000:0.0:1787560883.688133:0:19050:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9caec2227c00:19050] 3 exiting: rc = 0 00000100:00100000:0.0:1787560883.688232:0:18685:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9cafe09abe00:18685] 2 exiting: rc = 0 00000100:00100000:3.0:1787560883.688317:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688327:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688333:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688338:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688343:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688348:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688354:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688361:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688366:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688372:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688378:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688383:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688388:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688393:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688399:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688404:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688409:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688415:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688421:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688427:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688491:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688497:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688501:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688506:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688512:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688517:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688522:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688528:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688533:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688538:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688543:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688558:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688565:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688571:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688577:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688582:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688588:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688593:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688598:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688604:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688610:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688615:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688620:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688625:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688630:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688635:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688641:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688647:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688652:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688658:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688663:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688669:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688674:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688680:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688686:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688691:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688697:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688702:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688708:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688712:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688884:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688891:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688896:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.688901:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560883.689979:0:18686:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9cafc465d000:18686] 0 exiting: rc = 1 00000100:00100000:1.0:1787560883.690111:0:18687:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9caec1ee8800:18687] 1 exiting: rc = 0 00000100:00100000:2.0:1787560883.690313:0:20517:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9caec1788c00:20517] 2 exiting: rc = 0 00000100:00100000:3.0:1787560883.690531:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690538:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690555:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690560:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690566:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690571:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690577:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690582:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690588:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690593:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690598:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690603:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690607:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690612:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690617:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690622:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690627:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690633:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690638:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690644:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690649:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690654:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690661:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690667:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690674:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690680:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690686:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690691:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690696:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690887:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690945:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690955:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690960:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690967:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690972:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690978:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690984:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.690996:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.691069:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.691077:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.691083:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.691088:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.691094:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.691100:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.691105:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.691111:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.691116:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.691121:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.691127:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.691133:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.691139:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.691145:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.691151:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.691157:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.691162:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.691167:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.691173:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.691178:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.691183:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.691187:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.691192:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.691198:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.691203:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.691209:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.693842:0:18689:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9caff323d800:18689] 1 exiting: rc = 0 00000100:00100000:3.0:1787560883.694664:0:20317:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9cafc468ca00:20317] 3 exiting: rc = 0 00000100:00100000:1.0:1787560883.695090:0:18688:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9cafd8c31400:18688] 0 exiting: rc = 1 00000100:00100000:2.0:1787560883.695382:0:18690:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9caff323c600:18690] 2 exiting: rc = 0 00000100:00100000:3.0:1787560883.695621:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.695637:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.695646:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.695673:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.695684:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.695693:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.695701:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.695739:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.695744:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.695750:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.695756:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.695762:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.695767:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.695773:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.695778:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.695784:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.695789:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.695795:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.695801:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.695812:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.695818:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.695989:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.695998:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696003:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696009:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696015:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696020:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696038:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696044:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696050:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696055:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696061:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696614:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696624:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696630:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696637:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696644:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696650:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696655:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696684:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696690:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696695:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696711:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696717:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696722:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696728:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696750:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696757:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696763:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696769:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696774:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696795:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696802:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696808:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696814:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696820:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696976:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696988:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.696997:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.697015:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.697026:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.697049:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.697061:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787560883.697078:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787560883.707862:0:18691:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9cafc465f000:18691] 0 exiting: rc = 1 00000100:00100000:0.0:1787560883.707975:0:18692:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9cafc465f600:18692] 1 exiting: rc = 0 00000100:00100000:2.0:1787560883.708232:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708241:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708246:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708253:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708259:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708264:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708270:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708277:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708283:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708288:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708294:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708299:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708304:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708309:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708314:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708319:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708324:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708330:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708335:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708340:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708346:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708351:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708357:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708362:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708369:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708375:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708379:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708400:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708405:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708410:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708416:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708421:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708427:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708467:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708472:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708478:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708483:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708489:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708495:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708499:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708505:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708510:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708516:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708521:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708526:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708531:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708537:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708543:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708548:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708554:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708559:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708565:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708570:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708576:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708581:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708587:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708592:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708598:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708602:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708608:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708613:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708618:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708631:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.708635:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.709353:0:18694:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9caffc8b7a00:18694] 1 exiting: rc = 0 00000100:00100000:0.0:1787560883.709556:0:18693:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9cafc465fc00:18693] 0 exiting: rc = 1 00000100:00100000:2.0:1787560883.709713:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.709720:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.709727:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.709733:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.709763:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.709775:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.709785:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.709793:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.709800:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.709806:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.709811:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.709817:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.709984:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.709990:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.709998:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710004:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710030:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710036:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710043:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710049:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710055:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710060:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710065:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710070:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710076:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710082:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710087:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710093:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710113:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710119:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710125:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710131:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710149:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710154:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710160:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710165:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710170:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710175:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710180:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710185:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710204:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710222:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710228:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710233:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710238:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710243:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710248:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710255:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710261:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710266:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710271:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710277:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710294:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710301:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710307:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710312:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710318:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710324:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710329:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710334:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710342:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710347:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710352:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787560883.710357:0:21354:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787560883.722164:0:21354:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787560905.708169:0:22119:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787560916.202238:0:22719:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787560916.202247:0:22719:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787560916.202303:0:22719:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787560916.202418:0:22719:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9caffcb60800 00000020:01000004:2.0:1787560916.202465:0:22719:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787560916.202474:0:22719:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787560916.202489:0:22719:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9caff31d0000) 00000020:00000080:2.0:1787560916.202531:0:22719:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787560916.274250:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787560916.277260:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787560916.277955:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1787560916.283187:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787560916.283466:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1787560916.283692:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787560916.284018:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1787560916.284264:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1787560916.284486:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1787560916.284779:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787560916.285014:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787560916.285223:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787560916.285702:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787560916.286006:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1787560916.286266:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787560916.286502:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1787560916.286696:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787560916.287077:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787560916.287266:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1787560916.291362:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1787560916.291871:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1787560916.292193:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787560916.292389:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1787560916.292993:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1787560916.293221:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1787560916.293981:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1787560916.294861:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1787560916.295237:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1787560916.295559:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1787560916.296029:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1787560916.296863:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1787560916.297225:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1787560916.297419:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1787560916.298868:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1787560916.299632:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787560916.302780:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787560916.303866:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1787560916.304279:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1787560916.304533:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1787560916.304800:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787560916.305112:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1787560916.305369:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1787560916.305640:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1787560916.305980:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1787560916.306231:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1787560916.306565:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1787560916.307295:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787560916.310222:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1787560916.310633:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1787560916.311137:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1787560916.314814:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1787560916.315192:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1787560916.315633:0:22719:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:2.0:1787560916.317614:0:22719:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787560916.317852:0:22719:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787560916.317861:0:22719:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787560916.317872:0:22719:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4642c20bf2f35611 00000020:01000004:2.0:1787560916.317880:0:22719:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1787560916.317884:0:22719:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787560916.317889:0:22719:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9caffcb60800 from MGS 00000020:01000004:2.0:1787560916.317892:0:22719:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787560916.317903:0:22719:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9caff31d3370) 00000020:00000080:2.0:1787560916.317924:0:22719:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787560916.317978:0:22719:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9caffcb60800 from MGS, refs=2 00080000:01000000:2.0:1787560916.317992:0:22719:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787560916.318005:0:22719:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4642c20bf2f3561f 00000100:00100000:2.0:1787560916.318109:0:22719:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787560916.318239:0:22719:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787560916.318254:0:22719:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787560916.322388:0:22719:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787560916.322402:0:22719:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787560916.332658:0:22719:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787560916.332853:0:22719:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787560916.332859:0:22719:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787560916.334275:0:22719:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787560916.334287:0:22719:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787560916.347343:0:22719:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787560916.347359:0:22719:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787560916.358893:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560916.358898:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560916.358900:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560916.360177:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560916.360182:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560916.360184:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560916.361547:0:22719:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787560916.373458:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787560916.379099:0:22719:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1787560916.385895:0:22731:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787560916.387294:0:22719:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787560916.387365:0:22719:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787560916.389452:0:22719:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787560916.390165:0:22719:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787560916.390359:0:22719:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787560916.390366:0:22719:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787560916.391978:0:22719:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787560916.392133:0:22719:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787560916.392850:0:22719:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787560916.392858:0:22719:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787560916.393925:0:22719:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787560916.393943:0:22719:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.129@tcp' 00000020:01000004:3.0:1787560916.393945:0:22719:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787560916.393973:0:22719:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.129@tcp (typ=mgc) 00000020:00000080:3.0:1787560916.394001:0:22719:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.129@tcp (ffff9caff324cd28) 00000020:00000080:3.0:1787560916.394018:0:22719:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787560916.394091:0:22719:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9caec21e8800@MGC192.168.203.129@tcp: add connection 192.168.203.129@tcp at head 00010000:00010000:3.0:1787560916.394235:0:22719:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.129@tcp-0 is initialized 00000040:01000000:3.0:1787560916.394241:0:22719:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 1 is initialized 00000100:00080000:2.0:1787560916.394763:0:22736:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1787560916.397007:0:22737:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787560916.397187:0:22719:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.129@tcp (uuid c33dd467-64b2-4362-8604-d1a6489592bb) 00000020:00000080:3.0:1787560916.397210:0:22719:0:(genops.c:1385:class_connect()) connect: client c33dd467-64b2-4362-8604-d1a6489592bb, cookie 0x4642c20bf2f3562d 00000100:00080000:3.0:1787560916.397223:0:22719:0:(import.c:510:import_select_connection()) MGC192.168.203.129@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787560916.397236:0:22719:0:(import.c:624:import_select_connection()) MGC192.168.203.129@tcp: import ffff9caec21e8800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560916.397271:0:22719:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffcbba300 x1874392862922624/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787560916.397300:0:22719:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c33dd467-64b2-4362-8604-d1a6489592bb->MGS 00000020:01000004:3.0:1787560916.397321:0:22719:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787560916.397327:0:22719:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787560916.397344:0:22719:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9caff32499b8) 00000020:00000080:3.0:1787560916.397355:0:22719:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787560916.397569:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c33dd467-64b2-4362-8604-d1a6489592bb:3622:1874392862922624:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787560916.397635:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560916.399146:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862922624 00000100:00100000:0.0:1787560916.399158:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862922624 00000100:00100000:0.0:1787560916.399205:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787560916.399214:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4714c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3622:x1874392862922624:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787560916.399241:0:22733:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c33dd467-64b2-4362-8604-d1a6489592bb@0@lo t0 exp 0000000000000000 cur 635 last 0 00000020:00000080:0.0:1787560916.399273:0:22733:0:(genops.c:1385:class_connect()) connect: client c33dd467-64b2-4362-8604-d1a6489592bb, cookie 0x4642c20bf2f3563b 00000100:00080000:0.0:1787560916.399408:0:22733:0:(import.c:65:import_set_state_nolock()) ffff9caec4a64800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787560916.399512:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4714c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+5:3622:x1874392862922624:12345-0@lo:250:mount.lustre.0 Request processed in 298us (1875us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560916.399520:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787560916.399570:0:3622:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.129@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787560916.399580:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.129@tcp: connect to target with instance 0 00000100:00080000:0.0:1787560916.399587:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.129@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787560916.399592:0:3622:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787560916.399595:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec21e8800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787560916.399598:0:3622:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787560916.399606:0:3622:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787560916.399611:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c33dd467-64b2-4362-8604-d1a6489592bb:3622:1874392862922624:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787560916.425980:0:22719:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787560916.426315:0:22719:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787560916.426322:0:22719:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787560916.429062:0:22719:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787560916.429077:0:22719:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787560916.429674:0:22719:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787560916.429684:0:22719:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787560916.431141:0:22719:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787560916.431329:0:22719:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787560916.431336:0:22719:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787560916.437728:0:22719:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787560916.437744:0:22719:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787560916.503036:0:22719:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787560916.503273:0:22719:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787560916.503281:0:22719:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787560916.504731:0:22719:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787560916.504745:0:22719:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787560916.505530:0:22719:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787560916.505710:0:22719:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787560916.505715:0:22719:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787560916.506876:0:22719:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787560916.506886:0:22719:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787560916.508108:0:22719:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787560916.508343:0:22719:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787560916.508350:0:22719:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787560916.508891:0:22719:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787560916.508898:0:22719:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787560916.509770:0:22719:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787560916.509935:0:22719:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787560916.509940:0:22719:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787560916.510728:0:22719:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787560916.510737:0:22719:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787560916.532737:0:22719:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787560916.532958:0:22719:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787560916.532965:0:22719:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787560916.539282:0:22719:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787560916.539317:0:22719:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787560916.540669:0:22719:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787560916.540682:0:22719:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787560916.542208:0:22719:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787560916.542240:0:22719:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1787560916.542257:0:22719:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.129@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787560916.542385:0:22719:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787560916.542422:0:22719:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.129@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787560916.542427:0:22719:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787560916.542466:0:22719:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787560916.542468:0:22719:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560916.542469:0:22719:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560916.542470:0:22719:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560916.542472:0:22719:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560916.542473:0:22719:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787560916.542480:0:22719:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787560916.542482:0:22719:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560916.542483:0:22719:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787560916.542486:0:22719:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787560916.542488:0:22719:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787560916.542489:0:22719:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787560916.542490:0:22719:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560916.542491:0:22719:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560916.542492:0:22719:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560916.542493:0:22719:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560916.542494:0:22719:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787560916.542495:0:22719:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787560916.542496:0:22719:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560916.542496:0:22719:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787560916.542522:0:22719:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787560916.542543:0:22719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862922752:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787560916.542626:0:22719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560916.542666:0:22719:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffbb62600 going to sleep for 11 seconds 00000100:00100000:1.0:1787560916.542883:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862922752 00000100:00100000:1.0:1787560916.542893:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862922752 00000100:00100000:1.0:1787560916.542945:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787560916.542955:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4715450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+5:22719:x1874392862922752:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787560916.543016:0:22735:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787560916.543019:0:22735:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787560916.543022:0:22735:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1787560916.544010:0:22756:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787560916.547122:0:22735:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:3.0:1787560916.554132:0:22757:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787560916.554144:0:22757:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1787560916.554147:0:22757:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787560916.554150:0:22757:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787560916.556334:0:22757:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1787560916.559117:0:22735:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787560916.559131:0:22735:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787560916.564853:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4715450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+5:22719:x1874392862922752:12345-0@lo:253:mount.lustre.0 Request processed in 21889us (22217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560916.564868:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787560916.565123:0:22719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862922752:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787560916.565142:0:22719:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787560916.565146:0:22719:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787560916.565147:0:22719:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787560916.565149:0:22719:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560916.565150:0:22719:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560916.565151:0:22719:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560916.565153:0:22719:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560916.565154:0:22719:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787560916.565156:0:22719:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787560916.565157:0:22719:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560916.565159:0:22719:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787560916.565181:0:22719:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9caffcb60800 from lustre-MDT0000 10000000:01000000:2.0:1787560916.565215:0:22719:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787560916.565218:0:22719:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787560916.565223:0:22719:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9caff324cd28 10000000:01000000:2.0:1787560916.565227:0:22719:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787560916.565235:0:22719:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9caff324cd28 from 1 10000000:01000000:2.0:1787560916.565262:0:22719:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787560916.565386:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f35642 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560916.565400:0:22719:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f35642 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560916.565410:0:22719:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f35642 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560916.565464:0:22719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862922880:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787560916.565507:0:22719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560916.565555:0:22719:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffbb62cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560916.565620:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862922880 00000100:00100000:1.0:1787560916.565628:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862922880 00000100:00100000:1.0:1787560916.565668:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787560916.565677:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4717450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+5:22719:x1874392862922880:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787560916.565689:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560916.565704:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caec3880600/0x4642c20bf2f35649 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f35642 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560916.565726:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec3880600/0x4642c20bf2f35649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f35642 expref: 6 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560916.565748:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caec3880600/0x4642c20bf2f35649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35642 expref: 6 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560916.565759:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3880600, rc 0) 00000100:00100000:1.0:1787560916.565804:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4717450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+6:22719:x1874392862922880:12345-0@lo:101:mount.lustre.0 Request processed in 127us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560916.565811:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787560916.565839:0:22719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862922880:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787560916.565855:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f35642 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35649 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560916.565866:0:22719:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f35642 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35649 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560916.565924:0:22719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862923008:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560916.565953:0:22719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560916.566001:0:22719:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc2cd7600 going to sleep for 11 seconds 00000100:00100000:2.0:1787560916.566021:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862923008 00000100:00100000:2.0:1787560916.566026:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862923008 00000100:00100000:2.0:1787560916.566059:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787560916.566066:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4714850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+6:22719:x1874392862923008:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560916.566143:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4714850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+6:22719:x1874392862923008:12345-0@lo:501:mount.lustre.0 Request processed in 77us (189us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787560916.566151:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787560916.566476:0:22719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862923008:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787560916.566516:0:22719:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787560916.566532:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f35642 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35649 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560916.566540:0:22719:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f35642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35649 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560916.566547:0:22719:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9caffcb60800 10000000:01000000:0.0:1787560916.566552:0:22719:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787560916.566556:0:22719:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9caffcb60800 10000000:01000000:0.0:1787560916.566558:0:22719:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787560916.566561:0:22719:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9caffcb60800 from 1 10000000:01000000:0.0:1787560916.566563:0:22719:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787560916.566582:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbff400/0x4642c20bf2f35650 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560916.566590:0:22719:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffcbff400/0x4642c20bf2f35650 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560916.566598:0:22719:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffcbff400/0x4642c20bf2f35650 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560916.566611:0:22719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862923136:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787560916.566653:0:22719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560916.566682:0:22719:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd7c29c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787560916.567024:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862923136 00000100:00100000:3.0:1787560916.567031:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862923136 00000100:00100000:3.0:1787560916.567075:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787560916.567083:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4716450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+6:22719:x1874392862923136:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787560916.567093:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560916.567106:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f35657 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f35650 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560916.567122:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f35657 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f35650 expref: 7 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560916.567131:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafda2f7000/0x4642c20bf2f35657 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35650 expref: 7 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560916.567139:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7000, rc 0) 00000100:00100000:3.0:1787560916.567187:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4716450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+7:22719:x1874392862923136:12345-0@lo:101:mount.lustre.0 Request processed in 104us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560916.567194:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787560916.568637:0:22719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862923136:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787560916.568673:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffcbff400/0x4642c20bf2f35650 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35657 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560916.568687:0:22719:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffcbff400/0x4642c20bf2f35650 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35657 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560916.568709:0:22719:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787560916.568725:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbff400/0x4642c20bf2f35650 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35657 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560916.568733:0:22719:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffcbff400/0x4642c20bf2f35650 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35657 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560916.568741:0:22719:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787560916.568748:0:22719:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787560916.568753:0:22719:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9caffcb60800 10000000:01000000:1.0:1787560916.568756:0:22719:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787560916.568760:0:22719:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787560916.568762:0:22719:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787560916.568810:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3880000/0x4642c20bf2f3565e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560916.568817:0:22719:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caec3880000/0x4642c20bf2f3565e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560916.568826:0:22719:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caec3880000/0x4642c20bf2f3565e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560916.568851:0:22719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862923264:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787560916.568903:0:22719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560916.568955:0:22719:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd08b0300 going to sleep for 11 seconds 00000100:00100000:3.0:1787560916.569019:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862923264 00000100:00100000:3.0:1787560916.569027:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862923264 00000100:00100000:3.0:1787560916.569076:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787560916.569087:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4714050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+7:22719:x1874392862923264:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787560916.569100:0:22735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560916.569114:0:22735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafda2f7a00/0x4642c20bf2f35665 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f3565e expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560916.569133:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafda2f7a00/0x4642c20bf2f35665 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f3565e expref: 8 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560916.569172:0:22735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafda2f7a00/0x4642c20bf2f35665 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f3565e expref: 8 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560916.569182:0:22735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7a00, rc 0) 00000100:00100000:3.0:1787560916.569226:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4714050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+8:22719:x1874392862923264:12345-0@lo:101:mount.lustre.0 Request processed in 142us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560916.569232:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787560916.569741:0:22719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862923264:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787560916.569754:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caec3880000/0x4642c20bf2f3565e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35665 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560916.569775:0:22719:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caec3880000/0x4642c20bf2f3565e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35665 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560916.569833:0:22719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862923392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787560916.569862:0:22719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560916.569892:0:22719:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd7c29f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787560916.570398:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862923392 00000100:00100000:2.0:1787560916.570404:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862923392 00000100:00100000:2.0:1787560916.570474:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787560916.570483:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+8:22719:x1874392862923392:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560916.570632:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+9:22719:x1874392862923392:12345-0@lo:501:mount.lustre.0 Request processed in 150us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560916.570639:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787560916.571042:0:22719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862923392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787560916.571081:0:22719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862923520:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787560916.571129:0:22719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560916.571174:0:22719:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd7c29f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787560916.571229:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862923520 00000100:00100000:1.0:1787560916.571235:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862923520 00000100:00100000:1.0:1787560916.571270:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787560916.571278:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+9:22719:x1874392862923520:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787560916.572630:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+9:22719:x1874392862923520:12345-0@lo:503:mount.lustre.0 Request processed in 1346us (1494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560916.572641:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787560916.573051:0:22719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862923520:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787560916.573824:0:22758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbba680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c33dd467-64b2-4362-8604-d1a6489592bb:22758:1874392862923648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787560916.573892:0:22758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560916.573934:0:22758:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc2cd7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787560916.574018:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862923648 00000100:00100000:2.0:1787560916.574032:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862923648 00000100:00100000:2.0:1787560916.574088:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787560916.574098:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+9:22758:x1874392862923648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560916.574997:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+9:22758:x1874392862923648:12345-0@lo:502:llog_process_th.0 Request processed in 885us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560916.575009:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787560916.575202:0:22758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbba680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c33dd467-64b2-4362-8604-d1a6489592bb:22758:1874392862923648:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787560916.575242:0:22758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560916.575258:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560916.575260:0:22758:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787560916.575267:0:22758:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787560916.575271:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787560916.575290:0:22758:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9cafeabd0000) 00000020:00000080:1.0:1787560916.575308:0:22758:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787560916.575329:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787560916.575486:0:22758:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787560916.575501:0:22758:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4642c20bf2f35673 00000020:00000080:1.0:1787560916.575744:0:22758:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787560916.575751:0:22758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560916.575755:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560916.575757:0:22758:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787560916.575759:0:22758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560916.575763:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560916.575764:0:22758:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787560916.575768:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787560916.575776:0:22758:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9cafeabd4d28) 00000020:00000080:1.0:1787560916.575786:0:22758:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787560916.575790:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787560916.575793:0:22758:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787560916.575795:0:22758:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787560916.575802:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787560916.575853:0:22758:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9caffcb60800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787560916.575868:0:22758:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9cafeabd3370) 00000020:00000080:1.0:1787560916.575877:0:22758:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787560916.576866:0:22758:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787560916.576875:0:22758:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4642c20bf2f35688 00000020:00000080:1.0:1787560916.577069:0:22758:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787560916.577076:0:22758:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787560916.577080:0:22758:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4642c20bf2f3568f 00080000:01000000:1.0:1787560916.577086:0:22758:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787560916.577089:0:22758:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4642c20bf2f35696 00010000:00010000:2.0:1787560916.690478:0:22758:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787560916.690998:0:22758:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:2.0:1787560916.691288:0:22758:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787560916.692095:0:22758:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9caff31d19b8) 00000020:00000080:2.0:1787560916.692118:0:22758:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787560916.692209:0:22758:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787560916.692216:0:22758:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4642c20bf2f356a4 00000020:00000080:3.0:1787560916.700570:0:22758:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787560916.704163:0:22758:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4642c20bf2f356ab 00000020:00000080:2.0:1787560916.708193:0:22758:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787560916.708214:0:22758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560916.708226:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560916.708228:0:22758:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787560916.708232:0:22758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787560916.708235:0:22758:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1787560916.708236:0:22758:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787560916.708238:0:22758:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787560916.708239:0:22758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787560916.708243:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560916.708244:0:22758:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787560916.708246:0:22758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560916.708251:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560916.708252:0:22758:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787560916.708256:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787560916.708312:0:22758:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787560916.708332:0:22758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560916.708335:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560916.708349:0:22758:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787560916.708353:0:22758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560916.708356:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560916.708357:0:22758:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1787560916.708360:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787560916.708365:0:22758:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:00000080:2.0:1787560916.708395:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787560916.708415:0:22758:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9caff31d4d28) 00000020:00000080:2.0:1787560916.708453:0:22758:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787560916.708459:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787560916.708530:0:22758:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1787560916.708537:0:22758:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787560916.708544:0:22758:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4642c20bf2f356b9 00010000:00080000:2.0:1787560916.708578:0:22758:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cafc68d6000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.129@tcp at head 00010000:00010000:2.0:1787560916.713275:0:22758:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1787560916.715214:0:22758:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787560916.715230:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787560916.715270:0:22758:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787560916.715294:0:22758:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4642c20bf2f356c0 00000100:00080000:3.0:1787560916.715305:0:22758:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787560916.715312:0:22758:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9cafc68d6000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560916.715354:0:22758:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffcbb8e00 x1874392862923776/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787560916.715387:0:22758:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1787560916.715481:0:22758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560916.715486:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560916.715489:0:22758:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1787560916.715492:0:22758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787560916.715495:0:22758:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1787560916.715497:0:22758:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787560916.715511:0:22758:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787560916.715513:0:22758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787560916.715516:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560916.715517:0:22758:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787560916.715520:0:22758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787560916.715525:0:22758:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787560916.715529:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560916.715530:0:22758:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787560916.715533:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787560916.715538:0:22758:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:01000000:3.0:1787560916.715568:0:22758:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787560916.715571:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787560916.715587:0:22758:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9caff324b370) 00000020:00000080:3.0:1787560916.715601:0:22758:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787560916.715606:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787560916.715674:0:22758:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787560916.715682:0:22758:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787560916.715688:0:22758:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4642c20bf2f356ce 00010000:00080000:3.0:1787560916.715735:0:22758:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9caffff55000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.129@tcp at head 00010000:00010000:3.0:1787560916.716002:0:22758:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1787560916.716656:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862923776:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787560916.716734:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:1.0:1787560916.717346:0:22758:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787560916.717547:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862923776 00000100:00100000:3.0:1787560916.717557:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862923776 00000100:00100000:3.0:1787560916.717593:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787560916.717602:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffba2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1874392862923776:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1787560916.717622:0:22745:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1787560916.718464:0:22758:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1787560916.720049:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c33dd467-64b2-4362-8604-d1a6489592bb:3625:1874392862923904:0@lo:400:kworker.0 00000100:00100000:1.0:1787560916.720128:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560916.720187:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862923904 00000100:00100000:1.0:1787560916.720208:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862923904 00000100:00100000:1.0:1787560916.720261:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787560916.720271:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+9:3625:x1874392862923904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560916.720327:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+9:3625:x1874392862923904:12345-0@lo:400:kworker.0 Request processed in 57us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560916.720334:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787560916.720384:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c33dd467-64b2-4362-8604-d1a6489592bb:3625:1874392862923904:0@lo:400:kworker.0 00000040:00080000:2.0:1787560916.727710:0:22758:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787560916.728681:0:22758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1787560916.745872:0:22758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000100:00100000:3.0:1787560916.747259:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffba2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1874392862923776:12345-0@lo:38:llog_process_th.0 Request processed in 29651us (30518us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787560916.747271:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787560916.747455:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafc68d6000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787560916.747462:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787560916.747466:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862923776:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787560916.748721:0:22764:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787560916.748729:0:22764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787560916.750383:0:22758:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787560916.750399:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787560916.750634:0:22758:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787560916.750658:0:22758:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4642c20bf2f356d5 00000100:00080000:2.0:1787560916.750670:0:22758:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787560916.750677:0:22758:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9caffff55000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560916.750720:0:22758:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafc46eb480 x1874392862924032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787560916.750809:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862924032:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787560916.750886:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874392862924032 offset 0 length 520: 4 00000100:00080000:2.0:1787560916.757043:0:22758:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787560916.757407:0:22758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560916.757415:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560916.757418:0:22758:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787560916.757423:0:22758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787560916.757467:0:22758:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1787560916.757469:0:22758:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787560916.757471:0:22758:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787560916.757473:0:22758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787560916.757476:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560916.757477:0:22758:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787560916.757479:0:22758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787560916.757484:0:22758:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787560916.757487:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560916.757488:0:22758:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787560916.757491:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787560916.757495:0:22758:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:01000000:2.0:1787560916.757524:0:22758:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787560916.757527:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787560916.757547:0:22758:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9caec2fb4d28) 00000020:00000080:2.0:1787560916.757568:0:22758:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1787560916.757574:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787560916.757678:0:22758:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787560916.757685:0:22758:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1787560916.757692:0:22758:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4642c20bf2f356e3 00010000:00080000:2.0:1787560916.757723:0:22758:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cafc58be000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.129@tcp at head 00010000:00010000:2.0:1787560916.758042:0:22758:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1787560916.758142:0:22758:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787560916.758157:0:22758:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787560916.763012:0:22758:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787560916.763327:0:22758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1787560916.763471:0:22758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:2.0:1787560916.765605:0:22766:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787560916.765617:0:22766:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787560916.767102:0:22758:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787560916.767123:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787560916.767182:0:22758:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787560916.767206:0:22758:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4642c20bf2f356ea 00000100:00080000:1.0:1787560916.767220:0:22758:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787560916.767228:0:22758:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cafc58be000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787560916.767274:0:22758:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffba2c380 x1874392862924160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787560916.767423:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862924160:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787560916.767529:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874392862924160 offset 0 length 520: 4 00000100:00080000:1.0:1787560916.767735:0:22758:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787560916.767807:0:22758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560916.767812:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560916.767813:0:22758:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787560916.767816:0:22758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560916.767820:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560916.767836:0:22758:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787560916.767840:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787560916.767842:0:22758:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787560916.767844:0:22758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560916.767847:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560916.767848:0:22758:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787560916.767850:0:22758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560916.767853:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560916.767854:0:22758:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787560916.767857:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787560916.767887:0:22758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c33dd467-64b2-4362-8604-d1a6489592bb:22758:1874392862924288:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560916.767953:0:22758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560916.768089:0:22758:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafeec68cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560916.768474:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862924288 00000100:00100000:2.0:1787560916.768483:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862924288 00000100:00100000:2.0:1787560916.768536:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787560916.768557:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+9:22758:x1874392862924288:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560916.768711:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+9:22758:x1874392862924288:12345-0@lo:502:llog_process_th.0 Request processed in 156us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560916.768719:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787560916.769957:0:22758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c33dd467-64b2-4362-8604-d1a6489592bb:22758:1874392862924288:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787560916.770025:0:22758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560916.770033:0:22758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560916.770036:0:22758:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787560916.770041:0:22758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1787560916.770344:0:22719:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1787560916.770374:0:22719:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787560916.770405:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3880000/0x4642c20bf2f3565e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35665 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560916.770418:0:22719:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caec3880000/0x4642c20bf2f3565e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35665 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560916.770428:0:22719:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9caffcb60800 from 1 10000000:01000000:0.0:1787560916.770462:0:22719:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787560916.770508:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f356f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560916.770517:0:22719:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f356f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560916.770527:0:22719:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f356f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560916.770551:0:22719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862924416:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787560916.770621:0:22719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560916.770655:0:22719:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd7c293c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560916.773276:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862924416 00000100:00100000:1.0:1787560916.773293:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862924416 00000100:00100000:1.0:1787560916.773381:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787560916.773392:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+9:22719:x1874392862924416:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787560916.773423:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560916.773478:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caec3881a00/0x4642c20bf2f356f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f356f1 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560916.773508:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec3881a00/0x4642c20bf2f356f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f356f1 expref: 10 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560916.773521:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caec3881a00/0x4642c20bf2f356f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f356f1 expref: 10 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560916.773531:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881a00, rc 0) 00000100:00100000:1.0:1787560916.773622:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+10:22719:x1874392862924416:12345-0@lo:101:mount.lustre.0 Request processed in 232us (3000us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560916.773628:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787560916.774337:0:22719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862924416:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787560916.774360:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f356f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f356f8 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560916.774370:0:22719:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f356f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f356f8 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560916.774955:0:22719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862924544:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787560916.775018:0:22719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560916.775048:0:22719:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd7c293c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560916.776667:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862924544 00000100:00100000:1.0:1787560916.776681:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862924544 00000100:00100000:1.0:1787560916.776765:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787560916.776778:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+10:22719:x1874392862924544:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787560916.776811:0:22734:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787560916.776820:0:22734:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787560916.776978:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+10:22719:x1874392862924544:12345-0@lo:256:mount.lustre.0 Request processed in 203us (1958us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560916.776996:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787560916.777726:0:22719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862924544:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787560916.778692:0:22719:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787560916.778758:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f356f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f356f8 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560916.778838:0:22719:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f356f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f356f8 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560916.778849:0:22719:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9caffcb60800 from 1 10000000:01000000:0.0:1787560916.778852:0:22719:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787560916.778897:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbff600/0x4642c20bf2f356ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560916.778905:0:22719:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffcbff600/0x4642c20bf2f356ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560916.778925:0:22719:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffcbff600/0x4642c20bf2f356ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560916.778951:0:22719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862924672:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787560916.779018:0:22719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560916.779066:0:22719:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd7c293c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560916.779164:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862924672 00000100:00100000:2.0:1787560916.779171:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862924672 00000100:00100000:2.0:1787560916.779211:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787560916.779220:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+10:22719:x1874392862924672:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787560916.779233:0:22735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560916.779247:0:22735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f35706 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f356ff expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560916.779270:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f35706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f356ff expref: 11 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560916.779281:0:22735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f35706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f356ff expref: 11 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560916.779290:0:22735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca49c00, rc 0) 00000100:00100000:2.0:1787560916.779344:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+11:22719:x1874392862924672:12345-0@lo:101:mount.lustre.0 Request processed in 124us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560916.779350:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787560916.779731:0:22719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862924672:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787560916.779745:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffcbff600/0x4642c20bf2f356ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35706 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560916.779766:0:22719:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffcbff600/0x4642c20bf2f356ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35706 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560916.779827:0:22719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862924800:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787560916.779855:0:22719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560916.779883:0:22719:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd7c293c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560916.779996:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862924800 00000100:00100000:2.0:1787560916.780001:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862924800 00000100:00100000:2.0:1787560916.780036:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787560916.780043:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+11:22719:x1874392862924800:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560916.780179:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+11:22719:x1874392862924800:12345-0@lo:501:mount.lustre.0 Request processed in 136us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560916.780192:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787560916.780468:0:22719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862924800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560916.780499:0:22719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862924928:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787560916.780540:0:22719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560916.780555:0:22719:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c5180 going to sleep for 11 seconds 00000100:00100000:0.0:1787560916.780842:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862924928 00000100:00100000:0.0:1787560916.780848:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862924928 00000100:00100000:0.0:1787560916.780884:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787560916.780892:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+11:22719:x1874392862924928:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787560916.781007:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+11:22719:x1874392862924928:12345-0@lo:503:mount.lustre.0 Request processed in 115us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560916.781013:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787560916.781177:0:22719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862924928:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787560916.782192:0:22768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c33dd467-64b2-4362-8604-d1a6489592bb:22768:1874392862925056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560916.782254:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560916.782297:0:22768:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787560916.782399:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862925056 00000100:00100000:0.0:1787560916.782405:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862925056 00000100:00100000:0.0:1787560916.782467:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787560916.782475:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+11:22768:x1874392862925056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560916.782973:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+11:22768:x1874392862925056:12345-0@lo:502:llog_process_th.0 Request processed in 497us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560916.782989:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787560916.783107:0:22768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c33dd467-64b2-4362-8604-d1a6489592bb:22768:1874392862925056:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787560916.783136:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560916.783146:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560916.783148:0:22768:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787560916.783154:0:22768:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9caffcb60800 00000020:00000080:1.0:1787560916.783157:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787560916.783164:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560916.783166:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560916.783167:0:22768:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787560916.783170:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560916.783176:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560916.783178:0:22768:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787560916.783181:0:22768:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9caffcb60800 00000020:00000080:1.0:1787560916.783183:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787560916.783239:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560916.783242:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560916.783244:0:22768:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787560916.783245:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560916.783248:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560916.783249:0:22768:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787560916.783252:0:22768:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9caffcb60800 00000020:00000080:1.0:1787560916.783254:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787560916.783270:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560916.783272:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560916.783273:0:22768:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787560916.783275:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787560916.783277:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560916.783279:0:22768:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787560916.783282:0:22768:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9caffcb60800 00000020:00000080:1.0:1787560916.783284:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787560916.783376:0:22768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c33dd467-64b2-4362-8604-d1a6489592bb:22768:1874392862925184:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560916.783409:0:22768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560916.783457:0:22768:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787560916.783508:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862925184 00000100:00100000:2.0:1787560916.783513:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862925184 00000100:00100000:2.0:1787560916.783543:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787560916.783549:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+11:22768:x1874392862925184:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787560916.783626:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+11:22768:x1874392862925184:12345-0@lo:502:llog_process_th.0 Request processed in 76us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560916.783633:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787560916.783714:0:22768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c33dd467-64b2-4362-8604-d1a6489592bb:22768:1874392862925184:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787560916.783733:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787560916.783738:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560916.783739:0:22768:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787560916.783742:0:22768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1787560916.792043:0:22719:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787560916.792096:0:22719:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787560916.792180:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbff600/0x4642c20bf2f356ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35706 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560916.792193:0:22719:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffcbff600/0x4642c20bf2f356ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35706 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560916.792262:0:22719:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787560916.792266:0:22719:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9caffcb60800 10000000:01000000:2.0:1787560916.792269:0:22719:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9caffcb60800 10000000:01000000:2.0:1787560916.792273:0:22719:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787560916.792280:0:22719:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9caffcb60800 from 1 10000000:01000000:2.0:1787560916.792282:0:22719:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787560916.792331:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca48e00/0x4642c20bf2f3570d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560916.792340:0:22719:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffca48e00/0x4642c20bf2f3570d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560916.792351:0:22719:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffca48e00/0x4642c20bf2f3570d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560916.792392:0:22719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862925312:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787560916.792479:0:22719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560916.792530:0:22719:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc46e7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787560916.795482:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862925312 00000100:00100000:0.0:1787560916.795495:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862925312 00000100:00100000:0.0:1787560916.795555:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787560916.795566:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+11:22719:x1874392862925312:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787560916.795584:0:22735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560916.795606:0:22735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffcbfe000/0x4642c20bf2f35714 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f3570d expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560916.795636:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffcbfe000/0x4642c20bf2f35714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f3570d expref: 12 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560916.795646:0:22735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffcbfe000/0x4642c20bf2f35714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f3570d expref: 12 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560916.795669:0:22735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbfe000, rc 0) 00000100:00100000:0.0:1787560916.795759:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+12:22719:x1874392862925312:12345-0@lo:101:mount.lustre.0 Request processed in 195us (3279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560916.795766:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787560916.796717:0:22719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862925312:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787560916.796744:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffca48e00/0x4642c20bf2f3570d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35714 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560916.796756:0:22719:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffca48e00/0x4642c20bf2f3570d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35714 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560916.796841:0:22719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862925440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560916.796885:0:22719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560916.796978:0:22719:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc46e7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787560916.797427:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862925440 00000100:00100000:0.0:1787560916.797446:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862925440 00000100:00100000:0.0:1787560916.797481:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787560916.797490:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+12:22719:x1874392862925440:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787560916.797619:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+12:22719:x1874392862925440:12345-0@lo:501:mount.lustre.0 Request processed in 129us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560916.797626:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787560916.797881:0:22719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862925440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560916.798006:0:22719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862925568:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787560916.798046:0:22719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560916.798070:0:22719:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc46e7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787560916.799473:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862925568 00000100:00100000:0.0:1787560916.799485:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862925568 00000100:00100000:0.0:1787560916.799534:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787560916.799544:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+12:22719:x1874392862925568:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787560916.799684:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+12:22719:x1874392862925568:12345-0@lo:503:mount.lustre.0 Request processed in 141us (1637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560916.799692:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787560916.799867:0:22719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862925568:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787560916.809544:0:22773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c33dd467-64b2-4362-8604-d1a6489592bb:22773:1874392862925696:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560916.809630:0:22773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560916.813081:0:22773:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd99b6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787560916.813226:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862925696 00000100:00100000:1.0:1787560916.813238:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862925696 00000100:00100000:1.0:1787560916.813299:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787560916.813329:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4221c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+12:22773:x1874392862925696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560916.813532:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4221c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+12:22773:x1874392862925696:12345-0@lo:502:llog_process_th.0 Request processed in 216us (3901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560916.813541:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787560916.813728:0:22773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c33dd467-64b2-4362-8604-d1a6489592bb:22773:1874392862925696:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787560916.813798:0:22773:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787560916.813813:0:22773:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9caffb990000) 00000020:00000080:0.0:1787560916.813839:0:22773:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1787560916.815471:0:22773:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9caffcb60800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787560916.815480:0:22773:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9caffcb60800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787560916.815484:0:22773:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9caffcb60800 4 00010000:00080000:0.0:1787560916.815517:0:22773:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cafd9933800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.129@tcp at head 00010000:00010000:0.0:1787560916.822583:0:22773:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1787560916.829250:0:22773:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787560916.829296:0:22773:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787560916.829314:0:22773:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4642c20bf2f35722 00000100:00080000:0.0:1787560916.829327:0:22773:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787560916.829334:0:22773:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9cafd9933800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:0.0:1787560916.829369:0:22773:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffbaf4700 x1874392862925824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787560916.829412:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874392862925824:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787560916.829516:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787560916.829578:0:22773:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787560916.834058:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862925824 00000100:00100000:1.0:1787560916.834078:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862925824 00000100:00100000:1.0:1787560916.834134:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787560916.834144:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1874392862925824:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787560916.834249:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1874392862925824:12345-0@lo:38:llog_process_th.0 Request processed in 105us (4732us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787560916.834255:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787560916.836881:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787560916.836895:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafd9933800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787560916.836903:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787560916.839269:0:22773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c33dd467-64b2-4362-8604-d1a6489592bb:22773:1874392862925952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560916.839364:0:22773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560916.839416:0:22773:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c5840 going to sleep for 11 seconds 00000100:00100000:0.0:1787560916.841656:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874392862925824:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787560916.841708:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862925952 00000100:00100000:0.0:1787560916.841716:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862925952 00000100:00100000:0.0:1787560916.841766:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787560916.841775:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4223c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+12:22773:x1874392862925952:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560916.841976:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4223c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+12:22773:x1874392862925952:12345-0@lo:502:llog_process_th.0 Request processed in 201us (2611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560916.842002:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787560916.844414:0:22773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c33dd467-64b2-4362-8604-d1a6489592bb:22773:1874392862925952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560916.844532:0:22773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c33dd467-64b2-4362-8604-d1a6489592bb:22773:1874392862926080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787560916.844603:0:22773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560916.844648:0:22773:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c5840 going to sleep for 11 seconds 00000100:00100000:0.0:1787560916.845534:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862926080 00000100:00100000:0.0:1787560916.845545:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862926080 00000100:00100000:0.0:1787560916.846016:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787560916.846028:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4223050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+12:22773:x1874392862926080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787560916.846177:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4223050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+12:22773:x1874392862926080:12345-0@lo:502:llog_process_th.0 Request processed in 152us (1573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560916.846185:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787560916.849162:0:22773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c33dd467-64b2-4362-8604-d1a6489592bb:22773:1874392862926080:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787560916.849223:0:22773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787560916.851132:0:22719:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787560916.851175:0:22719:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787560916.851194:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca48e00/0x4642c20bf2f3570d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35714 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560916.851205:0:22719:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffca48e00/0x4642c20bf2f3570d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35714 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787560916.851269:0:22719:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787560916.851271:0:22719:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787560916.851272:0:22719:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787560916.851274:0:22719:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787560916.851275:0:22719:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787560916.851277:0:22719:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787560916.851279:0:22719:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787560916.851280:0:22719:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787560916.851282:0:22719:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787560916.851283:0:22719:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787560916.851287:0:22719:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787560916.851290:0:22719:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787560916.851291:0:22719:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787560916.851292:0:22719:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787560916.851293:0:22719:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787560916.851294:0:22719:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787560916.851295:0:22719:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787560916.851296:0:22719:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787560916.851297:0:22719:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787560916.851298:0:22719:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787560916.851299:0:22719:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787560916.851327:0:22719:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787560916.851347:0:22719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862926208:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787560916.851414:0:22719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560916.851469:0:22719:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560916.852806:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862926208 00000100:00100000:1.0:1787560916.852818:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862926208 00000100:00100000:1.0:1787560916.852905:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787560916.852928:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4222050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+12:22719:x1874392862926208:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787560916.852968:0:22735:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787560916.852994:0:22735:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787560916.855414:0:22735:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787560916.855427:0:22735:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787560916.855706:0:22756:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787560916.855712:0:22756:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787560916.855736:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9caec3881c00/0x4642c20bf2f35729 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560916.855758:0:22756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caec3881a00/0x4642c20bf2f356f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f356f1 expref: 12 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560916.855767:0:22756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9caec3881c00/0x4642c20bf2f35729 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560916.855811:0:22756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caec3881a00/0x4642c20bf2f356f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f356f1 expref: 12 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560916.855830:0:22756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9caec3881a00/0x4642c20bf2f356f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f356f1 expref: 12 pid: 22734 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560916.855848:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22756:1874392862926336:0@lo:104: 00000100:00100000:1.0:1787560916.857483:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560916.857544:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c5300 going to sleep for 11 seconds 00000100:00100000:1.0:1787560916.857667:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4222050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+12:22719:x1874392862926208:12345-0@lo:253:mount.lustre.0 Request processed in 4740us (6251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560916.857678:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787560916.860238:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862926336 00000100:00100000:2.0:1787560916.860255:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862926336 00000100:00100000:2.0:1787560916.860450:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787560916.860463:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffba2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c33dd467-64b2-4362-8604-d1a6489592bb+3:22756:x1874392862926336:12345-0@lo:104: 00010000:00010000:2.0:1787560916.860491:0:22723:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f356f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f356f8 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560916.860586:0:22723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787560916.860592:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffba2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c33dd467-64b2-4362-8604-d1a6489592bb+3:22756:x1874392862926336:12345-0@lo:104: Request processed in 133us (3169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560916.860599:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787560916.860623:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560916.860629:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f356f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f356f8 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560916.860638:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbffc00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:2.0:1787560916.860642:0:22729:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f356f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f356f8 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560916.860651:0:22729:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f356f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f356f8 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560916.860660:0:22729:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f356f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f356f8 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560916.860666:0:22729:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787560916.860704:0:22729:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f356f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f356f8 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560916.860711:0:22729:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560916.860733:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f356f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f356f8 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560916.860741:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caffcbffc00/0x4642c20bf2f356f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f356f8 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560916.860761:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560916.860763:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560916.860765:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560916.860781:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c33dd467-64b2-4362-8604-d1a6489592bb:3626:1874392862926464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787560916.860824:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560916.860888:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862926464 00000100:00100000:2.0:1787560916.860893:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862926464 00010000:00010000:2.0:1787560916.860929:0:22725:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caec3881a00/0x4642c20bf2f356f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f356f1 expref: 12 pid: 22734 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560916.860954:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787560916.860961:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c33dd467-64b2-4362-8604-d1a6489592bb+12:3626:x1874392862926464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787560916.860974:0:22725:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560916.860989:0:22725:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caec3881a00/0x4642c20bf2f356f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f356f1 expref: 12 pid: 22734 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560916.861000:0:22725:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caec3881a00/0x4642c20bf2f356f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f356f1 expref: 12 pid: 22734 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560916.861019:0:22725:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9caec3881c00/0x4642c20bf2f35729 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560916.861028:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec3881c00/0x4642c20bf2f35729 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787560916.861045:0:22725:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005333257s 00010000:00010000:2.0:1787560916.861050:0:22725:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9caec3881c00/0x4642c20bf2f35729 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560916.861066:0:22725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9caec3881c00/0x4642c20bf2f35729 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560916.861074:0:22725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9caec3881c00/0x4642c20bf2f35729 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560916.861080:0:22725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9caec3881c00/0x4642c20bf2f35729 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560916.861086:0:22725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881c00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:2.0:1787560916.861090:0:22725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9caec3881c00/0x4642c20bf2f35729 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560916.861097:0:22725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9caec3881c00/0x4642c20bf2f35729 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560916.861106:0:22725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9caec3881c00/0x4642c20bf2f35729 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560916.861117:0:22725:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560916.861148:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c33dd467-64b2-4362-8604-d1a6489592bb+12:3626:x1874392862926464:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560916.861154:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787560916.861191:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c33dd467-64b2-4362-8604-d1a6489592bb:3626:1874392862926464:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560916.861319:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caec3881a00/0x4642c20bf2f356f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f356f1 expref: 11 pid: 22734 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560916.861331:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22756:1874392862926336:0@lo:104: 00010000:00010000:1.0:1787560916.861346:0:22756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9caec3881c00/0x4642c20bf2f35729 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560916.861355:0:22756:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9caec3881c00/0x4642c20bf2f35729 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560916.861369:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9caec3881c00/0x4642c20bf2f35729 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560916.861375:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caec3881c00/0x4642c20bf2f35729 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560916.863053:0:22719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:22719:1874392862926208:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787560916.863071:0:22719:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787560916.863074:0:22719:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787560916.863076:0:22719:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787560916.863077:0:22719:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787560916.863078:0:22719:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787560916.863079:0:22719:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787560916.863080:0:22719:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787560916.863082:0:22719:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787560916.863083:0:22719:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787560916.863085:0:22719:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787560916.863086:0:22719:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787560916.863102:0:22719:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:0.0:1787560916.901681:0:22719:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:0.0:1787560916.903079:0:22719:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1787560916.903317:0:22780:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:2.0:1787560916.903324:0:22780:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:01000000:0.0:1787560916.903484:0:22781:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1787560916.904119:0:22781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1787560916.904569:0:22719:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:1.0:1787560916.906156:0:22782:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9caffba2f800 x1874392862926592/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560916.906170:0:22782:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c53c0 going to sleep for 0 seconds 00000040:01000000:2.0:1787560916.907259:0:22719:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787560916.907302:0:22719:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787560916.907745:0:22719:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787560916.907772:0:22719:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787560916.907811:0:22719:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787560916.908773:0:22719:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787560916.909328:0:22719:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787560916.909364:0:22719:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787560916.914655:0:22781:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787560916.914776:0:22781:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1787560916.920160:0:22719:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:0.0:1787560916.924172:0:22719:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:1.0:1787560916.936744:0:22719:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1787560916.939263:0:22719:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787560916.939306:0:22719:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb6db41a2f988 00100000:10000000:1.0:1787560916.939314:0:22719:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787560916.940220:0:22719:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787560916.940237:0:22719:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.129@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787560916.940257:0:22719:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1787560916.940274:0:22719:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1787560916.941337:0:22719:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787560916.948838:0:22719:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787560917.431467:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787560917.568362:0:22737:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787560917.568371:0:22737:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9caffcb60800 from 11 10000000:01000000:2.0:1787560917.568377:0:22737:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787560917.568643:0:22737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35730 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560917.568757:0:22737:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35730 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560917.568771:0:22737:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35730 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560917.568801:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862926720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787560917.568872:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560917.569048:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc46e7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787560917.572158:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862926720 00000100:00100000:0.0:1787560917.572172:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862926720 00000100:00100000:0.0:1787560917.572237:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787560917.572257:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4222c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+11:22737:x1874392862926720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787560917.572274:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560917.572295:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffcbfe200/0x4642c20bf2f35737 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f35730 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560917.572329:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffcbfe200/0x4642c20bf2f35737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f35730 expref: 12 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560917.572340:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffcbfe200/0x4642c20bf2f35737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35730 expref: 12 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560917.572350:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbfe200, rc 0) 00000100:00100000:0.0:1787560917.572456:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4222c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+12:22737:x1874392862926720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 210us (3583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560917.572463:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787560917.572556:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862926720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787560917.572573:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35730 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35737 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560917.572583:0:22737:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35730 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35737 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560917.572667:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862926848:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787560917.572705:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560917.572731:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe0a65540 going to sleep for 11 seconds 00000100:00100000:2.0:1787560917.572916:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862926848 00000100:00100000:2.0:1787560917.572921:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862926848 00000100:00100000:2.0:1787560917.572949:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787560917.572956:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4220050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+12:22737:x1874392862926848:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787560917.572969:0:22735:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787560917.572995:0:22735:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787560917.572998:0:22735:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1787560917.573086:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4220050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+12:22737:x1874392862926848:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560917.573092:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787560917.573364:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862926848:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787560917.573414:0:22737:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787560917.573467:0:22737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35730 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35737 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560917.573476:0:22737:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35730 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35737 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787560917.878421:0:22774:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787560917.878456:0:22774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787560917.879704:0:22774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787560917.879720:0:22774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787560917.939627:0:22782:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c53c0 going to sleep for 0 seconds 00010000:00010000:0.0:1787560918.455291:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787560918.899607:0:22774:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787560918.899616:0:22774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787560918.899734:0:22774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1787560918.899774:0:22774:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787560918.899918:0:22774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:2.0:1787560918.964531:0:22782:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c53c0 going to sleep for 0 seconds 00010000:00010000:2.0:1787560919.485565:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560919.988823:0:22782:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c53c0 going to sleep for 0 seconds 00010000:00010000:1.0:1787560920.503550:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560921.019216:0:22782:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c53c0 going to sleep for 0 seconds 00010000:00010000:1.0:1787560921.526046:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787560921.648213:0:23025:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787560922.035828:0:22782:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c53c0 going to sleep for 0 seconds 00000100:00080000:1.0:1787560922.163835:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787560922.163843:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787560922.163848:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cafc68d6000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787560922.163857:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 636 00000100:00080000:1.0:1787560922.163862:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787560922.163877:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9cafc68d6000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787560922.163901:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffba2dc00 x1874392862927104/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787560922.163918:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787560922.163921:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787560922.163924:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787560922.163927:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787560922.163929:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787560922.163933:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787560922.163934:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cafd9933800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787560922.163939:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9cafd9933800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787560922.163961:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffba2d180 x1874392862927232/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787560922.164017:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787560922.164029:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c33dd467-64b2-4362-8604-d1a6489592bb:3624:1874392862926976:0@lo:400:kworker.0 00000100:00100000:1.0:1787560922.164108:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560922.164248:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862926976 00000100:00100000:1.0:1787560922.164269:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862926976 00000100:00100000:1.0:1787560922.164316:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787560922.164323:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4220450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+12:3624:x1874392862926976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560922.164379:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4220450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+12:3624:x1874392862926976:12345-0@lo:400:kworker.0 Request processed in 56us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560922.164386:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787560922.164465:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862927104:0@lo:38:kworker.0 00000100:00100000:1.0:1787560922.164538:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560922.164559:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874392862927232:0@lo:38:kworker.0 00000100:00100000:1.0:1787560922.164587:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560922.164634:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862927104 00000100:00100000:1.0:1787560922.164639:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862927104 00000100:00100000:1.0:1787560922.164656:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787560922.164660:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffba2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1874392862927104:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787560922.164677:0:22746:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787560922.164712:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffba2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1874392862927104:12345-0@lo:38:kworker.0 Request processed in 49us (172us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787560922.164717:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787560922.164827:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c33dd467-64b2-4362-8604-d1a6489592bb:3624:1874392862926976:0@lo:400:kworker.0 00000100:00080000:1.0:1787560922.164855:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafc68d6000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787560922.164859:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787560922.164862:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862927104:0@lo:38:kworker.0 00000100:00100000:1.0:1787560922.164901:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862927232 00000100:00100000:1.0:1787560922.164905:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862927232 00000100:00100000:1.0:1787560922.164924:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787560922.164928:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffba2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1874392862927232:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787560922.164962:0:22742:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 641 last 0 00000020:00000080:1.0:1787560922.164993:0:22742:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4642c20bf2f3573e 00000004:00100000:1.0:1787560922.165009:0:22742:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787560922.165174:0:22742:0:(import.c:65:import_set_state_nolock()) ffff9caffff55800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787560922.165217:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffba2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1874392862927232:12345-0@lo:38:kworker.0 Request processed in 287us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560922.165225:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787560922.165326:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9caffba2d180 x1874392862927232/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787560932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787560922.165338:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1787560922.165345:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787560922.165350:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787560922.165352:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafd9933800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787560922.165357:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1874392862927232:0@lo:38:kworker.0 00010000:00010000:2.0:1787560922.547664:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787560922.745194:0:23077:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787560922.746203:0:23077:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787560923.059599:0:22782:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c53c0 going to sleep for 0 seconds 00010000:00010000:1.0:1787560923.577473:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787560923.630386:0:23127:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787560923.630651:0:23127:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787560924.090328:0:22782:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c53c0 going to sleep for 0 seconds 00010000:00010000:1.0:1787560924.603060:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560925.109646:0:22782:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c53c0 going to sleep for 0 seconds 00010000:00010000:3.0:1787560925.619974:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560926.138356:0:22782:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c53c0 going to sleep for 0 seconds 00000100:00100000:1.0:1787560926.260562:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560916/real 1787560916] req@ffff9caffba2c380 x1874392862924160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560926 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560926.260616:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9caffba2c380 x1874392862924160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560926 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560926.260629:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560916/real 1787560916] req@ffff9cafc46eb480 x1874392862924032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560926 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560926.260737:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cafc46eb480 x1874392862924032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560926 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787560926.260766:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafc58be000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787560926.260792:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787560926.260798:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862924160:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787560926.260806:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffff55000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787560926.260812:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787560926.260816:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862924032:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787560926.260997:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787560926.261002:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787560926.261006:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cafc68d6000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787560926.261012:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 641 00000100:00080000:1.0:1787560926.261019:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787560926.261028:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9cafc68d6000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787560926.261054:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffba2d180 x1874392862927488/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787560926.261068:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787560926.261071:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787560926.261073:0:8:0:(import.c:65:import_set_state_nolock()) ffff9caffff55000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787560926.261076:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 636 00000100:00080000:1.0:1787560926.261079:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787560926.261083:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9caffff55000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787560926.261095:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffba2dc00 x1874392862927616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787560926.261111:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787560926.261114:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787560926.261116:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cafc58be000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787560926.261120:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 636 00000100:00080000:1.0:1787560926.261123:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787560926.261127:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cafc58be000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787560926.261140:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffba2fb80 x1874392862927744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787560926.261197:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c33dd467-64b2-4362-8604-d1a6489592bb:3624:1874392862927360:0@lo:400:kworker.0 00000100:00100000:1.0:1787560926.261289:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560926.262144:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862927872:0@lo:400:kworker.0 00000100:00100000:1.0:1787560926.262201:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560926.262266:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862927360 00000100:00100000:1.0:1787560926.262276:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862927360 00000100:00100000:2.0:1787560926.263567:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862927872 00000100:00100000:2.0:1787560926.263592:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862927872 00000100:00100000:2.0:1787560926.263659:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787560926.264451:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787560926.264471:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4223850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+12:3624:x1874392862927360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560926.264600:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4223850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+12:3624:x1874392862927360:12345-0@lo:400:kworker.0 Request processed in 138us (3311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560926.264609:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787560926.264756:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffba2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862927872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560926.264811:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffba2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862927872:12345-0@lo:400:kworker.0 Request processed in 1143us (2610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560926.264819:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787560926.265779:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9caffba2ea00 x1874392862927872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560926.265800:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862927872:0@lo:400:kworker.0 00000100:00100000:1.0:1787560926.265855:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c33dd467-64b2-4362-8604-d1a6489592bb:3624:1874392862927360:0@lo:400:kworker.0 00000100:00100000:1.0:1787560926.266484:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862927488:0@lo:38:kworker.0 00000100:00100000:1.0:1787560926.266572:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560926.267138:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862927616:0@lo:8:kworker.0 00000400:00000100:1.0:1787560926.267172:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874392862927616 offset 0 length 520: 4 00000100:00100000:1.0:1787560926.267200:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862927744:0@lo:8:kworker.0 00000400:00000100:1.0:1787560926.267229:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874392862927744 offset 0 length 520: 4 00000100:00100000:2.0:1787560926.278799:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862927488 00000100:00100000:2.0:1787560926.278821:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862927488 00000100:00100000:2.0:1787560926.278961:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787560926.278973:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffba2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1874392862927488:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787560926.279000:0:22746:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787560926.279120:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffba2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1874392862927488:12345-0@lo:38:kworker.0 Request processed in 147us (12547us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787560926.279129:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787560926.280107:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafc68d6000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787560926.280117:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787560926.280122:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862927488:0@lo:38:kworker.0 00010000:00010000:1.0:1787560926.646537:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560927.156510:0:22782:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c53c0 going to sleep for 0 seconds 00010000:00010000:3.0:1787560927.669109:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787560928.116114:0:22774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787560928.183918:0:22782:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c53c0 going to sleep for 0 seconds 00010000:00010000:1.0:1787560928.697156:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560929.203550:0:22782:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c53c0 going to sleep for 0 seconds 00010000:00010000:3.0:1787560929.718956:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560930.228849:0:22782:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c53c0 going to sleep for 0 seconds 00000020:01000004:1.0:1787560930.290021:0:23472:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787560930.290027:0:23472:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787560930.290028:0:23472:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1787560930.290164:0:23472:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cafffe2b000 00000020:01000004:1.0:1787560930.290182:0:23472:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1787560930.290196:0:23472:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787560930.290984:0:23472:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9cafeabd19b8) 00000020:00000080:1.0:1787560930.291013:0:23472:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787560930.360475:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787560930.361455:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1787560930.363409:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1787560930.363669:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1787560930.363911:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1787560930.364195:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1787560930.364486:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1787560930.364705:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1787560930.365425:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1787560930.365826:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1787560930.366182:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1787560930.366419:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1787560930.366754:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1787560930.367102:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1787560930.367326:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1787560930.367534:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1787560930.367759:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1787560930.368074:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1787560930.368329:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1787560930.369637:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1787560930.370164:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1787560930.370339:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1787560930.370639:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1787560930.370978:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1787560930.371254:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1787560930.371407:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1787560930.371570:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1787560930.371868:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1787560930.372099:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1787560930.372262:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1787560930.372427:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1787560930.372807:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1787560930.373093:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1787560930.373273:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1787560930.373681:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1787560930.374221:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1787560930.374399:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1787560930.374907:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787560930.375164:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787560930.375640:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787560930.376013:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1787560930.376257:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787560930.376529:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787560930.376871:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1787560930.377156:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1787560930.377386:0:23472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:01000000:1.0:1787560930.379375:0:23472:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787560930.379787:0:23472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1787560930.379798:0:23472:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787560930.379810:0:23472:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4642c20bf2f3574c 00000020:01000004:1.0:1787560930.379828:0:23472:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787560930.379852:0:23472:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.129@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787560930.379855:0:23472:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787560930.379861:0:23472:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1787560930.379908:0:23472:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1787560930.379912:0:23472:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.129@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1787560930.384971:0:23472:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787560930.385148:0:23472:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.129@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1787560930.385152:0:23472:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787560930.385154:0:23472:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787560930.385155:0:23472:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787560930.385156:0:23472:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787560930.385157:0:23472:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787560930.385158:0:23472:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787560930.385160:0:23472:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787560930.385161:0:23472:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787560930.385162:0:23472:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787560930.385166:0:23472:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1787560930.385168:0:23472:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787560930.385169:0:23472:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787560930.385170:0:23472:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787560930.385171:0:23472:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787560930.385172:0:23472:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787560930.385173:0:23472:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787560930.385174:0:23472:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787560930.385175:0:23472:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787560930.385176:0:23472:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787560930.385204:0:23472:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787560930.385225:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862928000:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787560930.385295:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560930.385408:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc47a3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787560930.385541:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862928000 00000100:00100000:2.0:1787560930.385550:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862928000 00000100:00100000:2.0:1787560930.385634:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787560930.385644:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4220c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+12:23472:x1874392862928000:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787560930.385695:0:22733:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787560930.385701:0:22733:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1787560930.385707:0:22733:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1787560930.386170:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4220c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+12:23472:x1874392862928000:12345-0@lo:253:mount.lustre.0 Request processed in 526us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560930.386178:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787560930.386260:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862928000:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787560930.386272:0:23472:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787560930.386275:0:23472:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787560930.386276:0:23472:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787560930.386277:0:23472:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787560930.386278:0:23472:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787560930.386280:0:23472:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787560930.386281:0:23472:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787560930.386282:0:23472:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787560930.386283:0:23472:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787560930.386284:0:23472:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787560930.386305:0:23472:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cafffe2b000 from lustre-MDT0001 10000000:01000000:0.0:1787560930.386339:0:23472:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1787560930.386343:0:23472:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787560930.386351:0:23472:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9caff324cd28 local copy 00010000:00010000:0.0:1787560930.386368:0:23472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f35642 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35649 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560930.386493:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862928128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787560930.386524:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560930.386693:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc890840 going to sleep for 11 seconds 00000100:00100000:1.0:1787560930.386834:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862928128 00000100:00100000:1.0:1787560930.386840:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862928128 00000100:00100000:1.0:1787560930.386869:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787560930.386876:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4222850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+12:23472:x1874392862928128:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560930.386960:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4222850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+12:23472:x1874392862928128:12345-0@lo:501:mount.lustre.0 Request processed in 84us (435us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787560930.386967:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787560930.387050:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862928128:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787560930.387074:0:23472:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787560930.387092:0:23472:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787560930.387099:0:23472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f35642 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35649 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560930.387108:0:23472:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f35642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35649 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560930.387137:0:23472:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cafffe2b000 10000000:01000000:0.0:1787560930.387143:0:23472:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787560930.387149:0:23472:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9caff324cd28 10000000:01000000:0.0:1787560930.387152:0:23472:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787560930.387156:0:23472:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9caff324cd28 from 1 10000000:01000000:0.0:1787560930.387159:0:23472:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787560930.387189:0:23472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe400/0x4642c20bf2f35753 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560930.387197:0:23472:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe400/0x4642c20bf2f35753 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560930.387206:0:23472:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe400/0x4642c20bf2f35753 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560930.387228:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862928256:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787560930.387254:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560930.387278:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc890840 going to sleep for 11 seconds 00000100:00100000:1.0:1787560930.387323:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862928256 00000100:00100000:1.0:1787560930.387327:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862928256 00000100:00100000:1.0:1787560930.387347:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787560930.387353:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4223450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+12:23472:x1874392862928256:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787560930.387363:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560930.387378:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caec3881200/0x4642c20bf2f3575a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f35753 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.387399:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec3881200/0x4642c20bf2f3575a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f35753 expref: 13 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.387409:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caec3881200/0x4642c20bf2f3575a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35753 expref: 13 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.387419:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881200, rc 0) 00000100:00100000:1.0:1787560930.387499:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4223450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+13:23472:x1874392862928256:12345-0@lo:101:mount.lustre.0 Request processed in 144us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560930.387504:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787560930.387585:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862928256:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787560930.387597:0:23472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe400/0x4642c20bf2f35753 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3575a expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560930.387607:0:23472:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe400/0x4642c20bf2f35753 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f3575a expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560930.387622:0:23472:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787560930.387634:0:23472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe400/0x4642c20bf2f35753 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3575a expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560930.387640:0:23472:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe400/0x4642c20bf2f35753 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3575a expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560930.387647:0:23472:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9cafffe2b000 10000000:01000000:0.0:1787560930.387659:0:23472:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787560930.387662:0:23472:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9cafffe2b000 from 1 10000000:01000000:0.0:1787560930.387664:0:23472:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787560930.387688:0:23472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbfea00/0x4642c20bf2f35761 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560930.387695:0:23472:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffcbfea00/0x4642c20bf2f35761 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560930.387703:0:23472:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffcbfea00/0x4642c20bf2f35761 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560930.387722:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862928384:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787560930.387747:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560930.387765:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc890840 going to sleep for 11 seconds 00000100:00100000:1.0:1787560930.387956:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862928384 00000100:00100000:1.0:1787560930.387961:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862928384 00000100:00100000:1.0:1787560930.387979:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787560930.387985:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4221850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+13:23472:x1874392862928384:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787560930.387993:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560930.388001:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caec3880800/0x4642c20bf2f35768 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f35761 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.388016:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec3880800/0x4642c20bf2f35768 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f35761 expref: 14 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.388023:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caec3880800/0x4642c20bf2f35768 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35761 expref: 14 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.388035:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3880800, rc 0) 00000100:00100000:1.0:1787560930.388072:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4221850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+14:23472:x1874392862928384:12345-0@lo:101:mount.lustre.0 Request processed in 85us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560930.388078:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787560930.388149:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862928384:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787560930.388160:0:23472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffcbfea00/0x4642c20bf2f35761 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35768 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560930.388168:0:23472:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffcbfea00/0x4642c20bf2f35761 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35768 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560930.388177:0:23472:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787560930.388193:0:23472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbfea00/0x4642c20bf2f35761 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35768 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560930.388200:0:23472:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffcbfea00/0x4642c20bf2f35761 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35768 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560930.388205:0:23472:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787560930.388208:0:23472:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787560930.388212:0:23472:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9cafffe2b000 10000000:01000000:0.0:1787560930.388215:0:23472:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787560930.388218:0:23472:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1787560930.388220:0:23472:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787560930.388233:0:23472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbfec00/0x4642c20bf2f3576f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560930.388240:0:23472:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffcbfec00/0x4642c20bf2f3576f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560930.388254:0:23472:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffcbfec00/0x4642c20bf2f3576f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560930.388266:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862928512:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787560930.388292:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560930.388304:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc890840 going to sleep for 11 seconds 00000100:00100000:1.0:1787560930.388529:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862928512 00000100:00100000:1.0:1787560930.388534:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862928512 00000100:00100000:1.0:1787560930.388553:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787560930.388559:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4221450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+14:23472:x1874392862928512:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787560930.388567:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560930.388576:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caec3880e00/0x4642c20bf2f35776 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f3576f expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.388590:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec3880e00/0x4642c20bf2f35776 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f3576f expref: 15 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.388599:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caec3880e00/0x4642c20bf2f35776 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f3576f expref: 15 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.388606:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3880e00, rc 0) 00000100:00100000:1.0:1787560930.388634:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4221450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+15:23472:x1874392862928512:12345-0@lo:101:mount.lustre.0 Request processed in 75us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560930.388640:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787560930.388715:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862928512:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787560930.388726:0:23472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffcbfec00/0x4642c20bf2f3576f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35776 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560930.388733:0:23472:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffcbfec00/0x4642c20bf2f3576f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35776 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787560930.390424:0:23472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:0.0:1787560930.391347:0:23472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787560930.399205:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1787560930.399278:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:0.0:1787560930.399295:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:0.0:1787560930.399309:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:0.0:1787560930.399321:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:0.0:1787560930.399332:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:0.0:1787560930.399352:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:0.0:1787560930.399376:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:0.0:1787560930.399403:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:0.0:1787560930.399652:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:0.0:1787560930.399895:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:0.0:1787560930.399928:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:0.0:1787560930.399958:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:0.0:1787560930.400164:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:0.0:1787560930.400195:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:0.0:1787560930.400211:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:0.0:1787560930.400225:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:0.0:1787560930.400236:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:0.0:1787560930.400247:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:0.0:1787560930.400259:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:0.0:1787560930.400270:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:0.0:1787560930.400283:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:0.0:1787560930.400295:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:0.0:1787560930.400308:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:0.0:1787560930.400324:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:0.0:1787560930.400335:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:0.0:1787560930.400347:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:0.0:1787560930.400359:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:0.0:1787560930.400370:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:0.0:1787560930.400385:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:0.0:1787560930.400397:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:0.0:1787560930.400411:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:0.0:1787560930.400425:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:0.0:1787560930.400481:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:0.0:1787560930.400494:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:0.0:1787560930.400506:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:0.0:1787560930.400517:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:0.0:1787560930.400528:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:0.0:1787560930.400541:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:0.0:1787560930.400554:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:0.0:1787560930.400566:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:0.0:1787560930.400580:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:0.0:1787560930.400593:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:0.0:1787560930.400606:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:0.0:1787560930.400635:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:0.0:1787560930.400642:0:23472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:0.0:1787560930.400951:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862928640:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787560930.401164:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560930.401254:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cb002155a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787560930.401305:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862928640 00000100:00100000:1.0:1787560930.401313:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862928640 00000100:00100000:1.0:1787560930.401420:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787560930.401460:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4222450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+15:23472:x1874392862928640:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560930.401606:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4222450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+15:23472:x1874392862928640:12345-0@lo:501:mount.lustre.0 Request processed in 176us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560930.401621:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787560930.401736:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862928640:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787560930.401769:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862928768:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787560930.401810:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560930.402206:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cb002155a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787560930.402267:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862928768 00000100:00100000:2.0:1787560930.402272:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862928768 00000100:00100000:2.0:1787560930.402302:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787560930.402309:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4220850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+15:23472:x1874392862928768:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787560930.403393:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4220850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+15:23472:x1874392862928768:12345-0@lo:503:mount.lustre.0 Request processed in 1078us (1577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560930.403403:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787560930.403601:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862928768:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787560930.404274:0:23472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787560930.404351:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862928896:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787560930.404404:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560930.404486:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc81fe780 going to sleep for 11 seconds 00000100:00100000:3.0:1787560930.404574:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862928896 00000100:00100000:3.0:1787560930.404580:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862928896 00000100:00100000:3.0:1787560930.404629:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787560930.404639:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4221050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+15:23472:x1874392862928896:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787560930.406268:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4221050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+15:23472:x1874392862928896:12345-0@lo:502:mount.lustre.0 Request processed in 1624us (1857us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560930.406282:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787560930.406560:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862928896:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787560930.407198:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1787560930.407230:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:0.0:1787560930.407244:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:0.0:1787560930.407255:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:0.0:1787560930.407268:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:0.0:1787560930.407281:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:0.0:1787560930.407291:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:0.0:1787560930.407302:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:0.0:1787560930.407312:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:0.0:1787560930.407321:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:0.0:1787560930.407332:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:0.0:1787560930.407343:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:0.0:1787560930.407355:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:0.0:1787560930.407366:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:0.0:1787560930.407378:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:0.0:1787560930.407404:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:0.0:1787560930.407415:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:0.0:1787560930.407428:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:0.0:1787560930.407467:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:0.0:1787560930.407480:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:0.0:1787560930.407495:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:0.0:1787560930.407507:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:0.0:1787560930.407519:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:0.0:1787560930.407531:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:0.0:1787560930.407545:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:0.0:1787560930.407557:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:0.0:1787560930.407569:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:0.0:1787560930.407581:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:0.0:1787560930.407593:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:0.0:1787560930.407605:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:0.0:1787560930.407618:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:0.0:1787560930.407629:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:0.0:1787560930.407641:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:0.0:1787560930.407657:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:0.0:1787560930.407805:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:0.0:1787560930.407922:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:0.0:1787560930.407954:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:0.0:1787560930.408050:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:0.0:1787560930.408174:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:0.0:1787560930.408189:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:0.0:1787560930.408202:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:0.0:1787560930.408215:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:0.0:1787560930.408227:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:0.0:1787560930.408239:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:0.0:1787560930.408282:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862929024:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787560930.408366:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560930.408583:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc81fe780 going to sleep for 11 seconds 00000100:00100000:2.0:1787560930.408944:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862929024 00000100:00100000:2.0:1787560930.408957:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862929024 00000100:00100000:2.0:1787560930.409224:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787560930.409235:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+15:23472:x1874392862929024:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560930.409410:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+15:23472:x1874392862929024:12345-0@lo:502:mount.lustre.0 Request processed in 173us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560930.409426:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787560930.409619:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862929024:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787560930.409753:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:0.0:1787560930.409774:0:23472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1787560930.411136:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560930.411149:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560930.411152:0:23476:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787560930.411157:0:23476:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1787560930.411159:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787560930.411175:0:23476:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9caffb9919b8) 00000020:00000080:0.0:1787560930.411197:0:23476:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1787560930.411203:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787560930.411271:0:23476:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787560930.411278:0:23476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4642c20bf2f35784 00000020:00000080:0.0:1787560930.411598:0:23476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1787560930.411603:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560930.411607:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560930.411609:0:23476:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787560930.411612:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560930.411619:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560930.411622:0:23476:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1787560930.411629:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787560930.411642:0:23476:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9caffb993370) 00000020:00000080:0.0:1787560930.411659:0:23476:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1787560930.411668:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787560930.411931:0:23476:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1787560930.411939:0:23476:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1787560930.411957:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787560930.412041:0:23476:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cafffe2b000 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1787560930.412064:0:23476:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9caffb994d28) 00000020:00000080:0.0:1787560930.412076:0:23476:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1787560930.412141:0:23476:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787560930.412149:0:23476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4642c20bf2f35799 00000020:00000080:0.0:1787560930.412260:0:23476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1787560930.412268:0:23476:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787560930.412272:0:23476:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x4642c20bf2f357a0 00080000:01000000:0.0:1787560930.412278:0:23476:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787560930.412281:0:23476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4642c20bf2f357a7 00010000:00010000:3.0:1787560930.539211:0:23476:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1787560930.540332:0:23476:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:3.0:1787560930.546935:0:23476:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787560930.555348:0:23476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1787560930.555370:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560930.555382:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560930.555384:0:23476:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1787560930.555388:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560930.555393:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560930.555396:0:23476:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1787560930.555399:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787560930.555405:0:23476:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:00000080:0.0:1787560930.555484:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787560930.555516:0:23476:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9caff4908000) 00000020:00000080:0.0:1787560930.555552:0:23476:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1787560930.555558:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787560930.555684:0:23476:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1787560930.555696:0:23476:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787560930.555707:0:23476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4642c20bf2f357b5 00010000:00080000:0.0:1787560930.555758:0:23476:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9caec3b5a800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.129@tcp at head 00010000:00010000:0.0:1787560930.558456:0:23476:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1787560930.568594:0:23476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787560930.568610:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787560930.568659:0:23476:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787560930.568683:0:23476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4642c20bf2f357bc 00000100:00080000:0.0:1787560930.568768:0:23476:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787560930.568777:0:23476:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9caec3b5a800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:0.0:1787560930.568823:0:23476:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffbaf4700 x1874392862929152/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787560930.568918:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862929152:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787560930.569050:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560930.569155:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862929152 00000100:00100000:2.0:1787560930.569164:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862929152 00000100:00100000:2.0:1787560930.569199:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787560930.569206:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1874392862929152:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787560930.569230:0:22746:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 649 last 0 00000020:00000080:2.0:1787560930.569261:0:22746:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4642c20bf2f357c3 00000004:00100000:2.0:1787560930.569276:0:22746:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787560930.569281:0:22746:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:0.0:1787560930.569401:0:23476:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1787560930.569495:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560930.569500:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560930.569502:0:23476:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1787560930.569505:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787560930.569508:0:23476:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787560930.569510:0:23476:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787560930.569511:0:23476:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787560930.569513:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787560930.569515:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560930.569517:0:23476:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787560930.569519:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560930.569523:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560930.569525:0:23476:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1787560930.569529:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787560930.569561:0:23476:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787560930.569575:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560930.569578:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560930.569580:0:23476:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1787560930.569582:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787560930.569584:0:23476:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1787560930.569585:0:23476:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787560930.569587:0:23476:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787560930.569589:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787560930.569591:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560930.569592:0:23476:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787560930.569594:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787560930.569598:0:23476:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1787560930.569601:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560930.569602:0:23476:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787560930.569605:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787560930.569609:0:23476:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:01000000:0.0:1787560930.569636:0:23476:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1787560930.569639:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787560930.569652:0:23476:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9caff490cd28) 00000020:00000080:0.0:1787560930.569665:0:23476:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1787560930.569671:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787560930.569735:0:23476:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1787560930.569742:0:23476:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787560930.569748:0:23476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4642c20bf2f357d1 00010000:00080000:0.0:1787560930.569777:0:23476:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9caffcbc7800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.129@tcp at head 00010000:00010000:0.0:1787560930.569992:0:23476:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:2.0:1787560930.570197:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787560930.570206:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787560930.570210:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cafc68d6000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787560930.570217:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 645 00000100:00080000:2.0:1787560930.570223:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787560930.570230:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9cafc68d6000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560930.570268:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafc46e9880 x1874392862929280/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:01000000:0.0:1787560930.570757:0:23476:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787560930.570791:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862929280:0@lo:38:kworker.0 00000100:00100000:3.0:1787560930.570882:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:0.0:1787560930.570988:0:23476:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:3.0:1787560930.571104:0:22745:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1787560930.571116:0:22745:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1787560930.571403:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862929280 00000100:00100000:3.0:1787560930.571415:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862929280 00000100:00100000:3.0:1787560930.571696:0:23481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787560930.571705:0:23481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3622:x1874392862929280:12345-0@lo:38:kworker.0 00000100:00080000:2.0:1787560930.571765:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560930.571771:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787560930.571775:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560930.571778:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787560930.571968:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862929408:0@lo:400:kworker.0 00000100:00100000:1.0:1787560930.572033:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560930.572080:0:23481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3622:x1874392862929280:12345-0@lo:38:kworker.0 Request processed in 372us (1195us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787560930.572090:0:23481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787560930.572357:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862929408 00000100:00100000:2.0:1787560930.572364:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862929408 00000100:00100000:2.0:1787560930.572455:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787560930.572463:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:2.0:1787560930.572468:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffba2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862929408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560930.572541:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffba2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862929408:12345-0@lo:400:kworker.0 Request processed in 76us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560930.572553:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000040:00080000:0.0:1787560930.572999:0:23476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1787560930.573138:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafc68d6000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787560930.573147:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787560930.573154:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862929280:0@lo:38:kworker.0 00000040:00080000:0.0:1787560930.573577:0:23476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1787560930.573750:0:23476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00010000:00080000:1.0:1787560930.574129:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cafc46eaa00 x1874392862929408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560930.574152:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862929408:0@lo:400:kworker.0 00000100:00080000:1.0:1787560930.575695:0:22746:0:(import.c:65:import_set_state_nolock()) ffff9cafffe2e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787560930.575829:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3622:x1874392862929152:12345-0@lo:38:llog_process_th.0 Request processed in 6603us (6761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560930.575844:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787560930.576124:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787560930.576133:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1787560930.576143:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787560930.576148:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787560930.576151:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec3b5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787560930.576168:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862929152:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787560930.576383:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787560930.576404:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862929536:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787560930.576524:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560930.576572:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862929536 00000100:00100000:2.0:1787560930.576579:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862929536 00000100:00100000:2.0:1787560930.576615:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787560930.576623:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3624:x1874392862929536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787560930.576650:0:22745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787560930.576706:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3624:x1874392862929536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560930.576712:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787560930.576741:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862929536:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1787560930.577312:0:23482:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787560930.577320:0:23482:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787560930.579120:0:23476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787560930.579147:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787560930.579235:0:23476:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787560930.579264:0:23476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4642c20bf2f357d8 00000100:00080000:2.0:1787560930.579275:0:23476:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787560930.579281:0:23476:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9caffcbc7800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560930.579320:0:23476:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafc46e8380 x1874392862929664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787560930.579395:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862929664:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787560930.579484:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874392862929664 offset 0 length 520: 4 00000100:00080000:2.0:1787560930.579554:0:23476:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787560930.579629:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560930.579634:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560930.579636:0:23476:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787560930.579639:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787560930.579642:0:23476:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1787560930.579644:0:23476:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787560930.579653:0:23476:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787560930.579655:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787560930.579658:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560930.579659:0:23476:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787560930.579662:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787560930.579667:0:23476:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787560930.579670:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560930.579671:0:23476:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787560930.579674:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787560930.579678:0:23476:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:01000000:2.0:1787560930.579700:0:23476:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787560930.579703:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787560930.579715:0:23476:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9caec2fb3370) 00000020:00000080:2.0:1787560930.579729:0:23476:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1787560930.579733:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787560930.579790:0:23476:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1787560930.579797:0:23476:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787560930.579804:0:23476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4642c20bf2f357e6 00010000:00080000:2.0:1787560930.579843:0:23476:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9caec3383000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.129@tcp at head 00010000:00010000:2.0:1787560930.580064:0:23476:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1787560930.580134:0:23476:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787560930.580148:0:23476:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1787560930.580630:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560930.580635:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787560930.580638:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560930.580642:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1787560930.582056:0:23476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787560930.582289:0:23476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1787560930.582703:0:23476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:0.0:1787560930.583226:0:23484:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787560930.583231:0:23484:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787560930.583973:0:23476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787560930.583985:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787560930.584021:0:23476:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787560930.584042:0:23476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4642c20bf2f357ed 00000100:00080000:2.0:1787560930.584053:0:23476:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787560930.584059:0:23476:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9caec3383000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560930.584098:0:23476:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafc46eb800 x1874392862929792/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787560930.584166:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862929792:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787560930.584226:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874392862929792 offset 0 length 520: 4 00000100:00080000:2.0:1787560930.584280:0:23476:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787560930.584338:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560930.584342:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560930.584344:0:23476:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787560930.584347:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560930.584351:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560930.584352:0:23476:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787560930.584356:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787560930.584357:0:23476:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787560930.584360:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560930.584362:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560930.584363:0:23476:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787560930.584365:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560930.584367:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560930.584369:0:23476:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787560930.584373:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787560930.584392:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560930.584395:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560930.584396:0:23476:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787560930.584400:0:23476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:3.0:1787560930.584601:0:23472:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1787560930.584629:0:23472:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787560930.584649:0:23472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbfec00/0x4642c20bf2f3576f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35776 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560930.584660:0:23472:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffcbfec00/0x4642c20bf2f3576f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35776 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560930.584669:0:23472:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cafffe2b000 from 1 10000000:01000000:3.0:1787560930.584672:0:23472:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787560930.584698:0:23472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6a00/0x4642c20bf2f357f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560930.584705:0:23472:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6a00/0x4642c20bf2f357f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560930.584716:0:23472:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6a00/0x4642c20bf2f357f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560930.584731:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862929920:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787560930.584769:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560930.584803:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec3a6df00 going to sleep for 11 seconds 00000100:00080000:3.0:1787560930.584832:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560930.584842:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787560930.584845:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560930.584849:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787560930.584989:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862929920 00000100:00100000:2.0:1787560930.584996:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862929920 00000100:00100000:2.0:1787560930.585043:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787560930.585052:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+15:23472:x1874392862929920:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787560930.585066:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560930.585078:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca49800/0x4642c20bf2f357fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f357f4 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560930.585099:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca49800/0x4642c20bf2f357fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f357f4 expref: 16 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560930.585123:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca49800/0x4642c20bf2f357fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f357f4 expref: 16 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560930.585132:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca49800, rc 0) 00000100:00100000:2.0:1787560930.585175:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+16:23472:x1874392862929920:12345-0@lo:101:mount.lustre.0 Request processed in 124us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560930.585182:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787560930.585284:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862929920:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787560930.585297:0:23472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6a00/0x4642c20bf2f357f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f357fb expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560930.585306:0:23472:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6a00/0x4642c20bf2f357f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f357fb expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560930.586023:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862930048:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787560930.586065:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560930.586100:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc46c80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560930.586196:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862930048 00000100:00100000:3.0:1787560930.586202:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862930048 00000100:00100000:3.0:1787560930.586241:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787560930.586249:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+16:23472:x1874392862930048:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787560930.586263:0:22733:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787560930.586279:0:22733:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787560930.586282:0:22733:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1787560930.586359:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+16:23472:x1874392862930048:12345-0@lo:256:mount.lustre.0 Request processed in 110us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560930.586366:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787560930.586523:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862930048:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787560930.587277:0:23472:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787560930.587373:0:23472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6a00/0x4642c20bf2f357f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f357fb expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560930.587388:0:23472:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6a00/0x4642c20bf2f357f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f357fb expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560930.587398:0:23472:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cafffe2b000 from 1 10000000:01000000:2.0:1787560930.587402:0:23472:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787560930.587475:0:23472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca48000/0x4642c20bf2f35802 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560930.587486:0:23472:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffca48000/0x4642c20bf2f35802 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560930.587499:0:23472:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffca48000/0x4642c20bf2f35802 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560930.587536:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862930176:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787560930.587578:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560930.587620:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc46c80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560930.587787:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862930176 00000100:00100000:3.0:1787560930.587794:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862930176 00000100:00100000:3.0:1787560930.587845:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787560930.587852:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+16:23472:x1874392862930176:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787560930.587864:0:22735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560930.587875:0:22735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f35809 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f35802 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560930.587912:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f35809 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f35802 expref: 17 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560930.587921:0:22735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f35809 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35802 expref: 17 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560930.587929:0:22735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f6800, rc 0) 00000100:00100000:3.0:1787560930.587972:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+17:23472:x1874392862930176:12345-0@lo:101:mount.lustre.0 Request processed in 120us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560930.587979:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787560930.588126:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46ea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862930176:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787560930.588139:0:23472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffca48000/0x4642c20bf2f35802 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35809 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560930.588148:0:23472:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffca48000/0x4642c20bf2f35802 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35809 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787560930.589631:0:23472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1787560930.590015:0:23472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787560930.590214:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1787560930.590239:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1787560930.590254:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1787560930.590272:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1787560930.590299:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1787560930.590326:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1787560930.590356:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1787560930.590386:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1787560930.590418:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1787560930.590551:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1787560930.590586:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1787560930.590605:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1787560930.590610:0:23472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1787560930.590716:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862930304:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560930.590781:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560930.590829:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc46c8300 going to sleep for 11 seconds 00000100:00100000:0.0:1787560930.591107:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862930304 00000100:00100000:0.0:1787560930.591115:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862930304 00000100:00100000:0.0:1787560930.591164:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787560930.591173:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+17:23472:x1874392862930304:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787560930.591323:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+17:23472:x1874392862930304:12345-0@lo:501:mount.lustre.0 Request processed in 148us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560930.591335:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787560930.591767:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862930304:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560930.591836:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862930432:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787560930.591919:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560930.591970:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc46c8300 going to sleep for 11 seconds 00000100:00100000:0.0:1787560930.592099:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862930432 00000100:00100000:0.0:1787560930.592104:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862930432 00000100:00100000:0.0:1787560930.592138:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787560930.592145:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+17:23472:x1874392862930432:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787560930.592236:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+17:23472:x1874392862930432:12345-0@lo:503:mount.lustre.0 Request processed in 91us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560930.592243:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787560930.592391:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862930432:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787560930.593019:0:23472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787560930.593095:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862930560:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787560930.593135:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560930.593200:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff32516c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560930.593298:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862930560 00000100:00100000:2.0:1787560930.593304:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862930560 00000100:00100000:2.0:1787560930.593381:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787560930.593390:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+17:23472:x1874392862930560:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560930.593533:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+17:23472:x1874392862930560:12345-0@lo:502:mount.lustre.0 Request processed in 142us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560930.593544:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787560930.593629:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862930560:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787560930.593879:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1787560930.593929:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:1.0:1787560930.593951:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:1.0:1787560930.593974:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:1.0:1787560930.593999:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:1.0:1787560930.594023:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:1.0:1787560930.594048:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:1.0:1787560930.594065:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:1.0:1787560930.594078:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1787560930.594101:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:1.0:1787560930.594115:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:1.0:1787560930.594154:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862930688:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787560930.594198:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560930.594590:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff32516c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560930.594652:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862930688 00000100:00100000:0.0:1787560930.594658:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862930688 00000100:00100000:0.0:1787560930.594696:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787560930.594704:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+17:23472:x1874392862930688:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787560930.594952:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862930688:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787560930.595015:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:1.0:1787560930.595028:0:23472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000100:00100000:0.0:1787560930.595380:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+17:23472:x1874392862930688:12345-0@lo:502:mount.lustre.0 Request processed in 674us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560930.595391:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000020:01000000:0.0:1787560930.596093:0:23486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560930.596101:0:23486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560930.596103:0:23486:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787560930.596111:0:23486:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cafffe2b000 00000020:00000080:0.0:1787560930.596113:0:23486:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787560930.596127:0:23486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560930.596129:0:23486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560930.596131:0:23486:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787560930.596133:0:23486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560930.596135:0:23486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560930.596136:0:23486:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787560930.596139:0:23486:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cafffe2b000 00000020:00000080:0.0:1787560930.596141:0:23486:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787560930.596227:0:23486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560930.596231:0:23486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560930.596232:0:23486:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787560930.596235:0:23486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560930.596237:0:23486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560930.596238:0:23486:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787560930.596242:0:23486:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cafffe2b000 00000020:00000080:0.0:1787560930.596244:0:23486:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787560930.601277:0:23486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560930.601289:0:23486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560930.601291:0:23486:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787560930.601295:0:23486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787560930.601298:0:23486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560930.601300:0:23486:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787560930.601305:0:23486:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cafffe2b000 00000020:00000080:0.0:1787560930.601307:0:23486:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787560930.601366:0:23486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787560930.601369:0:23486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787560930.601370:0:23486:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787560930.601373:0:23486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:0.0:1787560930.603191:0:23472:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787560930.603234:0:23472:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787560930.603253:0:23472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca48000/0x4642c20bf2f35802 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35809 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560930.603275:0:23472:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffca48000/0x4642c20bf2f35802 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35809 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560930.603331:0:23472:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787560930.603335:0:23472:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cafffe2b000 10000000:01000000:0.0:1787560930.603337:0:23472:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cafffe2b000 10000000:01000000:0.0:1787560930.603341:0:23472:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787560930.603346:0:23472:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cafffe2b000 from 1 10000000:01000000:0.0:1787560930.603348:0:23472:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787560930.603382:0:23472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbff800/0x4642c20bf2f35810 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560930.603390:0:23472:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffcbff800/0x4642c20bf2f35810 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560930.603401:0:23472:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffcbff800/0x4642c20bf2f35810 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560930.603423:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862930816:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787560930.603504:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560930.605215:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862930816 00000100:00100000:0.0:1787560930.605227:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862930816 00000100:00100000:0.0:1787560930.605293:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787560930.605304:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+17:23472:x1874392862930816:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787560930.605318:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560930.605334:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffcbfe600/0x4642c20bf2f35817 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f35810 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560930.605372:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffcbfe600/0x4642c20bf2f35817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f35810 expref: 18 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560930.605381:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffcbfe600/0x4642c20bf2f35817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35810 expref: 18 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560930.605390:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbfe600, rc 0) 00000100:00100000:0.0:1787560930.605459:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+18:23472:x1874392862930816:12345-0@lo:101:mount.lustre.0 Request processed in 157us (1955us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560930.605466:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787560930.605513:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc890a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787560930.605535:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862930816:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787560930.605615:0:23472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffcbff800/0x4642c20bf2f35810 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35817 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560930.605625:0:23472:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffcbff800/0x4642c20bf2f35810 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35817 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787560930.609588:0:23472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:1.0:1787560930.609904:0:23472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787560930.610080:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:1.0:1787560930.610104:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:1.0:1787560930.610119:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:1.0:1787560930.610132:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:1.0:1787560930.610144:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:1.0:1787560930.610157:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:1.0:1787560930.610171:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:1.0:1787560930.610184:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:1.0:1787560930.610196:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:1.0:1787560930.610209:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:1.0:1787560930.610221:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:1.0:1787560930.610233:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:1.0:1787560930.610271:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:1.0:1787560930.610303:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:1.0:1787560930.610333:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:1.0:1787560930.610364:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:1.0:1787560930.610397:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:1.0:1787560930.610427:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:1.0:1787560930.611755:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:1.0:1787560930.611771:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:1.0:1787560930.611784:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:1.0:1787560930.611806:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:1.0:1787560930.612925:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:1.0:1787560930.612977:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:1.0:1787560930.613003:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:1.0:1787560930.613027:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:1.0:1787560930.613052:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:1.0:1787560930.613077:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:1.0:1787560930.613139:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:1.0:1787560930.613169:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:1.0:1787560930.613186:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:1.0:1787560930.613205:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:1.0:1787560930.613223:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:1.0:1787560930.613235:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:1.0:1787560930.613247:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:1.0:1787560930.613258:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:1.0:1787560930.613269:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:1.0:1787560930.613280:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:1.0:1787560930.613292:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:1.0:1787560930.613305:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:1.0:1787560930.613317:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:1.0:1787560930.613328:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:1.0:1787560930.613339:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:1.0:1787560930.613350:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:1.0:1787560930.613377:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:1.0:1787560930.613394:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:1.0:1787560930.613405:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:1.0:1787560930.613418:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:1.0:1787560930.613643:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:1.0:1787560930.613663:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:1.0:1787560930.613681:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:1.0:1787560930.613687:0:23472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:1.0:1787560930.613791:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862930944:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560930.613865:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560930.613932:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862930944 00000100:00100000:1.0:1787560930.613939:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862930944 00000100:00100000:1.0:1787560930.613986:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787560930.613994:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+18:23472:x1874392862930944:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560930.614140:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+18:23472:x1874392862930944:12345-0@lo:501:mount.lustre.0 Request processed in 144us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560930.614152:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787560930.614201:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff3251a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787560930.614221:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862930944:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560930.614251:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862931072:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787560930.614286:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560930.614309:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862931072 00000100:00100000:1.0:1787560930.614313:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862931072 00000100:00100000:1.0:1787560930.614336:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787560930.614342:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+18:23472:x1874392862931072:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787560930.614468:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+18:23472:x1874392862931072:12345-0@lo:503:mount.lustre.0 Request processed in 89us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560930.614478:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787560930.614543:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff3251a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787560930.614556:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862931072:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787560930.618370:0:23472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787560930.618582:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862931200:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787560930.618682:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560930.618732:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862931200 00000100:00100000:1.0:1787560930.618745:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862931200 00000100:00100000:1.0:1787560930.618806:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787560930.620197:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+18:23472:x1874392862931200:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787560930.620352:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+18:23472:x1874392862931200:12345-0@lo:502:mount.lustre.0 Request processed in 169us (1672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560930.620360:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787560930.620503:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff3251a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787560930.620528:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862931200:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787560930.625189:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:1.0:1787560930.625251:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:1.0:1787560930.625266:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:1.0:1787560930.625278:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:1.0:1787560930.625290:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:1.0:1787560930.625302:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:1.0:1787560930.625334:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:1.0:1787560930.625357:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:1.0:1787560930.625384:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:1.0:1787560930.625409:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:1.0:1787560930.625467:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:1.0:1787560930.625499:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:1.0:1787560930.625525:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:1.0:1787560930.625546:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:1.0:1787560930.625561:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:1.0:1787560930.625574:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:1.0:1787560930.625586:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:1.0:1787560930.625598:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:1.0:1787560930.625610:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:1.0:1787560930.625627:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:1.0:1787560930.625650:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:1.0:1787560930.625675:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:1.0:1787560930.625721:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:1.0:1787560930.625737:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:1.0:1787560930.625749:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:1.0:1787560930.625762:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:1.0:1787560930.625781:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:1.0:1787560930.625808:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:1.0:1787560930.629426:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:1.0:1787560930.629465:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:1.0:1787560930.629476:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:1.0:1787560930.629487:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:1.0:1787560930.629498:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:1.0:1787560930.629508:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:1.0:1787560930.629518:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:1.0:1787560930.629529:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:1.0:1787560930.629539:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:1.0:1787560930.629549:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:1.0:1787560930.629577:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:1.0:1787560930.629588:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:1.0:1787560930.629599:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:1.0:1787560930.629609:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:1.0:1787560930.629620:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:1.0:1787560930.629630:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:1.0:1787560930.629640:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:1.0:1787560930.629650:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:1.0:1787560930.629660:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:1.0:1787560930.629671:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:1.0:1787560930.629720:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862931328:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787560930.629786:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560930.629825:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862931328 00000100:00100000:1.0:1787560930.629831:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862931328 00000100:00100000:1.0:1787560930.629869:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787560930.629877:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+18:23472:x1874392862931328:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787560930.629999:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+18:23472:x1874392862931328:12345-0@lo:502:mount.lustre.0 Request processed in 120us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560930.630006:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787560930.630056:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff3251a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787560930.630079:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862931328:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787560930.630243:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:1.0:1787560930.630267:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:1.0:1787560930.630287:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862931456:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787560930.630320:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560930.630342:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862931456 00000100:00100000:1.0:1787560930.630346:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862931456 00000100:00100000:1.0:1787560930.630368:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787560930.630375:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+18:23472:x1874392862931456:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787560930.630457:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+18:23472:x1874392862931456:12345-0@lo:502:mount.lustre.0 Request processed in 82us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560930.630463:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787560930.630496:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff5227600 going to sleep for 11 seconds 00000100:00100000:1.0:1787560930.630508:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862931456:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787560930.630541:0:23472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:1.0:1787560930.630549:0:23472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787560930.637527:0:23491:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1787560930.638655:0:23491:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9cafef9fb370) 00000020:00000080:1.0:1787560930.638697:0:23491:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1787560930.638948:0:23491:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cafffe2b000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787560930.638954:0:23491:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cafffe2b000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787560930.638958:0:23491:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cafffe2b000 3 00010000:00080000:1.0:1787560930.639016:0:23491:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cafeabca800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.129@tcp at head 00010000:00010000:1.0:1787560930.643527:0:23491:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1787560930.649184:0:23491:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1787560930.649236:0:23491:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787560930.649248:0:23491:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x4642c20bf2f35825 00000100:00080000:1.0:1787560930.649258:0:23491:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787560930.649263:0:23491:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9cafeabca800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787560930.649308:0:23491:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffba2f480 x1874392862931584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787560930.649356:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874392862931584:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787560930.649448:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560930.649514:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862931584 00000100:00100000:1.0:1787560930.649522:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862931584 00000100:00100000:1.0:1787560930.649749:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787560930.649757:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffba2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1874392862931584:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787560930.649782:0:22742:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 649 last 0 00000020:00000080:1.0:1787560930.649834:0:22742:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x4642c20bf2f3582c 00000004:00100000:1.0:1787560930.649849:0:22742:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787560930.649877:0:22742:0:(import.c:65:import_set_state_nolock()) ffff9cafffe28000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787560930.649943:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffba2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1874392862931584:12345-0@lo:38:llog_process_th.0 Request processed in 184us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560930.649950:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787560930.649989:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9caffba2f480 x1874392862931584/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787560940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560930.649998:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787560930.650005:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1787560930.650018:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787560930.650023:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787560930.650025:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafeabca800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787560930.650030:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1874392862931584:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1787560930.650050:0:23491:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787560930.650938:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787560930.650944:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787560930.650947:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787560930.650950:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1787560930.654312:0:23491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:1.0:1787560930.654363:0:23472:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787560930.654394:0:23472:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787560930.654411:0:23472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbff800/0x4642c20bf2f35810 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35817 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.654422:0:23472:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffcbff800/0x4642c20bf2f35810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35817 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787560930.654498:0:23472:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787560930.654500:0:23472:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787560930.654501:0:23472:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787560930.654503:0:23472:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787560930.654504:0:23472:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787560930.654505:0:23472:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787560930.654506:0:23472:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787560930.654508:0:23472:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787560930.654509:0:23472:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787560930.654513:0:23472:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1787560930.654516:0:23472:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787560930.654522:0:23472:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787560930.654523:0:23472:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787560930.654524:0:23472:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787560930.654525:0:23472:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787560930.654526:0:23472:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787560930.654527:0:23472:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787560930.654528:0:23472:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787560930.654529:0:23472:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787560930.657013:0:23472:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787560930.657056:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862931712:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787560930.657248:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560930.657290:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe06da6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560930.657341:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862931712 00000100:00100000:1.0:1787560930.657349:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862931712 00000100:00100000:1.0:1787560930.657400:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787560930.657409:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+18:23472:x1874392862931712:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787560930.657464:0:22733:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787560930.657477:0:22733:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1787560930.665704:0:22720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1787560930.665763:0:22733:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787560930.665775:0:22733:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1787560930.665899:0:22756:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787560930.665904:0:22756:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787560930.665927:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9caec3881600/0x4642c20bf2f35833 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.665948:0:22756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffcbfe200/0x4642c20bf2f35737 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35730 expref: 18 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.665955:0:22756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffca49800/0x4642c20bf2f357fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f357f4 expref: 18 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.665962:0:22756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9caec3881600/0x4642c20bf2f35833 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.666006:0:22756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffca49800/0x4642c20bf2f357fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f357f4 expref: 18 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.666022:0:22756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9caffca49800/0x4642c20bf2f357fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f357f4 expref: 18 pid: 22734 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560930.666038:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22756:1874392862931840:0@lo:104: 00000100:00100000:1.0:1787560930.667245:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787560930.667453:0:22756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffcbfe200/0x4642c20bf2f35737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f35730 expref: 18 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.667467:0:22756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9caffcbfe200/0x4642c20bf2f35737 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f35730 expref: 18 pid: 22734 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560930.667480:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22756:1874392862931968:0@lo:104: 00000100:00100000:1.0:1787560930.667505:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560930.667526:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe06da540 going to sleep for 11 seconds 00000100:00100000:1.0:1787560930.667563:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862931840 00000100:00100000:1.0:1787560930.667570:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862931840 00000100:00100000:1.0:1787560930.667604:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862931968 00000100:00100000:1.0:1787560930.667607:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862931968 00000100:00100000:1.0:1787560930.667621:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787560930.667629:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffba2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c33dd467-64b2-4362-8604-d1a6489592bb+4:22756:x1874392862931840:12345-0@lo:104: 00010000:00010000:1.0:1787560930.667641:0:22723:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6a00/0x4642c20bf2f357f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f357fb expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.667689:0:22723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787560930.667695:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffba2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c33dd467-64b2-4362-8604-d1a6489592bb+4:22756:x1874392862931840:12345-0@lo:104: Request processed in 67us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560930.667713:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787560930.667729:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787560930.667735:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffba2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c33dd467-64b2-4362-8604-d1a6489592bb+3:22756:x1874392862931968:12345-0@lo:104: 00010000:00010000:1.0:1787560930.667742:0:22723:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35730 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f35737 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.667777:0:22723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787560930.667783:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffba2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c33dd467-64b2-4362-8604-d1a6489592bb+3:22756:x1874392862931968:12345-0@lo:104: Request processed in 48us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560930.667789:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787560930.667804:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787560930.667809:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6a00/0x4642c20bf2f357f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f357fb expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.667828:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6a00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:1.0:1787560930.667833:0:22729:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6a00/0x4642c20bf2f357f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f357fb expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.667842:0:22729:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6a00/0x4642c20bf2f357f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f357fb expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560930.667849:0:22729:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6a00/0x4642c20bf2f357f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f357fb expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560930.667854:0:22729:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787560930.667891:0:22729:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6a00/0x4642c20bf2f357f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f357fb expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.667898:0:22729:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560930.667927:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6a00/0x4642c20bf2f357f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f357fb expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.667935:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6a00/0x4642c20bf2f357f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f357fb expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.667945:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560930.667948:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35730 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f35737 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.667954:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49e00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:1.0:1787560930.667957:0:22729:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35730 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f35737 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.667963:0:22729:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35730 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f35737 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560930.667968:0:22729:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35730 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f35737 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560930.667974:0:22729:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787560930.667988:0:22729:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35730 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35737 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.667994:0:22729:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560930.668007:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35730 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35737 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.668015:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caffca49e00/0x4642c20bf2f35730 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35737 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.668039:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560930.668041:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560930.668043:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560930.668052:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560930.668058:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c33dd467-64b2-4362-8604-d1a6489592bb:3624:1874392862932096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560930.668084:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c33dd467-64b2-4362-8604-d1a6489592bb:3625:1874392862932224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787560930.668096:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560930.668124:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560930.668174:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862932096 00000100:00100000:1.0:1787560930.668178:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862932096 00010000:00010000:1.0:1787560930.668195:0:22726:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffca49800/0x4642c20bf2f357fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f357f4 expref: 19 pid: 22734 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560930.668213:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862932224 00000100:00100000:1.0:1787560930.668215:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862932224 00010000:00010000:1.0:1787560930.668225:0:22726:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffcbfe200/0x4642c20bf2f35737 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f35730 expref: 20 pid: 22734 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560930.668237:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787560930.668243:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c33dd467-64b2-4362-8604-d1a6489592bb+20:3624:x1874392862932096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560930.668253:0:22726:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560930.668259:0:22726:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffca49800/0x4642c20bf2f357fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f357f4 expref: 20 pid: 22734 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.668269:0:22726:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffca49800/0x4642c20bf2f357fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f357f4 expref: 20 pid: 22734 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.668283:0:22726:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560930.668306:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c33dd467-64b2-4362-8604-d1a6489592bb+20:3624:x1874392862932096:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560930.668324:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787560930.668337:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787560930.668343:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c33dd467-64b2-4362-8604-d1a6489592bb+19:3625:x1874392862932224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560930.668350:0:22726:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560930.668355:0:22726:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffcbfe200/0x4642c20bf2f35737 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f35730 expref: 19 pid: 22734 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.668363:0:22726:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffcbfe200/0x4642c20bf2f35737 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f35730 expref: 19 pid: 22734 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.668376:0:22726:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9caec3881600/0x4642c20bf2f35833 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.668384:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec3881600/0x4642c20bf2f35833 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787560930.668397:0:22726:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005333257s 00010000:00010000:1.0:1787560930.668401:0:22726:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9caec3881600/0x4642c20bf2f35833 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.668409:0:22726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9caec3881600/0x4642c20bf2f35833 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.668416:0:22726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9caec3881600/0x4642c20bf2f35833 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.668422:0:22726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9caec3881600/0x4642c20bf2f35833 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.668452:0:22726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881600 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560930.668463:0:22726:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9caec3881600/0x4642c20bf2f35833 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.668471:0:22726:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9caec3881600/0x4642c20bf2f35833 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.668479:0:22726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9caec3881600/0x4642c20bf2f35833 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.668488:0:22726:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560930.668515:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c33dd467-64b2-4362-8604-d1a6489592bb+19:3625:x1874392862932224:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560930.668521:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787560930.668551:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c33dd467-64b2-4362-8604-d1a6489592bb:3625:1874392862932224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787560930.668606:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+18:23472:x1874392862931712:12345-0@lo:253:mount.lustre.0 Request processed in 11199us (11358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560930.668616:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787560930.668658:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:23472:1874392862931712:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787560930.668668:0:23472:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787560930.668671:0:23472:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787560930.668674:0:23472:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787560930.668676:0:23472:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787560930.668677:0:23472:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787560930.668678:0:23472:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787560930.668679:0:23472:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787560930.668681:0:23472:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787560930.668683:0:23472:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787560930.668684:0:23472:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787560930.668694:0:23472:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787560930.669016:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c33dd467-64b2-4362-8604-d1a6489592bb:3624:1874392862932096:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560930.669259:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca49800/0x4642c20bf2f357fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f357f4 expref: 17 pid: 22734 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560930.669282:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22756:1874392862931840:0@lo:104: 00010000:00010000:1.0:1787560930.669294:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffcbfe200/0x4642c20bf2f35737 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f35730 expref: 16 pid: 22734 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560930.669302:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22756:1874392862931968:0@lo:104: 00010000:00010000:1.0:1787560930.669317:0:22756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9caec3881600/0x4642c20bf2f35833 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.669325:0:22756:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9caec3881600/0x4642c20bf2f35833 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.669331:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9caec3881600/0x4642c20bf2f35833 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560930.669338:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caec3881600/0x4642c20bf2f35833 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:3.0:1787560930.678688:0:23472:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1787560930.678991:0:23498:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1787560930.678995:0:23498:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787560930.684853:0:23499:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1787560930.686797:0:23499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1787560930.687640:0:23472:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:01000000:0.0:1787560930.688249:0:23472:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1787560930.688287:0:23472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787560930.688959:0:23500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb9880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23500:1874392862932352:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787560930.689041:0:23500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560930.689156:0:23500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd84bb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560930.689630:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862932352 00000100:00100000:1.0:1787560930.689638:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862932352 00000004:00000080:0.0:1787560930.690159:0:23472:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787560930.690171:0:23472:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1787560930.690246:0:23472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787560930.692612:0:23499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000100:00100000:1.0:1787560930.692662:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787560930.692683:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23500:x1874392862932352:12345-0@lo:1000:lod0001_rec0000.0 00000004:00080000:2.0:1787560930.692771:0:23499:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1787560930.692832:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23500:x1874392862932352:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 158us (3790us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560930.692841:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:0.0:1787560930.693147:0:23472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1787560930.693534:0:23500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb9880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23500:1874392862932352:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1787560930.693576:0:23500:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787560930.693618:0:23500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e9180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23500:1874392862932480:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787560930.693666:0:23500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1787560930.695905:0:23472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787560930.695985:0:23472:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:1.0:1787560930.696733:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862932480 00000100:00100000:1.0:1787560930.696744:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862932480 00000100:00100000:2.0:1787560930.696770:0:23500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec22aa6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560930.696793:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787560930.696804:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23500:x1874392862932480:12345-0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1787560930.696954:0:23472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787560930.697852:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23500:x1874392862932480:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 1048us (4184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560930.697862:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787560930.697896:0:23500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e9180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23500:1874392862932480:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787560930.697980:0:23500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e9180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23500:1874392862932608:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1787560930.698020:0:23500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560930.698059:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862932608 00000100:00100000:2.0:1787560930.698063:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862932608 00000100:00100000:2.0:1787560930.698094:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787560930.698109:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23500:x1874392862932608:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1787560930.698156:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23500:x1874392862932608:12345-0@lo:900:lod0001_rec0000.0 Request processed in 49us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560930.698163:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787560930.698183:0:23500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec22aa480 going to sleep for 11 seconds 00010000:00080000:2.0:1787560930.698261:0:23500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cafc46e9180 x1874392862932608/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787560946 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560930.698275:0:23500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e9180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23500:1874392862932608:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1787560930.698320:0:23500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e9180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23500:1874392862932736:0@lo:1000:lod0001_rec0000.0 00080000:10000000:0.0:1787560930.698365:0:23472:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:2.0:1787560930.698634:0:23500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560930.698664:0:23481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862932736 00000100:00100000:2.0:1787560930.698667:0:23481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862932736 00000100:00100000:2.0:1787560930.698767:0:23481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787560930.698773:0:23481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23500:x1874392862932736:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787560930.698822:0:23481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23500:x1874392862932736:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 49us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560930.698831:0:23481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787560930.698848:0:23500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec22aa6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560930.698861:0:23500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e9180 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23500:1874392862932736:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1787560930.698916:0:23500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787560930.703095:0:23500:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787560930.703176:0:23500:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787560930.703180:0:23500:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:1.0:1787560930.706371:0:23472:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1787560930.709624:0:23472:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787560930.709671:0:23472:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb6db418bf988 00100000:10000000:1.0:1787560930.709680:0:23472:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1787560930.710963:0:23472:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787560930.710995:0:23472:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.129@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787560930.711009:0:23472:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787560930.711023:0:23472:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1787560930.711821:0:23472:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787560930.712031:0:23472:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787560930.743906:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560931.254277:0:22782:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c53c0 going to sleep for 0 seconds 00000040:00080000:3.0:1787560931.703373:0:23495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787560931.763720:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560932.275584:0:22782:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c53c0 going to sleep for 0 seconds 10000000:01000000:1.0:1787560932.340566:0:22737:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787560932.340581:0:22737:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cafffe2b000 from 12 10000000:01000000:1.0:1787560932.340590:0:22737:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787560932.340670:0:22737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3881000/0x4642c20bf2f3583a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560932.340685:0:22737:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caec3881000/0x4642c20bf2f3583a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560932.340700:0:22737:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caec3881000/0x4642c20bf2f3583a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560932.340737:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862932864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787560932.340856:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560932.340938:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffb8af0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560932.341118:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862932864 00000100:00100000:3.0:1787560932.341129:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862932864 00000100:00100000:3.0:1787560932.341206:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787560932.341218:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+16:22737:x1874392862932864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787560932.341236:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560932.341256:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafda2f6e00/0x4642c20bf2f35841 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f3583a expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560932.341285:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafda2f6e00/0x4642c20bf2f35841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f3583a expref: 17 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560932.341298:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafda2f6e00/0x4642c20bf2f35841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f3583a expref: 17 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560932.341318:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f6e00, rc 0) 00000100:00100000:3.0:1787560932.341378:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+17:22737:x1874392862932864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560932.341386:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787560932.341462:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862932864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787560932.341480:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caec3881000/0x4642c20bf2f3583a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35841 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560932.341490:0:22737:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caec3881000/0x4642c20bf2f3583a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35841 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560932.341549:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862932992:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787560932.341581:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560932.341594:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd84bb180 going to sleep for 11 seconds 00000100:00100000:1.0:1787560932.341665:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862932992 00000100:00100000:1.0:1787560932.341670:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862932992 00000100:00100000:1.0:1787560932.341702:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787560932.341708:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdf2c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+17:22737:x1874392862932992:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787560932.341724:0:22735:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787560932.341743:0:22735:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787560932.341746:0:22735:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1787560932.343477:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdf2c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+17:22737:x1874392862932992:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1752us (1879us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560932.343495:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787560932.348234:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862932992:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787560932.348326:0:22737:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787560932.348340:0:22737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3881000/0x4642c20bf2f3583a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35841 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560932.348353:0:22737:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caec3881000/0x4642c20bf2f3583a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35841 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560932.348367:0:22737:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787560932.348370:0:22737:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9caffcb60800 from 12 10000000:01000000:3.0:1787560932.348372:0:22737:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787560932.348418:0:22737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f35848 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560932.348465:0:22737:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f35848 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560932.348477:0:22737:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f35848 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560932.348504:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862933120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787560932.348597:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560932.348749:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd84bb180 going to sleep for 11 seconds 00000100:00100000:1.0:1787560932.355004:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862933120 00000100:00100000:1.0:1787560932.355029:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862933120 00000100:00100000:1.0:1787560932.355129:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787560932.355144:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdf2c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+17:22737:x1874392862933120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560932.355172:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560932.355199:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caec3880a00/0x4642c20bf2f3584f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f35848 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560932.355234:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec3880a00/0x4642c20bf2f3584f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f35848 expref: 18 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560932.355247:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caec3880a00/0x4642c20bf2f3584f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35848 expref: 18 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560932.355259:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3880a00, rc 0) 00000100:00100000:1.0:1787560932.355628:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdf2c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+18:22737:x1874392862933120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 485us (7028us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560932.355667:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862933120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560932.355693:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f35848 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3584f expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560932.355706:0:22737:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f35848 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f3584f expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560932.355718:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787560932.355809:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862933248:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787560932.355860:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560932.355914:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec22aa840 going to sleep for 11 seconds 00000100:00100000:1.0:1787560932.356036:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862933248 00000100:00100000:1.0:1787560932.356050:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862933248 00000100:00100000:1.0:1787560932.356091:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787560932.356099:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdf2c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+18:22737:x1874392862933248:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787560932.356120:0:22735:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787560932.356142:0:22735:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787560932.356145:0:22735:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1787560932.356232:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdf2c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+18:22737:x1874392862933248:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 133us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560932.356239:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787560932.356410:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862933248:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787560932.356512:0:22737:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787560932.356524:0:22737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f35848 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3584f expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560932.356535:0:22737:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f35848 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3584f expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787560932.724401:0:23495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787560932.798771:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560933.301505:0:22782:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c53c0 going to sleep for 0 seconds 00010000:00010000:3.0:1787560933.814536:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560934.324496:0:22782:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c53c0 going to sleep for 0 seconds 00010000:00010000:3.0:1787560934.835779:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787560935.204425:0:23744:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787560935.348114:0:22782:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c53c0 going to sleep for 0 seconds 00010000:00010000:3.0:1787560935.863595:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560935.988174:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862933376:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787560935.988263:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560935.988385:0:23481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862933376 00000100:00100000:0.0:1787560935.988394:0:23481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862933376 00000100:00100000:0.0:1787560935.988470:0:23481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787560935.988480:0:23481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862933376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787560935.988517:0:23481:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787560935.988565:0:23481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862933376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560935.988572:0:23481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787560935.988814:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862933376:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787560935.993573:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c33dd467-64b2-4362-8604-d1a6489592bb:3623:1874392862933504:0@lo:400:kworker.0 00000100:00100000:2.0:1787560935.993675:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787560935.993740:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787560935.993745:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787560935.993749:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cafc68d6000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787560935.993760:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9cafc68d6000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560935.993783:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffcbb8700 x1874392862933632/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787560935.993812:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560935.993816:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787560935.993819:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560935.993823:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787560935.993904:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862933504 00000100:00100000:0.0:1787560935.993914:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862933504 00000100:00100000:0.0:1787560935.993970:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787560935.993981:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdf2c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+18:3623:x1874392862933504:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787560935.994146:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560935.994151:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787560935.994155:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560935.994158:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787560935.994203:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862933760:0@lo:400:kworker.0 00000100:00100000:3.0:1787560935.994245:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560935.994286:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862933888:0@lo:400:kworker.0 00000100:00100000:3.0:1787560935.994317:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560935.994361:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862933760 00000100:00100000:3.0:1787560935.994365:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862933760 00000100:00100000:3.0:1787560935.994487:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862933888 00000100:00100000:3.0:1787560935.994491:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862933888 00000100:00100000:3.0:1787560935.994508:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787560935.994514:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862933760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560935.994554:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862933760:12345-0@lo:400:kworker.0 Request processed in 39us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560935.994562:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787560935.994578:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787560935.994585:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862933888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560935.994624:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862933888:12345-0@lo:400:kworker.0 Request processed in 40us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560935.994632:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787560935.994669:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9caffcbb9180 x1874392862933888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560935.994684:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862933888:0@lo:400:kworker.0 00010000:00080000:3.0:1787560935.994714:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9caffcbbb100 x1874392862933760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560935.994724:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862933760:0@lo:400:kworker.0 00000100:00100000:3.0:1787560935.994754:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862933632:0@lo:38:kworker.0 00000100:00100000:3.0:1787560935.994782:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560935.994814:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862933632 00000100:00100000:3.0:1787560935.994817:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862933632 00000100:00100000:3.0:1787560935.994837:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787560935.994843:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1874392862933632:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787560935.994882:0:22746:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 655 last 0 00000020:00000080:3.0:1787560935.994923:0:22746:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4642c20bf2f35856 00000004:00100000:3.0:1787560935.994939:0:22746:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1787560935.994945:0:22746:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:2.0:1787560935.998697:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c33dd467-64b2-4362-8604-d1a6489592bb:3623:1874392862933504:0@lo:400:kworker.0 00000100:00100000:0.0:1787560935.998698:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdf2c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+18:3623:x1874392862933504:12345-0@lo:400:kworker.0 Request processed in 4709us (5013us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560935.998718:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1787560936.005416:0:22746:0:(import.c:65:import_set_state_nolock()) ffff9cafc3f7a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787560936.005560:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3622:x1874392862933632:12345-0@lo:38:kworker.0 Request processed in 10713us (10774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560936.005573:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787560936.005616:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1787560936.005628:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787560936.005635:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787560936.005638:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafc68d6000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787560936.005661:0:3622:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000d80338d5): req@ffff9caffba2f800 x1874392862926592/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560936.005682:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862933632:0@lo:38:kworker.0 00000100:00100000:2.0:1787560936.005764:0:22782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560936.005775:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862934016:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787560936.005808:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862926592 00000100:00100000:2.0:1787560936.005810:0:22782:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560936.005816:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862926592 00000100:00100000:0.0:1787560936.005829:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560936.009963:0:23481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862934016 00000100:00100000:2.0:1787560936.009985:0:23481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862934016 00000100:00100000:2.0:1787560936.010039:0:23481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787560936.010048:0:23481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22782:x1874392862926592:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787560936.010174:0:23481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22782:x1874392862926592:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 126us (4412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560936.010182:0:23481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787560936.010199:0:23481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787560936.010206:0:23481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3626:x1874392862934016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787560936.010231:0:23481:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787560936.010269:0:23481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3626:x1874392862934016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (4441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560936.010275:0:23481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787560936.010326:0:22782:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2f800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22782:1874392862926592:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1787560936.010367:0:22782:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787560936.010414:0:22782:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e8000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22782:1874392862934144:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787560936.010470:0:22782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560936.010502:0:22782:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec22aa300 going to sleep for 11 seconds 00000100:00100000:2.0:1787560936.010518:0:23481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862934144 00000100:00100000:2.0:1787560936.010522:0:23481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862934144 00000100:00100000:2.0:1787560936.010544:0:23481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787560936.010550:0:23481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22782:x1874392862934144:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787560936.010580:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862934016:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787560936.010669:0:23481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22782:x1874392862934144:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 118us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560936.010677:0:23481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787560936.010689:0:22782:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e8000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22782:1874392862934144:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787560936.010758:0:22782:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf5500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22782:1874392862934272:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787560936.010795:0:22782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560936.010818:0:22782:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787560936.011703:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862934272 00000100:00100000:2.0:1787560936.012066:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862934272 00000100:00100000:2.0:1787560936.012139:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787560936.012150:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22782:x1874392862934272:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787560936.012246:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22782:x1874392862934272:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 98us (1450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560936.012254:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787560936.012484:0:22782:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf5500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22782:1874392862934272:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1787560936.012538:0:22782:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000004:3.0:1787560936.015285:0:23796:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787560936.015555:0:23796:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:0.0:1787560936.017157:0:22782:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787560936.017239:0:22782:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:0.0:1787560936.017244:0:22782:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1787560936.883869:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787560936.914112:0:23846:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787560936.914314:0:23846:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787560937.907719:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787560938.154211:0:23894:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd4f17d580 20000000:00000080:2.0:1787560938.154229:0:23894:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cafc7540c00 uarg=0000000000000000 20000000:01000000:2.0:1787560938.154272:0:23894:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787560938.154280:0:23894:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787560938.154284:0:23894:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787560938.154927:0:23895:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1787560938.155062:0:23894:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787560938.164509:0:23894:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787560938.164563:0:23894:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9caffca49a00/0x4642c20bf2f3585d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560938.164594:0:23894:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f35706 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f356ff expref: 17 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560938.164602:0:23894:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f35809 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35802 expref: 17 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560938.164610:0:23894:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9caffca49a00/0x4642c20bf2f3585d lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560938.164686:0:23894:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f35809 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f35802 expref: 17 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560938.164705:0:23894:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f35809 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f35802 expref: 17 pid: 22735 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560938.164751:0:23894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23894:1874392862934400:0@lo:104: 00000100:00100000:2.0:1787560938.164857:0:23894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787560938.165355:0:23894:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f35706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f356ff expref: 17 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560938.165366:0:23894:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f35706 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f356ff expref: 17 pid: 22735 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560938.165376:0:23894:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46ebb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23894:1874392862934528:0@lo:104: 00000100:00100000:2.0:1787560938.165403:0:23894:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560938.168581:0:23894:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec22aa540 going to sleep for 11 seconds 00000100:00100000:1.0:1787560938.168957:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862934400 00000100:00100000:1.0:1787560938.168973:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862934400 00000100:00100000:1.0:1787560938.169020:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862934528 00000100:00100000:1.0:1787560938.169023:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862934528 00000100:00100000:3.0:1787560938.169054:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787560938.169074:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c33dd467-64b2-4362-8604-d1a6489592bb+4:23894:x1874392862934400:12345-0@lo:104: 00010000:00010000:3.0:1787560938.169109:0:22724:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9caffca48000/0x4642c20bf2f35802 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f35809 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560938.169214:0:22724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787560938.169220:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c33dd467-64b2-4362-8604-d1a6489592bb+4:23894:x1874392862934400:12345-0@lo:104: Request processed in 154us (4364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560938.169468:0:23894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23894:1874392862934400:0@lo:104: 00010000:00010000:2.0:1787560938.170503:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560938.170517:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caffca48000/0x4642c20bf2f35802 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f35809 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560938.170530:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca48000 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:2.0:1787560938.170535:0:22729:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caffca48000/0x4642c20bf2f35802 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f35809 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560938.170548:0:22729:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caffca48000/0x4642c20bf2f35802 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f35809 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560938.170556:0:22729:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caffca48000/0x4642c20bf2f35802 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f35809 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560938.170563:0:22729:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787560938.170629:0:22729:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caffca48000/0x4642c20bf2f35802 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35809 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560938.170650:0:22729:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560938.170678:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caffca48000/0x4642c20bf2f35802 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35809 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560938.170686:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caffca48000/0x4642c20bf2f35802 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35809 expref: -99 pid: 23472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560938.170716:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560938.170718:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560938.170720:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560938.170746:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c33dd467-64b2-4362-8604-d1a6489592bb:3623:1874392862934656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787560938.171221:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560938.171272:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862934656 00000100:00100000:0.0:1787560938.171281:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862934656 00010000:00010000:0.0:1787560938.171322:0:22725:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f35809 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f35802 expref: 18 pid: 22735 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560938.171397:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787560938.171408:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c33dd467-64b2-4362-8604-d1a6489592bb+18:3623:x1874392862934656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787560938.171425:0:22725:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560938.171444:0:22725:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f35809 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f35802 expref: 18 pid: 22735 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560938.171457:0:22725:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f35809 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f35802 expref: 18 pid: 22735 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560938.171477:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f35809 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f35802 expref: 18 pid: 22735 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560938.171496:0:22725:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560938.171539:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c33dd467-64b2-4362-8604-d1a6489592bb+17:3623:x1874392862934656:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560938.171546:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787560938.171601:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c33dd467-64b2-4362-8604-d1a6489592bb:3623:1874392862934656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787560938.174383:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787560938.174473:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787560938.174496:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c33dd467-64b2-4362-8604-d1a6489592bb+3:23894:x1874392862934528:12345-0@lo:104: 00010000:00010000:3.0:1787560938.174525:0:22724:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9caffcbff600/0x4642c20bf2f356ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f35706 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560938.174654:0:22724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787560938.174666:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c33dd467-64b2-4362-8604-d1a6489592bb+3:23894:x1874392862934528:12345-0@lo:104: Request processed in 179us (9257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560938.174673:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787560938.174860:0:23894:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46ebb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23894:1874392862934528:0@lo:104: 00010000:00010000:2.0:1787560938.174896:0:23894:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9caffca49a00/0x4642c20bf2f3585d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560938.175704:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560938.175719:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caffcbff600/0x4642c20bf2f356ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f35706 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560938.175730:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbff600 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:1.0:1787560938.175734:0:22728:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caffcbff600/0x4642c20bf2f356ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f35706 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560938.175765:0:22728:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caffcbff600/0x4642c20bf2f356ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f35706 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787560938.175772:0:22728:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caffcbff600/0x4642c20bf2f356ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f35706 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560938.175777:0:22728:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787560938.175920:0:22728:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caffcbff600/0x4642c20bf2f356ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35706 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560938.175929:0:22728:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787560938.175960:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caffcbff600/0x4642c20bf2f356ff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35706 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560938.175967:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caffcbff600/0x4642c20bf2f356ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35706 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560938.175986:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1787560938.175995:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560938.175999:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560938.176002:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560938.176015:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c33dd467-64b2-4362-8604-d1a6489592bb:3623:1874392862934784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787560938.176091:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560938.178112:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862934784 00000100:00100000:1.0:1787560938.178125:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862934784 00010000:00010000:1.0:1787560938.178171:0:22726:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f35706 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f356ff expref: 17 pid: 22735 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560938.178209:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787560938.178219:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c33dd467-64b2-4362-8604-d1a6489592bb+17:3623:x1874392862934784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560938.178232:0:22726:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560938.178237:0:22726:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f35706 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f356ff expref: 17 pid: 22735 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560938.178265:0:22726:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f35706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f356ff expref: 17 pid: 22735 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560938.178286:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f35706 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f356ff expref: 17 pid: 22735 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560938.178303:0:22726:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9caffca49a00/0x4642c20bf2f3585d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560938.178312:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca49a00/0x4642c20bf2f3585d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560938.178330:0:22726:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9caffca49a00/0x4642c20bf2f3585d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560938.178338:0:22726:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9caffca49a00/0x4642c20bf2f3585d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560938.178345:0:22726:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9caffca49a00/0x4642c20bf2f3585d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560938.178351:0:22726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9caffca49a00/0x4642c20bf2f3585d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560938.178358:0:22726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49a00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560938.178363:0:22726:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9caffca49a00/0x4642c20bf2f3585d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560938.178370:0:22726:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9caffca49a00/0x4642c20bf2f3585d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560938.178404:0:22726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9caffca49a00/0x4642c20bf2f3585d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560938.178417:0:22726:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787560938.178493:0:23894:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9caffca49a00/0x4642c20bf2f3585d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560938.178510:0:23894:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9caffca49a00/0x4642c20bf2f3585d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560938.178519:0:23894:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca49a00/0x4642c20bf2f3585d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23894 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560938.178540:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c33dd467-64b2-4362-8604-d1a6489592bb+16:3623:x1874392862934784:12345-0@lo:103:ldlm_bl.0 Request processed in 321us (2448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560938.178568:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787560938.179327:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c33dd467-64b2-4362-8604-d1a6489592bb:3623:1874392862934784:0@lo:103:ldlm_bl.0 00000040:00080000:3.0:1787560938.421350:0:22774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787560938.932548:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787560939.443595:0:22737:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787560939.443602:0:22737:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cafffe2b000 from 13 10000000:01000000:0.0:1787560939.443608:0:22737:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787560939.443664:0:22737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35864 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560939.443676:0:22737:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35864 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560939.443688:0:22737:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35864 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560939.443714:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862934912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787560939.443802:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560939.443913:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787560939.444944:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862934912 00000100:00100000:2.0:1787560939.445072:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862934912 00000100:00100000:2.0:1787560939.445132:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787560939.445142:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdf2c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+16:22737:x1874392862934912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560939.445156:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560939.445173:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca48000/0x4642c20bf2f3586b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f35864 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560939.445197:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca48000/0x4642c20bf2f3586b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f35864 expref: 17 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560939.445207:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca48000/0x4642c20bf2f3586b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35864 expref: 17 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560939.445216:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca48000, rc 0) 00000100:00100000:2.0:1787560939.445278:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdf2c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+17:22737:x1874392862934912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560939.445284:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787560939.445339:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862934912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787560939.445361:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35864 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3586b expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560939.445371:0:22737:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35864 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f3586b expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560939.445575:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862935040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560939.445607:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560939.445644:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787560939.445693:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862935040 00000100:00100000:2.0:1787560939.445697:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862935040 00000100:00100000:2.0:1787560939.445728:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787560939.445734:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdf2c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+17:22737:x1874392862935040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560939.445866:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdf2c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+17:22737:x1874392862935040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560939.445873:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787560939.445956:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862935040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560939.445988:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862935168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787560939.446035:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560939.446057:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc46c80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560939.446099:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862935168 00000100:00100000:2.0:1787560939.446110:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862935168 00000100:00100000:2.0:1787560939.446139:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787560939.446146:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdf2c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+17:22737:x1874392862935168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560939.446221:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdf2c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+17:22737:x1874392862935168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560939.446228:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787560939.446265:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862935168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787560939.446921:0:23957:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787560939.446985:0:22737:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787560939.447006:0:22737:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787560939.447016:0:22737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35864 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3586b expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560939.447026:0:22737:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35864 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3586b expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560939.447036:0:22737:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787560939.447039:0:22737:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9caffcb60800 from 13 10000000:01000000:2.0:1787560939.447041:0:22737:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787560939.447074:0:22737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f35872 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560939.447082:0:22737:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f35872 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560939.447090:0:22737:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f35872 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560939.447106:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862935296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787560939.447152:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560939.447169:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec22aa300 going to sleep for 11 seconds 00000100:00100000:2.0:1787560939.447184:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862935296 00000100:00100000:2.0:1787560939.447188:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862935296 00000100:00100000:2.0:1787560939.447211:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787560939.447218:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdf2c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+17:22737:x1874392862935296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560939.447228:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560939.447238:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca49600/0x4642c20bf2f35879 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f35872 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560939.447256:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca49600/0x4642c20bf2f35879 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f35872 expref: 18 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560939.447265:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca49600/0x4642c20bf2f35879 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35872 expref: 18 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560939.447273:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca49600, rc 0) 00000100:00100000:2.0:1787560939.447303:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdf2c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+18:22737:x1874392862935296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560939.447309:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787560939.447341:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862935296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560939.447354:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f35872 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35879 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560939.447362:0:22737:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f35872 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35879 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560939.447403:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862935424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560939.447460:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560939.447472:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec22aa300 going to sleep for 11 seconds 00000100:00100000:2.0:1787560939.447482:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862935424 00000100:00100000:2.0:1787560939.447486:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862935424 00000100:00100000:2.0:1787560939.447501:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787560939.447506:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4788450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+18:22737:x1874392862935424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560939.447582:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4788450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+18:22737:x1874392862935424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 75us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560939.447588:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787560939.447608:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862935424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560939.447627:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862935552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560939.447658:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560939.447668:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec22aa300 going to sleep for 11 seconds 00000100:00100000:2.0:1787560939.447676:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862935552 00000100:00100000:2.0:1787560939.447679:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862935552 00000100:00100000:2.0:1787560939.447693:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787560939.447697:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4788050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+18:22737:x1874392862935552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560939.447754:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4788050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+18:22737:x1874392862935552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 55us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560939.447760:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787560939.447796:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862935552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787560939.448509:0:23958:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787560939.448557:0:22737:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787560939.448574:0:22737:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787560939.448583:0:22737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f35872 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35879 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560939.448600:0:22737:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f35872 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35879 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560939.958205:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560940.090188:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560930/real 1787560930] req@ffff9cafc46eb800 x1874392862929792/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560940 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560940.090218:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cafc46eb800 x1874392862929792/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560940 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560940.090228:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560930/real 1787560930] req@ffff9cafc46e8380 x1874392862929664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560940 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560940.090240:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cafc46e8380 x1874392862929664/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560940 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787560940.090258:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec3383000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787560940.090349:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787560940.090353:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862929792:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787560940.090359:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffcbc7800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787560940.093670:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560940.093677:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787560940.093680:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560940.093684:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787560940.093719:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560940.093723:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787560940.093727:0:36:0:(import.c:65:import_set_state_nolock()) ffff9caffcbc7800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787560940.093735:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 649 00000100:00080000:3.0:1787560940.093740:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787560940.093746:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9caffcbc7800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560940.093769:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffcbbb480 x1874392862936192/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787560940.093781:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560940.093784:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787560940.093786:0:36:0:(import.c:65:import_set_state_nolock()) ffff9caec3383000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787560940.093789:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 649 00000100:00080000:3.0:1787560940.093792:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787560940.093796:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9caec3383000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560940.093808:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffcbb8a80 x1874392862936320/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787560940.093952:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c33dd467-64b2-4362-8604-d1a6489592bb:3625:1874392862935680:0@lo:400:kworker.0 00000100:00100000:3.0:1787560940.094034:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560940.094090:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862936448:0@lo:400:kworker.0 00000100:00100000:3.0:1787560940.094118:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560940.094144:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787560940.094150:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862935808:0@lo:400:kworker.0 00000100:00100000:3.0:1787560940.094175:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560940.094204:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862935936:0@lo:400:kworker.0 00000100:00100000:3.0:1787560940.094238:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560940.094257:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560940.094262:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862936064:0@lo:400:kworker.0 00000100:00100000:3.0:1787560940.094283:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560940.094312:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862936448 00000100:00100000:3.0:1787560940.094319:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862936448 00000100:00100000:3.0:1787560940.094362:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862935936 00000100:00100000:3.0:1787560940.094365:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862935936 00000100:00100000:3.0:1787560940.094383:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787560940.094392:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862936448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560940.094467:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862936448:12345-0@lo:400:kworker.0 Request processed in 74us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560940.094474:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787560940.094490:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787560940.094497:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862935936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560940.094528:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862935936:12345-0@lo:400:kworker.0 Request processed in 31us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560940.094534:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787560940.094574:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9caffcbbad80 x1874392862936448/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560940.094586:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862936448:0@lo:400:kworker.0 00010000:00080000:3.0:1787560940.094609:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9caffcbba300 x1874392862935936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560940.094616:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862935936:0@lo:400:kworker.0 00000100:00080000:2.0:1787560940.094708:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787560940.094714:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862929664:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1787560940.094726:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862935680 00000100:00100000:2.0:1787560940.094730:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862935680 00000100:00100000:2.0:1787560940.094760:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787560940.094766:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc478b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+18:3625:x1874392862935680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560940.094803:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc478b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+18:3625:x1874392862935680:12345-0@lo:400:kworker.0 Request processed in 37us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560940.094832:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787560940.094864:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862935808 00000100:00100000:2.0:1787560940.094868:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862935808 00000100:00100000:2.0:1787560940.094898:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862936064 00000100:00100000:2.0:1787560940.094902:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862936064 00000100:00100000:2.0:1787560940.094915:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787560940.094921:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3625:x1874392862935808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560940.094954:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3625:x1874392862935808:12345-0@lo:400:kworker.0 Request processed in 33us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560940.094960:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787560940.094973:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787560940.094977:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862936064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560940.095009:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862936064:12345-0@lo:400:kworker.0 Request processed in 31us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560940.095015:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787560940.095046:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862936064:0@lo:400:kworker.0 00000100:00100000:2.0:1787560940.095071:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862936192:0@lo:8:kworker.0 00000400:00000100:2.0:1787560940.095096:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874392862936192 offset 0 length 520: 4 00000100:00100000:2.0:1787560940.095116:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862936320:0@lo:8:kworker.0 00000400:00000100:2.0:1787560940.095135:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874392862936320 offset 0 length 520: 4 00000100:00100000:3.0:1787560940.095205:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862935808:0@lo:400:kworker.0 00000100:00100000:3.0:1787560940.095224:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c33dd467-64b2-4362-8604-d1a6489592bb:3625:1874392862935680:0@lo:400:kworker.0 00000100:00080000:3.0:1787560940.095248:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560940.095252:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787560940.095255:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560940.095258:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787560940.982164:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560941.107614:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560926/real 1787560926] req@ffff9caffba2dc00 x1874392862927616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560941 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560941.107665:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9caffba2dc00 x1874392862927616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560941 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560941.107676:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560926/real 1787560926] req@ffff9caffba2fb80 x1874392862927744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560941 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560941.107694:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9caffba2fb80 x1874392862927744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560941 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787560941.107781:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffff55000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787560941.107807:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787560941.107822:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862927616:0@lo:8:kworker.0 00000100:00080000:2.0:1787560941.107835:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafc58be000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787560941.107841:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787560941.107844:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862927744:0@lo:8:kworker.0 00000100:00080000:3.0:1787560941.107995:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560941.108000:0:15403:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787560941.108003:0:15403:0:(import.c:65:import_set_state_nolock()) ffff9caffff55000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787560941.108007:0:15403:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 645 00000100:00080000:3.0:1787560941.108011:0:15403:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787560941.108018:0:15403:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9caffff55000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560941.108036:0:15403:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffcbba300 x1874392862936832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787560941.108046:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560941.108049:0:15403:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787560941.108050:0:15403:0:(import.c:65:import_set_state_nolock()) ffff9cafc58be000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787560941.108052:0:15403:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 645 00000100:00080000:3.0:1787560941.108054:0:15403:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787560941.108058:0:15403:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cafc58be000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560941.108067:0:15403:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffcbbad80 x1874392862936960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787560941.108086:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560941.108089:0:15403:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787560941.108097:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560941.108100:0:15403:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787560941.108126:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862937216:0@lo:400:kworker.0 00000100:00100000:3.0:1787560941.108188:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560941.108217:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787560941.108224:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c33dd467-64b2-4362-8604-d1a6489592bb:3625:1874392862936576:0@lo:400:kworker.0 00000100:00100000:3.0:1787560941.108250:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560941.108277:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862937344:0@lo:400:kworker.0 00000100:00100000:3.0:1787560941.108300:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560941.108324:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862937088:0@lo:400:kworker.0 00000100:00100000:3.0:1787560941.108347:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560941.108364:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787560941.108368:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862936704:0@lo:400:kworker.0 00000100:00100000:3.0:1787560941.108388:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560941.108414:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862936576 00000100:00100000:3.0:1787560941.108421:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862936576 00000100:00100000:3.0:1787560941.108494:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787560941.108503:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4714c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+18:3625:x1874392862936576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560941.108545:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4714c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+18:3625:x1874392862936576:12345-0@lo:400:kworker.0 Request processed in 43us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560941.108551:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787560941.108581:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862937344 00000100:00100000:3.0:1787560941.108585:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862937344 00000100:00100000:3.0:1787560941.108607:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862937088 00000100:00100000:3.0:1787560941.108609:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862937088 00000100:00100000:3.0:1787560941.108622:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787560941.108635:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862937344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560941.108666:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862937344:12345-0@lo:400:kworker.0 Request processed in 33us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560941.108672:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787560941.108684:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787560941.108689:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862937088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560941.108719:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862937088:12345-0@lo:400:kworker.0 Request processed in 29us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560941.108724:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787560941.108760:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9caffcbbaa00 x1874392862937088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560941.108771:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862937088:0@lo:400:kworker.0 00000100:00100000:3.0:1787560941.108793:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c33dd467-64b2-4362-8604-d1a6489592bb:3625:1874392862936576:0@lo:400:kworker.0 00010000:00080000:3.0:1787560941.108802:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9caec407d180 x1874392862937344/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560941.108820:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862937344:0@lo:400:kworker.0 00000100:00100000:3.0:1787560941.108935:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862937600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560941.108959:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560941.108992:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787560941.108998:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862937472:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787560941.109018:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560941.109036:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862937216 00000100:00100000:2.0:1787560941.109040:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862937216 00000100:00100000:2.0:1787560941.109066:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862936704 00000100:00100000:2.0:1787560941.109070:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862936704 00000100:00100000:2.0:1787560941.109081:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862937600 00000100:00100000:2.0:1787560941.109083:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862937600 00000100:00100000:0.0:1787560941.109084:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862937472 00000100:00100000:0.0:1787560941.109087:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862937472 00000100:00100000:2.0:1787560941.109094:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787560941.109099:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3625:x1874392862937216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560941.109102:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787560941.109107:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3624:x1874392862936704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560941.109136:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3625:x1874392862937216:12345-0@lo:400:kworker.0 Request processed in 36us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560941.109142:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787560941.109154:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787560941.109154:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3624:x1874392862936704:12345-0@lo:400:kworker.0 Request processed in 46us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560941.109160:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3624:x1874392862937600:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787560941.109160:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787560941.109170:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787560941.109174:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862937472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787560941.109182:0:22746:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000004:00000024:0.0:1787560941.109187:0:22745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787560941.109208:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1874392862937600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 48us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560941.109208:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862937472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 33us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560941.109214:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787560941.109268:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862937472:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787560941.109279:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862937600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560941.109296:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862936704:0@lo:400:kworker.0 00000100:00100000:3.0:1787560941.109321:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862937216:0@lo:400:kworker.0 00000100:00100000:3.0:1787560941.110600:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862936832:0@lo:8:kworker.0 00000400:00000100:3.0:1787560941.110640:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874392862936832 offset 0 length 520: 4 00000100:00100000:3.0:1787560941.110669:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862936960:0@lo:8:kworker.0 00000400:00000100:3.0:1787560941.110683:0:3622:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874392862936960 offset 0 length 520: 4 00000100:00100000:2.0:1787560941.114912:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000001:00100000:2.0:1787560941.622654:0:23473:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1787560942.003644:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787560942.966672:0:23495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787560943.028730:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560944.053195:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787560944.665239:0:24243:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787560944.665243:0:24243:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787560944.665245:0:24243:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787560944.665344:0:24243:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9caffbb0c800 00000020:01000004:2.0:1787560944.665363:0:24243:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787560944.665385:0:24243:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787560944.665403:0:24243:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9caec2fb19b8) 00000020:00000080:2.0:1787560944.665422:0:24243:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787560944.750475:0:24243:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787560944.751263:0:24243:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787560944.752540:0:24243:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1787560944.753021:0:24243:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787560944.753702:0:24243:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1787560944.754331:0:24243:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787560944.754579:0:24243:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1787560944.760275:0:24243:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787560944.760847:0:24243:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787560944.760861:0:24243:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787560944.760875:0:24243:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4642c20bf2f35887 00000020:01000004:3.0:1787560944.760882:0:24243:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787560944.760904:0:24243:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.129@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787560944.760907:0:24243:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787560944.760924:0:24243:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787560944.760929:0:24243:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787560944.760940:0:24243:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9caff3248000) 00000020:00000080:3.0:1787560944.760953:0:24243:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1787560944.764116:0:24243:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787560944.764343:0:24243:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787560944.764350:0:24243:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787560944.768217:0:24243:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787560944.768228:0:24243:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787560944.768728:0:24243:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787560944.768735:0:24243:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787560944.771276:0:24243:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787560944.771692:0:24243:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787560944.771699:0:24243:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787560944.774117:0:24243:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787560944.774129:0:24243:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787560944.797381:0:24243:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787560944.798575:0:24243:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787560944.798583:0:24243:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787560944.800405:0:24243:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787560944.800575:0:24243:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787560944.801853:0:24243:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787560944.801865:0:24243:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787560944.811822:0:24243:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787560944.812026:0:24243:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787560944.812033:0:24243:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787560944.813928:0:24243:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787560944.813940:0:24243:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787560944.869532:0:24243:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787560944.870011:0:24243:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787560944.870018:0:24243:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787560944.875138:0:24243:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787560944.875159:0:24243:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787560944.876850:0:24243:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787560944.876884:0:24243:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1787560944.876890:0:24243:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.129@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787560944.897982:0:24243:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787560944.898025:0:24243:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.129@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787560944.898030:0:24243:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787560944.898031:0:24243:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787560944.898033:0:24243:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787560944.898034:0:24243:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787560944.898035:0:24243:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787560944.898036:0:24243:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787560944.898037:0:24243:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787560944.898039:0:24243:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787560944.898040:0:24243:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787560944.898043:0:24243:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787560944.898045:0:24243:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787560944.898051:0:24243:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787560944.898052:0:24243:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787560944.898053:0:24243:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787560944.898054:0:24243:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787560944.898055:0:24243:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787560944.898056:0:24243:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787560944.898057:0:24243:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787560944.898058:0:24243:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787560944.898082:0:24243:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787560944.898102:0:24243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862937728:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787560944.898171:0:24243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560944.898231:0:24243:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe0bae6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560944.900804:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862937728 00000100:00100000:2.0:1787560944.900820:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862937728 00000100:00100000:2.0:1787560944.900889:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787560944.900898:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4715450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+18:24243:x1874392862937728:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787560944.900932:0:22735:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787560944.900935:0:22735:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787560944.900939:0:22735:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787560944.902007:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4715450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+18:24243:x1874392862937728:12345-0@lo:253:mount.lustre.0 Request processed in 1106us (3831us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560944.902018:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787560944.903459:0:24243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862937728:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787560944.903477:0:24243:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787560944.903480:0:24243:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787560944.903482:0:24243:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787560944.903483:0:24243:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787560944.903484:0:24243:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787560944.903486:0:24243:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787560944.903487:0:24243:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787560944.903488:0:24243:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787560944.903490:0:24243:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787560944.903491:0:24243:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787560944.903519:0:24243:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9caffbb0c800 from lustre-OST0000 10000000:01000000:1.0:1787560944.903551:0:24243:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787560944.903554:0:24243:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787560944.903562:0:24243:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9caff324cd28 local copy 00010000:00010000:1.0:1787560944.903574:0:24243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f35642 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35649 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560944.903697:0:24243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862937856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560944.903760:0:24243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560944.903865:0:24243:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe0baed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787560944.912861:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862937856 00000100:00100000:0.0:1787560944.912894:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862937856 00000100:00100000:0.0:1787560944.913155:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787560944.913168:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4717450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+18:24243:x1874392862937856:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787560944.913367:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4717450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+18:24243:x1874392862937856:12345-0@lo:501:mount.lustre.0 Request processed in 202us (9606us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787560944.913376:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787560944.913473:0:24243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862937856:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787560944.913514:0:24243:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787560944.913541:0:24243:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787560944.913549:0:24243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f35642 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35649 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560944.913560:0:24243:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f35642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35649 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560944.913588:0:24243:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9caffbb0c800 10000000:01000000:1.0:1787560944.913593:0:24243:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787560944.913598:0:24243:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787560944.913601:0:24243:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787560944.913605:0:24243:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787560944.913608:0:24243:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787560944.913801:0:24243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3881600/0x4642c20bf2f35895 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560944.913811:0:24243:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caec3881600/0x4642c20bf2f35895 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560944.913821:0:24243:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caec3881600/0x4642c20bf2f35895 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560944.913841:0:24243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862937984:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787560944.913877:0:24243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560944.913913:0:24243:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe0baed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787560944.914069:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862937984 00000100:00100000:2.0:1787560944.914075:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862937984 00000100:00100000:2.0:1787560944.914114:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787560944.914122:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4714850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+18:24243:x1874392862937984:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787560944.914132:0:22735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560944.914147:0:22735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca48400/0x4642c20bf2f3589c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f35895 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560944.914170:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca48400/0x4642c20bf2f3589c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f35895 expref: 19 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560944.914195:0:22735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca48400/0x4642c20bf2f3589c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35895 expref: 19 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560944.914203:0:22735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca48400, rc 0) 00000100:00100000:2.0:1787560944.914274:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4714850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+19:24243:x1874392862937984:12345-0@lo:101:mount.lustre.0 Request processed in 152us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560944.914280:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787560944.914373:0:24243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862937984:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787560944.914386:0:24243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caec3881600/0x4642c20bf2f35895 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3589c expref: -99 pid: 24243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560944.914400:0:24243:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caec3881600/0x4642c20bf2f35895 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f3589c expref: -99 pid: 24243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787560944.915566:0:24243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1787560944.916589:0:24243:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787560944.920740:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1787560944.920807:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1787560944.920825:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1787560944.920837:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1787560944.920849:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1787560944.920861:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1787560944.920874:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1787560944.920888:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1787560944.920899:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1787560944.920911:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1787560944.920923:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1787560944.920934:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1787560944.920971:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1787560944.920978:0:24243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1787560944.921088:0:24243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862938112:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560944.921153:0:24243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560944.921198:0:24243:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 11 seconds 00000100:00100000:0.0:1787560944.921740:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862938112 00000100:00100000:0.0:1787560944.921748:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862938112 00000100:00100000:0.0:1787560944.921810:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787560944.921819:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4716450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+19:24243:x1874392862938112:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787560944.921977:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4716450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+19:24243:x1874392862938112:12345-0@lo:501:mount.lustre.0 Request processed in 159us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560944.921985:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787560944.922505:0:24243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862938112:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560944.922760:0:24243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862938240:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787560944.922832:0:24243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560944.922880:0:24243:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 11 seconds 00000100:00100000:3.0:1787560944.923071:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862938240 00000100:00100000:3.0:1787560944.923077:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862938240 00000100:00100000:3.0:1787560944.923121:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787560944.923130:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4714050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+19:24243:x1874392862938240:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787560944.924144:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4714050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+19:24243:x1874392862938240:12345-0@lo:503:mount.lustre.0 Request processed in 1011us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560944.924155:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787560944.924297:0:24243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862938240:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787560944.925371:0:24243:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787560944.925484:0:24243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862938368:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560944.925620:0:24243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560944.925729:0:24243:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 11 seconds 00000100:00100000:0.0:1787560944.925948:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862938368 00000100:00100000:0.0:1787560944.925956:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862938368 00000100:00100000:0.0:1787560944.926064:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787560944.926074:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+19:24243:x1874392862938368:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787560944.926640:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+19:24243:x1874392862938368:12345-0@lo:502:mount.lustre.0 Request processed in 565us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560944.926649:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787560944.926750:0:24243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862938368:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787560944.926990:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1787560944.927020:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1787560944.927033:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1787560944.927046:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1787560944.927060:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1787560944.927073:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1787560944.927085:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1787560944.927097:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1787560944.927109:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1787560944.927122:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1787560944.927135:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1787560944.927150:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1787560944.927179:0:24243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862938496:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560944.927235:0:24243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560944.927269:0:24243:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2900 going to sleep for 11 seconds 00000100:00100000:3.0:1787560944.927393:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862938496 00000100:00100000:3.0:1787560944.927400:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862938496 00000100:00100000:3.0:1787560944.927468:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787560944.927478:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+19:24243:x1874392862938496:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787560944.927822:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+19:24243:x1874392862938496:12345-0@lo:502:mount.lustre.0 Request processed in 345us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560944.927829:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787560944.928271:0:24243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862938496:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787560944.928351:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1787560944.928362:0:24243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1787560944.929657:0:24260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787560944.929668:0:24260:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1787560944.929675:0:24260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560944.929686:0:24260:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787560944.929692:0:24260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787560944.929706:0:24260:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9caec2fb0000) 00000020:00000080:2.0:1787560944.929743:0:24260:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787560944.929749:0:24260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787560944.929839:0:24260:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9caffbb0c800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787560944.929846:0:24260:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787560944.929854:0:24260:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4642c20bf2f358aa 00010000:00010000:3.0:1787560944.938079:0:24260:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1787560944.938698:0:24260:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:3.0:1787560944.940187:0:24260:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1787560944.949615:0:24260:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787560944.949629:0:24260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560944.949635:0:24260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560944.949643:0:24260:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787560944.949648:0:24260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787560944.949650:0:24260:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1787560944.949651:0:24260:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787560944.949653:0:24260:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787560944.949655:0:24260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787560944.949657:0:24260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560944.949659:0:24260:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787560944.949661:0:24260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560944.949664:0:24260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560944.949666:0:24260:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787560944.949669:0:24260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787560944.949671:0:24260:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787560944.949673:0:24260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560944.949676:0:24260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560944.949677:0:24260:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787560944.949679:0:24260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560944.949684:0:24260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560944.949685:0:24260:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787560944.949688:0:24260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787560944.949720:0:24260:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560944.949723:0:24260:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560944.949724:0:24260:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787560944.949727:0:24260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1787560944.950557:0:24243:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1787560944.950592:0:24243:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787560944.950612:0:24243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3881600/0x4642c20bf2f35895 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3589c expref: -99 pid: 24243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560944.950624:0:24243:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caec3881600/0x4642c20bf2f35895 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f3589c expref: -99 pid: 24243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560944.950649:0:24243:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9caffbb0c800 from 1 10000000:01000000:0.0:1787560944.950652:0:24243:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787560944.950689:0:24243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbfee00/0x4642c20bf2f358b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560944.950697:0:24243:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffcbfee00/0x4642c20bf2f358b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560944.950708:0:24243:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffcbfee00/0x4642c20bf2f358b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560944.950731:0:24243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862938624:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787560944.950807:0:24243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560944.950862:0:24243:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc2f41000 going to sleep for 11 seconds 00000100:00100000:3.0:1787560944.951243:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862938624 00000100:00100000:3.0:1787560944.951251:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862938624 00000100:00100000:3.0:1787560944.951297:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787560944.951307:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+19:24243:x1874392862938624:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787560944.951321:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560944.951334:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafda2f7e00/0x4642c20bf2f358b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f358b1 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560944.951357:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafda2f7e00/0x4642c20bf2f358b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f358b1 expref: 20 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560944.951377:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafda2f7e00/0x4642c20bf2f358b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f358b1 expref: 20 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560944.951385:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f7e00, rc 0) 00000100:00100000:3.0:1787560944.951455:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+20:24243:x1874392862938624:12345-0@lo:101:mount.lustre.0 Request processed in 148us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560944.951463:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787560944.951555:0:24243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862938624:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787560944.951571:0:24243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffcbfee00/0x4642c20bf2f358b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f358b8 expref: -99 pid: 24243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560944.951580:0:24243:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffcbfee00/0x4642c20bf2f358b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f358b8 expref: -99 pid: 24243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787560944.956935:0:24243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1787560944.957244:0:24243:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787560944.957679:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1787560944.957706:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1787560944.957733:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1787560944.957748:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1787560944.957760:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1787560944.957771:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1787560944.957794:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1787560944.957810:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1787560944.957822:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1787560944.957833:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1787560944.957846:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1787560944.957865:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1787560944.957870:0:24243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1787560944.957955:0:24243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862938752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787560944.958021:0:24243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560944.958158:0:24243:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc2f41f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787560944.969446:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862938752 00000100:00100000:3.0:1787560944.969459:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862938752 00000100:00100000:3.0:1787560944.969505:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787560944.969514:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+20:24243:x1874392862938752:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560944.969662:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+20:24243:x1874392862938752:12345-0@lo:501:mount.lustre.0 Request processed in 149us (11641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560944.969670:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787560944.974387:0:24243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862938752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787560944.977476:0:24243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862938880:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787560944.977556:0:24243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560944.977595:0:24243:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc2f41f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787560944.977625:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862938880 00000100:00100000:0.0:1787560944.977632:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862938880 00000100:00100000:0.0:1787560944.977675:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787560944.977683:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+20:24243:x1874392862938880:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787560944.977798:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+20:24243:x1874392862938880:12345-0@lo:503:mount.lustre.0 Request processed in 102us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560944.977806:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787560944.977855:0:24243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862938880:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787560944.979452:0:24243:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787560944.979562:0:24243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862939008:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787560944.979634:0:24243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560944.979665:0:24243:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc2f41f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787560944.979696:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862939008 00000100:00100000:0.0:1787560944.979702:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862939008 00000100:00100000:0.0:1787560944.979743:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787560944.979751:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+20:24243:x1874392862939008:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787560944.979861:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+20:24243:x1874392862939008:12345-0@lo:502:mount.lustre.0 Request processed in 110us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560944.979869:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787560944.979932:0:24243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862939008:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787560944.980584:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1787560944.980615:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1787560944.980628:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1787560944.980641:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1787560944.980652:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1787560944.980666:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1787560944.980679:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1787560944.980692:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1787560944.980704:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1787560944.980716:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1787560944.980730:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1787560944.980760:0:24243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862939136:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787560944.980820:0:24243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560944.981858:0:24243:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc2f41f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787560944.982472:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862939136 00000100:00100000:1.0:1787560944.982481:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862939136 00000100:00100000:0.0:1787560944.982579:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787560944.982590:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+20:24243:x1874392862939136:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787560944.982737:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+20:24243:x1874392862939136:12345-0@lo:502:mount.lustre.0 Request processed in 148us (1915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560944.982745:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787560944.982926:0:24243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862939136:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787560944.983003:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1787560944.983016:0:24243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787560944.984251:0:24264:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560944.984264:0:24264:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560944.984266:0:24264:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787560944.984273:0:24264:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9caffbb0c800 00000020:00000080:3.0:1787560944.984276:0:24264:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787560944.984285:0:24264:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560944.984287:0:24264:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560944.984289:0:24264:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787560944.984292:0:24264:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560944.984295:0:24264:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560944.984296:0:24264:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787560944.984299:0:24264:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9caffbb0c800 00000020:00000080:3.0:1787560944.984301:0:24264:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787560944.984367:0:24264:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560944.984378:0:24264:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560944.984379:0:24264:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787560944.984383:0:24264:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560944.984386:0:24264:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560944.984388:0:24264:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787560944.984391:0:24264:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9caffbb0c800 00000020:00000080:3.0:1787560944.984394:0:24264:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787560944.984415:0:24264:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560944.984418:0:24264:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560944.984420:0:24264:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787560944.984423:0:24264:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560944.984425:0:24264:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560944.984426:0:24264:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787560944.984502:0:24264:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9caffbb0c800 00000020:00000080:3.0:1787560944.984505:0:24264:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787560944.984534:0:24264:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560944.984538:0:24264:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560944.984539:0:24264:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787560944.984542:0:24264:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1787560944.984738:0:24243:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787560944.984765:0:24243:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787560944.984798:0:24243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbfee00/0x4642c20bf2f358b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f358b8 expref: -99 pid: 24243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560944.984811:0:24243:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffcbfee00/0x4642c20bf2f358b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f358b8 expref: -99 pid: 24243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560944.984880:0:24243:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787560944.984887:0:24243:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9caffbb0c800 10000000:01000000:0.0:1787560944.984891:0:24243:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9caffbb0c800 10000000:01000000:0.0:1787560944.984895:0:24243:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787560944.984901:0:24243:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9caffbb0c800 from 1 10000000:01000000:0.0:1787560944.984903:0:24243:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787560944.984944:0:24243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe200/0x4642c20bf2f358bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560944.984953:0:24243:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe200/0x4642c20bf2f358bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560944.984965:0:24243:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe200/0x4642c20bf2f358bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560944.984989:0:24243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862939264:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787560944.985166:0:24243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560944.985216:0:24243:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc2f41c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787560944.986262:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862939264 00000100:00100000:1.0:1787560944.986273:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862939264 00000100:00100000:1.0:1787560944.986332:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787560944.986342:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+20:24243:x1874392862939264:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787560944.986356:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560944.986372:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caec3881800/0x4642c20bf2f358c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f358bf expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560944.986399:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec3881800/0x4642c20bf2f358c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f358bf expref: 21 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560944.986411:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caec3881800/0x4642c20bf2f358c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f358bf expref: 21 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560944.986421:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3881800, rc 0) 00000100:00100000:1.0:1787560944.986499:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+21:24243:x1874392862939264:12345-0@lo:101:mount.lustre.0 Request processed in 159us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560944.986506:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787560944.986695:0:24243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862939264:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787560944.986713:0:24243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe200/0x4642c20bf2f358bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f358c6 expref: -99 pid: 24243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560944.986722:0:24243:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe200/0x4642c20bf2f358bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f358c6 expref: -99 pid: 24243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787560944.994215:0:24243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1787560944.994536:0:24243:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787560944.994709:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1787560944.994750:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1787560944.994764:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1787560944.994778:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1787560944.994804:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1787560944.994818:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1787560944.994829:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1787560944.994841:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1787560944.994870:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1787560944.994885:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1787560944.994896:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1787560944.994908:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1787560944.994920:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1787560944.994932:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1787560944.994945:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1787560944.994959:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1787560944.994974:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1787560944.994990:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1787560944.995012:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1787560944.995030:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1787560944.995044:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1787560944.995057:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1787560944.995069:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1787560944.995082:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1787560944.995107:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1787560944.995122:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1787560944.995133:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1787560944.995146:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1787560944.995163:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1787560944.995178:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1787560944.995195:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1787560944.995227:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1787560944.995249:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1787560944.995269:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1787560944.995286:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1787560944.995305:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1787560944.995323:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1787560944.995341:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1787560944.995358:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1787560944.995378:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1787560944.995412:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1787560944.995454:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1787560944.995471:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1787560944.995482:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1787560944.995494:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1787560944.995506:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1787560944.995524:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1787560944.995543:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1787560944.995688:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1787560944.995713:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1787560944.995737:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1787560944.995744:0:24243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1787560944.995846:0:24243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862939392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560944.995907:0:24243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560944.995958:0:24243:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe0bae6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560944.995976:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862939392 00000100:00100000:3.0:1787560944.995987:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862939392 00000100:00100000:3.0:1787560944.996047:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787560944.996056:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+21:24243:x1874392862939392:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560944.996168:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+21:24243:x1874392862939392:12345-0@lo:501:mount.lustre.0 Request processed in 113us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560944.996176:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787560944.997939:0:24243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862939392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560944.998026:0:24243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862939520:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787560944.998107:0:24243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560944.998145:0:24243:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe0bae6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560944.998263:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862939520 00000100:00100000:0.0:1787560944.998270:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862939520 00000100:00100000:0.0:1787560944.998322:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787560944.998331:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+21:24243:x1874392862939520:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787560944.998459:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+21:24243:x1874392862939520:12345-0@lo:503:mount.lustre.0 Request processed in 128us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560944.998473:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787560945.001206:0:24243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862939520:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787560945.001922:0:24243:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787560945.002021:0:24243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862939648:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787560945.002103:0:24243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560945.002144:0:24243:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe0bae6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560945.002173:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862939648 00000100:00100000:1.0:1787560945.002178:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862939648 00000100:00100000:1.0:1787560945.002238:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787560945.002248:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+21:24243:x1874392862939648:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787560945.002359:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+21:24243:x1874392862939648:12345-0@lo:502:mount.lustre.0 Request processed in 111us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560945.002368:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787560945.003709:0:24243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862939648:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787560945.006002:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1787560945.006042:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1787560945.006060:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1787560945.006073:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1787560945.006085:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1787560945.006097:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1787560945.006110:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1787560945.006123:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1787560945.006138:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1787560945.006155:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1787560945.006171:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1787560945.006188:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1787560945.006204:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1787560945.006219:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1787560945.006237:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1787560945.006253:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1787560945.006292:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1787560945.006311:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1787560945.006328:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1787560945.006344:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1787560945.006357:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1787560945.006372:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1787560945.006388:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1787560945.006404:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1787560945.006419:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1787560945.006462:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1787560945.006478:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1787560945.006490:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1787560945.006502:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1787560945.006515:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1787560945.006527:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1787560945.006539:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1787560945.006567:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1787560945.006582:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1787560945.006596:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1787560945.006609:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1787560945.006620:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1787560945.006631:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1787560945.006644:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1787560945.006656:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1787560945.006669:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1787560945.006680:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1787560945.006691:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1787560945.006703:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1787560945.006717:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1787560945.006731:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1787560945.006745:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1787560945.006762:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1787560945.006843:0:24243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862939776:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787560945.006931:0:24243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560945.006988:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862939776 00000100:00100000:1.0:1787560945.006995:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862939776 00000100:00100000:1.0:1787560945.007043:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787560945.007052:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+21:24243:x1874392862939776:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787560945.007169:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+21:24243:x1874392862939776:12345-0@lo:502:mount.lustre.0 Request processed in 117us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560945.007177:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787560945.007236:0:24243:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafe0bae6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560945.007260:0:24243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862939776:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787560945.007473:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1787560945.007500:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1787560945.007526:0:24243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862939904:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787560945.007563:0:24243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560945.007587:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862939904 00000100:00100000:1.0:1787560945.007591:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862939904 00000100:00100000:1.0:1787560945.007614:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787560945.007621:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+21:24243:x1874392862939904:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787560945.007683:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+21:24243:x1874392862939904:12345-0@lo:502:mount.lustre.0 Request processed in 62us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560945.007689:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787560945.007722:0:24243:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd87003c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560945.007735:0:24243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862939904:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787560945.007770:0:24243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1787560945.007776:0:24243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787560945.011277:0:24269:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787560945.011308:0:24269:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9caec23199b8) 00000020:00000080:3.0:1787560945.011333:0:24269:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1787560945.011424:0:24269:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9caffbb0c800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787560945.011446:0:24269:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9caffbb0c800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787560945.011455:0:24269:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9caffbb0c800 3 00010000:00080000:3.0:1787560945.011496:0:24269:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cafd8c2f000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.129@tcp at head 00010000:00010000:3.0:1787560945.017299:0:24269:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1787560945.020016:0:24269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787560945.020065:0:24269:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787560945.020080:0:24269:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4642c20bf2f358d4 00000100:00080000:3.0:1787560945.020091:0:24269:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787560945.020097:0:24269:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9cafd8c2f000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560945.020133:0:24269:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caec407d180 x1874392862940032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787560945.020181:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1874392862940032:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787560945.020265:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560945.020330:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862940032 00000100:00100000:3.0:1787560945.020337:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862940032 00000100:00100000:3.0:1787560945.020369:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787560945.020377:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1874392862940032:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787560945.020402:0:22741:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 664 last 0 00000020:00000080:3.0:1787560945.020466:0:22741:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4642c20bf2f358db 00000004:00100000:3.0:1787560945.020485:0:22741:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787560945.020518:0:22741:0:(import.c:65:import_set_state_nolock()) ffff9cafc3dc1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787560945.020568:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1874392862940032:12345-0@lo:38:llog_process_th.0 Request processed in 190us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560945.020577:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787560945.020616:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9caec407d180 x1874392862940032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787560955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560945.020625:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787560945.020632:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1787560945.020646:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787560945.020649:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787560945.020652:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafd8c2f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787560945.020658:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1874392862940032:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787560945.020677:0:24269:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:01000004:3.0:1787560945.021613:0:24269:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787560945.021629:0:24269:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9caec231b370) 00000020:00000080:3.0:1787560945.021652:0:24269:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1787560945.021754:0:24269:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9caffbb0c800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787560945.021758:0:24269:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9caffbb0c800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787560945.021761:0:24269:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9caffbb0c800 3 00010000:00080000:3.0:1787560945.021798:0:24269:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cafd8c2d800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.129@tcp at head 00000100:00080000:0.0:1787560945.023805:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787560945.023812:0:15403:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787560945.023815:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787560945.023818:0:15403:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787560945.023853:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787560945.023857:0:15403:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787560945.023860:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787560945.023863:0:15403:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787560945.023996:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862940160:0@lo:400:kworker.0 00000100:00100000:3.0:1787560945.024154:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862940544:0@lo:400:kworker.0 00000100:00100000:3.0:1787560945.024216:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560945.024251:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787560945.024257:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862940416:0@lo:400:kworker.0 00000100:00100000:3.0:1787560945.024282:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560945.024323:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862940544 00000100:00100000:3.0:1787560945.024329:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862940544 00000100:00100000:3.0:1787560945.024372:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787560945.024380:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862940544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560945.026248:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560945.026301:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560945.026311:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862940288:0@lo:400:kworker.0 00000100:00100000:0.0:1787560945.026345:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560945.026681:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862940544:12345-0@lo:400:kworker.0 Request processed in 50us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560945.026693:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787560945.026722:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862940288 00000100:00100000:3.0:1787560945.026729:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862940288 00000100:00100000:3.0:1787560945.026759:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787560945.026796:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862940288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560945.026857:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862940288:12345-0@lo:400:kworker.0 Request processed in 74us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560945.026863:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1787560945.026912:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9caffbaf7b80 x1874392862940544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560945.026926:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862940544:0@lo:400:kworker.0 00000100:00100000:1.0:1787560945.028283:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862940416 00000100:00100000:1.0:1787560945.028300:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862940416 00000100:00100000:1.0:1787560945.028350:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862940160 00000100:00100000:1.0:1787560945.028354:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862940160 00000100:00100000:1.0:1787560945.028373:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787560945.028382:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862940416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560945.028481:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862940416:12345-0@lo:400:kworker.0 Request processed in 101us (4198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560945.028489:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787560945.028506:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787560945.028512:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862940160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560945.028546:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862940160:12345-0@lo:400:kworker.0 Request processed in 34us (2305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560945.028552:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787560945.028611:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862940416:0@lo:400:kworker.0 00010000:00080000:0.0:1787560945.030459:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9caffbaf5c00 x1874392862940288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560945.030477:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862940288:0@lo:400:kworker.0 00000100:00100000:0.0:1787560945.030493:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862940160:0@lo:400:kworker.0 00010000:00010000:3.0:1787560945.030871:0:24269:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1787560945.031155:0:24269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1787560945.031209:0:24269:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787560945.031227:0:24269:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x4642c20bf2f358e9 00000100:00080000:3.0:1787560945.031236:0:24269:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787560945.031242:0:24269:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9cafd8c2d800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560945.031275:0:24269:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caec407df80 x1874392862940672/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787560945.031313:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1874392862940672:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787560945.031387:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560945.031497:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862940672 00000100:00100000:3.0:1787560945.031504:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862940672 00000100:00100000:3.0:1787560945.031542:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787560945.031552:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1874392862940672:12345-0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787560945.032314:0:24269:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00010000:00080000:3.0:1787560945.032514:0:22740:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 664 last 0 00000100:00080000:0.0:1787560945.032686:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787560945.032690:0:15403:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787560945.032693:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787560945.032702:0:15403:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787560945.032706:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787560945.032709:0:15403:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787560945.032711:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787560945.032714:0:15403:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:3.0:1787560945.032844:0:22740:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x4642c20bf2f358f0 00000004:00100000:3.0:1787560945.032866:0:22740:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787560945.032905:0:22740:0:(import.c:65:import_set_state_nolock()) ffff9cafc3239800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787560945.032996:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1874392862940672:12345-0@lo:38:llog_process_th.0 Request processed in 1443us (1607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560945.033007:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787560945.033165:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9caec407df80 x1874392862940672/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787560955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560945.033177:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787560945.033186:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1787560945.033195:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787560945.033200:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787560945.033202:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafd8c2d800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787560945.033210:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1874392862940672:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1787560945.034120:0:24269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1787560945.034298:0:24243:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787560945.034332:0:24243:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787560945.034377:0:24243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe200/0x4642c20bf2f358bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f358c6 expref: -99 pid: 24243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560945.034388:0:24243:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe200/0x4642c20bf2f358bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f358c6 expref: -99 pid: 24243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787560945.034465:0:24243:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787560945.034468:0:24243:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787560945.034469:0:24243:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787560945.034471:0:24243:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787560945.034472:0:24243:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787560945.034474:0:24243:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787560945.034476:0:24243:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787560945.034478:0:24243:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787560945.034480:0:24243:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787560945.034484:0:24243:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787560945.034487:0:24243:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787560945.034489:0:24243:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787560945.034490:0:24243:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787560945.034491:0:24243:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787560945.034493:0:24243:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787560945.034494:0:24243:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787560945.034495:0:24243:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787560945.034496:0:24243:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787560945.034497:0:24243:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787560945.034529:0:24243:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787560945.034547:0:24243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862940800:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787560945.034624:0:24243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560945.034666:0:24243:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc2f41d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787560945.034895:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862940800 00000100:00100000:1.0:1787560945.034904:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862940800 00000100:00100000:1.0:1787560945.034970:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787560945.034982:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+21:24243:x1874392862940800:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787560945.035015:0:22733:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787560945.035031:0:22733:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787560945.051465:0:22733:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787560945.051481:0:22733:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787560945.051600:0:22756:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787560945.051605:0:22756:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787560945.051627:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f358f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560945.051644:0:22756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cafda2f6e00/0x4642c20bf2f35841 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f3583a expref: 21 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560945.051653:0:22756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caec3880a00/0x4642c20bf2f3584f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35848 expref: 21 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560945.051661:0:22756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f358f7 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560945.051702:0:22756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caec3880a00/0x4642c20bf2f3584f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f35848 expref: 21 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560945.051724:0:22756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9caec3880a00/0x4642c20bf2f3584f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f35848 expref: 21 pid: 22734 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560945.051737:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22756:1874392862940928:0@lo:104: 00000100:00100000:3.0:1787560945.051809:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787560945.051863:0:22756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cafda2f6e00/0x4642c20bf2f35841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f3583a expref: 21 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560945.051871:0:22756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cafda2f6e00/0x4642c20bf2f35841 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f3583a expref: 21 pid: 22734 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560945.051895:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22756:1874392862941056:0@lo:104: 00000100:00100000:3.0:1787560945.051924:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560945.051946:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd1770600 going to sleep for 11 seconds 00000100:00100000:2.0:1787560945.052073:0:22724:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787560945.052091:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862940928 00000100:00100000:2.0:1787560945.052103:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862940928 00000100:00100000:2.0:1787560945.052138:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862941056 00000100:00100000:2.0:1787560945.052141:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862941056 00000100:00100000:2.0:1787560945.052156:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787560945.052165:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c33dd467-64b2-4362-8604-d1a6489592bb+4:22756:x1874392862940928:12345-0@lo:104: 00010000:00010000:2.0:1787560945.052177:0:22724:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f35848 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f3584f expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560945.052240:0:22724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787560945.052247:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c33dd467-64b2-4362-8604-d1a6489592bb+4:22756:x1874392862940928:12345-0@lo:104: Request processed in 84us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560945.052255:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787560945.052272:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787560945.052279:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc421fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c33dd467-64b2-4362-8604-d1a6489592bb+3:22756:x1874392862941056:12345-0@lo:104: 00010000:00010000:2.0:1787560945.052287:0:22724:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9caec3881000/0x4642c20bf2f3583a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f35841 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560945.052321:0:22724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787560945.052326:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc421fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c33dd467-64b2-4362-8604-d1a6489592bb+3:22756:x1874392862941056:12345-0@lo:104: Request processed in 49us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560945.052332:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787560945.052369:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787560945.052375:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f35848 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f3584f expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560945.052382:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7200 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:2.0:1787560945.052386:0:22729:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f35848 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f3584f expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560945.052406:0:22729:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f35848 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f3584f expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560945.052413:0:22729:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f35848 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f3584f expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560945.052418:0:22729:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787560945.052472:0:22729:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f35848 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f3584f expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560945.052478:0:22729:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560945.052496:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f35848 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f3584f expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560945.052502:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafda2f7200/0x4642c20bf2f35848 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f3584f expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560945.052514:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560945.052516:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caec3881000/0x4642c20bf2f3583a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f35841 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560945.052522:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881000 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:2.0:1787560945.052524:0:22729:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caec3881000/0x4642c20bf2f3583a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f35841 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560945.052531:0:22729:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caec3881000/0x4642c20bf2f3583a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f35841 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560945.052536:0:22729:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caec3881000/0x4642c20bf2f3583a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f35841 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560945.052547:0:22729:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787560945.052561:0:22729:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caec3881000/0x4642c20bf2f3583a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35841 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560945.052567:0:22729:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560945.052837:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caec3881000/0x4642c20bf2f3583a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35841 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560945.052844:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caec3881000/0x4642c20bf2f3583a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35841 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560945.052861:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560945.052863:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560945.052864:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560945.052872:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560945.052892:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c33dd467-64b2-4362-8604-d1a6489592bb:3625:1874392862941184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787560945.052924:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560945.052957:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560945.052963:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c33dd467-64b2-4362-8604-d1a6489592bb:3625:1874392862941312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787560945.052985:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560945.053019:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862941184 00000100:00100000:2.0:1787560945.053023:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862941184 00010000:00010000:2.0:1787560945.053700:0:22725:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caec3880a00/0x4642c20bf2f3584f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f35848 expref: 22 pid: 22734 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560945.053738:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862941312 00000100:00100000:2.0:1787560945.053743:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862941312 00010000:00010000:2.0:1787560945.053756:0:22725:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cafda2f6e00/0x4642c20bf2f35841 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f3583a expref: 23 pid: 22734 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560945.053781:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787560945.053800:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c33dd467-64b2-4362-8604-d1a6489592bb+23:3625:x1874392862941184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787560945.053814:0:22725:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560945.053820:0:22725:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caec3880a00/0x4642c20bf2f3584f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f35848 expref: 23 pid: 22734 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560945.053831:0:22725:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caec3880a00/0x4642c20bf2f3584f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f35848 expref: 23 pid: 22734 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560945.053847:0:22725:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560945.053884:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c33dd467-64b2-4362-8604-d1a6489592bb+23:3625:x1874392862941184:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560945.053891:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787560945.053906:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787560945.053912:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdf2c2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c33dd467-64b2-4362-8604-d1a6489592bb+22:3625:x1874392862941312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787560945.053919:0:22725:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560945.053923:0:22725:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cafda2f6e00/0x4642c20bf2f35841 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f3583a expref: 22 pid: 22734 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560945.053931:0:22725:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cafda2f6e00/0x4642c20bf2f35841 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f3583a expref: 22 pid: 22734 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560945.053943:0:22725:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f358f7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560945.053951:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f358f7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787560945.053975:0:22725:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005333257s 00010000:00010000:2.0:1787560945.053979:0:22725:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f358f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560945.053987:0:22725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f358f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560945.053993:0:22725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f358f7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560945.053999:0:22725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f358f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560945.054005:0:22725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6800 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:2.0:1787560945.054009:0:22725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f358f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560945.054016:0:22725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f358f7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560945.054025:0:22725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f358f7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560945.054161:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caec3880a00/0x4642c20bf2f3584f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f35848 expref: 22 pid: 22734 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560945.054173:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22756:1874392862940928:0@lo:104: 00010000:00010000:3.0:1787560945.054184:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafda2f6e00/0x4642c20bf2f35841 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f3583a expref: 21 pid: 22734 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560945.054191:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22756:1874392862941056:0@lo:104: 00010000:00010000:3.0:1787560945.054211:0:22756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f358f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560945.054220:0:22756:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f358f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560945.054227:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f358f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560945.054233:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f358f7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560945.054551:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+20:24243:x1874392862940800:12345-0@lo:253:mount.lustre.0 Request processed in 19570us (19925us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560945.054560:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:2.0:1787560945.054810:0:22725:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560945.054841:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdf2c2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c33dd467-64b2-4362-8604-d1a6489592bb+19:3625:x1874392862941312:12345-0@lo:103:ldlm_bl.0 Request processed in 927us (1852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560945.054848:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787560945.054902:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c33dd467-64b2-4362-8604-d1a6489592bb:3625:1874392862941312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787560945.054911:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c33dd467-64b2-4362-8604-d1a6489592bb:3625:1874392862941184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560945.055150:0:24243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:24243:1874392862940800:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787560945.055161:0:24243:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787560945.055164:0:24243:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787560945.055166:0:24243:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787560945.055167:0:24243:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787560945.055169:0:24243:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787560945.055170:0:24243:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787560945.055171:0:24243:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787560945.055173:0:24243:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787560945.055175:0:24243:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787560945.055176:0:24243:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787560945.055185:0:24243:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:1.0:1787560945.061221:0:24243:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1787560945.066767:0:24243:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787560945.066780:0:24243:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787560945.066840:0:24243:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787560945.066883:0:24243:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.129@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787560945.066901:0:24243:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787560945.066929:0:24243:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1787560945.068466:0:24243:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787560945.070325:0:24243:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787560945.100694:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787560945.979174:0:24324:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787560945.979382:0:24324:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1787560946.109282:0:22737:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787560946.109289:0:22737:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cafffe2b000 from 13 10000000:01000000:1.0:1787560946.109294:0:22737:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787560946.109340:0:22737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3880c00/0x4642c20bf2f358fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560946.110230:0:22737:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caec3880c00/0x4642c20bf2f358fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560946.110245:0:22737:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caec3880c00/0x4642c20bf2f358fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560946.110272:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862941440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787560946.110346:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560946.110394:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc5812cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560946.115958:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862941440 00000100:00100000:2.0:1787560946.115974:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862941440 00000100:00100000:2.0:1787560946.116085:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787560946.116096:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+19:22737:x1874392862941440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560946.116113:0:22735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560946.116143:0:22735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f35905 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f358fe expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560946.116170:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f35905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f358fe expref: 20 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560946.116180:0:22735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f35905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f358fe expref: 20 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560946.116189:0:22735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca49c00, rc 0) 00000100:00100000:2.0:1787560946.116267:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+20:22737:x1874392862941440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (5920us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560946.116274:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787560946.116629:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862941440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787560946.116649:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caec3880c00/0x4642c20bf2f358fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35905 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560946.116660:0:22737:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caec3880c00/0x4642c20bf2f358fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35905 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560946.116746:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862941568:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787560946.116798:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560946.117355:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd17700c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560946.117488:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862941568 00000100:00100000:1.0:1787560946.117496:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862941568 00000100:00100000:1.0:1787560946.117532:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787560946.117540:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4221c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+20:22737:x1874392862941568:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787560946.117559:0:22734:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787560946.117585:0:22734:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787560946.117588:0:22734:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1787560946.117677:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4221c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+20:22737:x1874392862941568:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 138us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560946.117685:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787560946.121898:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862941568:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787560946.121983:0:22737:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787560946.121994:0:22737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3880c00/0x4642c20bf2f358fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35905 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560946.122005:0:22737:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caec3880c00/0x4642c20bf2f358fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35905 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560946.122015:0:22737:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787560946.122024:0:22737:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9caffcb60800 from 13 10000000:01000000:2.0:1787560946.122027:0:22737:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787560946.122073:0:22737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49a00/0x4642c20bf2f3590c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560946.122082:0:22737:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffca49a00/0x4642c20bf2f3590c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560946.122092:0:22737:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffca49a00/0x4642c20bf2f3590c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560946.122113:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862941696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787560946.122183:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560946.122226:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c86300 going to sleep for 11 seconds 00000100:00100000:2.0:1787560946.122246:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862941696 00000100:00100000:2.0:1787560946.122252:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862941696 00000100:00100000:2.0:1787560946.122292:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787560946.122301:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4223c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+20:22737:x1874392862941696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560946.122313:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560946.122325:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f35913 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f3590c expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560946.122349:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f35913 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f3590c expref: 21 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560946.122359:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f35913 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f3590c expref: 21 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560946.122368:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca49e00, rc 0) 00000100:00100000:2.0:1787560946.122403:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4223c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+21:22737:x1874392862941696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560946.122415:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787560946.122495:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862941696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560946.122507:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffca49a00/0x4642c20bf2f3590c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35913 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560946.122514:0:22737:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffca49a00/0x4642c20bf2f3590c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35913 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560946.122558:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862941824:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787560946.122802:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560946.122817:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c86300 going to sleep for 11 seconds 00000100:00100000:2.0:1787560946.122830:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862941824 00000100:00100000:2.0:1787560946.122833:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862941824 00000100:00100000:2.0:1787560946.122852:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787560946.122858:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4223050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+21:22737:x1874392862941824:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787560946.122870:0:22734:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787560946.122884:0:22734:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787560946.122887:0:22734:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1787560946.122948:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4223050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+21:22737:x1874392862941824:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 89us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560946.122955:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787560946.122983:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862941824:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787560946.123022:0:22737:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787560946.123028:0:22737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49a00/0x4642c20bf2f3590c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35913 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560946.123044:0:22737:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffca49a00/0x4642c20bf2f3590c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35913 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560946.166675:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560946.230041:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862941952:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560946.230163:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560946.230250:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862941952 00000100:00100000:3.0:1787560946.230261:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862941952 00000100:00100000:3.0:1787560946.230339:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787560946.230354:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862941952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787560946.230402:0:22745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787560946.230711:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862941952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 360us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560946.230720:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787560946.230756:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862942080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787560946.230798:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560946.230890:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862941952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787560946.231352:0:23481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862942080 00000100:00100000:1.0:1787560946.231367:0:23481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862942080 00000100:00100000:1.0:1787560946.231425:0:23481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787560946.231466:0:23481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862942080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787560946.231503:0:23481:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787560946.231597:0:23481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862942080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560946.231604:0:23481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787560946.231696:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862942080:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787560947.188860:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560948.211626:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787560948.666158:0:22774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787560949.236023:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560950.259723:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787560950.326197:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787560950.326203:0:15403:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787560950.326206:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787560950.326209:0:15403:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787560950.326233:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787560950.326236:0:15403:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787560950.326238:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787560950.326241:0:15403:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787560950.326276:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862942464:0@lo:400:kworker.0 00000100:00100000:1.0:1787560950.326339:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560950.326396:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862942976:0@lo:400:kworker.0 00000100:00100000:1.0:1787560950.326420:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560950.326468:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560950.326565:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862942336:0@lo:400:kworker.0 00000100:00100000:0.0:1787560950.326597:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560950.326623:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862942848:0@lo:400:kworker.0 00000100:00100000:0.0:1787560950.326647:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560950.326664:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787560950.326670:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c33dd467-64b2-4362-8604-d1a6489592bb:3626:1874392862942208:0@lo:400:kworker.0 00000100:00100000:0.0:1787560950.326708:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560950.326730:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862942720:0@lo:400:kworker.0 00000100:00100000:0.0:1787560950.326762:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560950.326789:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862942336 00000100:00100000:0.0:1787560950.326796:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862942336 00000100:00100000:0.0:1787560950.326835:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787560950.326844:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862942336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560950.326904:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862942336:12345-0@lo:400:kworker.0 Request processed in 60us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560950.326911:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787560950.326936:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862942464 00000100:00100000:0.0:1787560950.326940:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862942464 00000100:00100000:0.0:1787560950.326957:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862942976 00000100:00100000:0.0:1787560950.326960:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862942976 00000100:00100000:0.0:1787560950.326983:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862942848 00000100:00100000:0.0:1787560950.326986:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862942848 00000100:00100000:0.0:1787560950.327173:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862942720 00000100:00100000:0.0:1787560950.327177:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862942720 00000100:00100000:0.0:1787560950.327192:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787560950.327197:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862942464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560950.327226:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1874392862942464:12345-0@lo:400:kworker.0 Request processed in 29us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560950.327232:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787560950.327242:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787560950.327248:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862942976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560950.327272:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862942976:12345-0@lo:400:kworker.0 Request processed in 25us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560950.327277:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787560950.327288:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787560950.327293:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862942848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560950.327317:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862942848:12345-0@lo:400:kworker.0 Request processed in 24us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560950.327323:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787560950.327334:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787560950.327348:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874392862942720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560950.327379:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874392862942720:12345-0@lo:400:kworker.0 Request processed in 33us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560950.327384:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787560950.327426:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caffcb09500 x1874392862942720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560950.327466:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862942720:0@lo:400:kworker.0 00000100:00100000:0.0:1787560950.327558:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862942336:0@lo:400:kworker.0 00010000:00080000:0.0:1787560950.327568:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caffcb08700 x1874392862942848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560950.327577:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862942848:0@lo:400:kworker.0 00000100:00100000:1.0:1787560950.327783:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862942592:0@lo:400:kworker.0 00000100:00100000:1.0:1787560950.327816:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787560950.327840:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caffcb08380 x1874392862942464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560950.327849:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1874392862942464:0@lo:400:kworker.0 00010000:00080000:1.0:1787560950.327858:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caffcb0a300 x1874392862942976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560950.327865:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862942976:0@lo:400:kworker.0 00000100:00100000:0.0:1787560950.328110:0:23481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862942592 00000100:00100000:0.0:1787560950.328115:0:23481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862942592 00000100:00100000:0.0:1787560950.328149:0:23481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787560950.328157:0:23481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862942592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560950.328205:0:23481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862942592:12345-0@lo:400:kworker.0 Request processed in 49us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560950.328211:0:23481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787560950.328293:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862942592:0@lo:400:kworker.0 00000100:00100000:0.0:1787560950.328604:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862942208 00000100:00100000:0.0:1787560950.328609:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862942208 00000100:00100000:0.0:1787560950.328642:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787560950.328649:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4222050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+21:3626:x1874392862942208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560950.328704:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4222050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+21:3626:x1874392862942208:12345-0@lo:400:kworker.0 Request processed in 54us (1993us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560950.328720:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787560950.328798:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c33dd467-64b2-4362-8604-d1a6489592bb:3626:1874392862942208:0@lo:400:kworker.0 00000100:00080000:3.0:1787560950.328919:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787560950.328927:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787560951.284643:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560951.347589:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862943104:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787560951.347598:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862943232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560951.349196:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560951.351127:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560951.351212:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862943104 00000100:00100000:0.0:1787560951.351222:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862943104 00000100:00100000:0.0:1787560951.351265:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862943232 00000100:00100000:0.0:1787560951.351268:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862943232 00000100:00100000:0.0:1787560951.351284:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787560951.351294:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862943104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787560951.351335:0:22746:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787560951.351400:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862943104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (2209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560951.351407:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787560951.351425:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787560951.351459:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862943232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787560951.351487:0:22746:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787560951.351520:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862943232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560951.351525:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787560951.351574:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862943104:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787560951.351606:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862943232:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1787560951.759420:0:24613:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:1.0:1787560952.180289:0:23495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787560952.307594:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787560952.802649:0:24665:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787560952.802894:0:24665:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787560953.332705:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787560953.906525:0:24716:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787560953.906789:0:24716:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787560954.355600:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560955.251566:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560940/real 1787560940] req@ffff9caffcbbb480 x1874392862936192/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560955 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560955.251723:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9caffcbbb480 x1874392862936192/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560955 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560955.251735:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560940/real 1787560940] req@ffff9caffcbb8a80 x1874392862936320/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560955 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560955.251745:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9caffcbb8a80 x1874392862936320/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560955 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787560955.251762:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffcbc7800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787560955.251784:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787560955.251788:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862936192:0@lo:8:kworker.0 00000100:00080000:3.0:1787560955.251793:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec3383000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787560955.251798:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787560955.251801:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862936320:0@lo:8:kworker.0 00000100:00080000:1.0:1787560955.252068:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787560955.252073:0:15403:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787560955.252076:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787560955.252079:0:15403:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787560955.252096:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787560955.252099:0:15403:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787560955.252102:0:15403:0:(import.c:65:import_set_state_nolock()) ffff9caffcbc7800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787560955.252107:0:15403:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 659 00000100:00080000:1.0:1787560955.252112:0:15403:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787560955.252120:0:15403:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9caffcbc7800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787560955.252142:0:15403:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffcb0b800 x1874392862943872/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787560955.252156:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787560955.252159:0:15403:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787560955.252160:0:15403:0:(import.c:65:import_set_state_nolock()) ffff9caec3383000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787560955.252164:0:15403:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 659 00000100:00080000:1.0:1787560955.252167:0:15403:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787560955.252171:0:15403:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9caec3383000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787560955.252183:0:15403:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffcb0b480 x1874392862944000/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787560955.252236:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862943488:0@lo:400:kworker.0 00000100:00100000:0.0:1787560955.252347:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862943744:0@lo:400:kworker.0 00000100:00100000:0.0:1787560955.252458:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560955.252526:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787560955.252533:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c33dd467-64b2-4362-8604-d1a6489592bb:3625:1874392862943360:0@lo:400:kworker.0 00000100:00100000:0.0:1787560955.252565:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560955.252604:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862944128:0@lo:400:kworker.0 00000100:00100000:0.0:1787560955.252630:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560955.252654:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862943616:0@lo:400:kworker.0 00000100:00100000:0.0:1787560955.252675:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560955.252691:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862944384:0@lo:400:kworker.0 00000100:00100000:0.0:1787560955.252723:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560955.252762:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862943744 00000100:00100000:0.0:1787560955.252770:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862943744 00000100:00100000:0.0:1787560955.252831:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787560955.252843:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862943744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560955.252904:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862943744:12345-0@lo:400:kworker.0 Request processed in 64us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560955.252913:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787560955.252940:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862943360 00000100:00100000:0.0:1787560955.252944:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862943360 00000100:00100000:0.0:1787560955.252970:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787560955.252976:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4222c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+21:3625:x1874392862943360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560955.253007:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4222c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+21:3625:x1874392862943360:12345-0@lo:400:kworker.0 Request processed in 31us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560955.253013:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787560955.253038:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862944128 00000100:00100000:0.0:1787560955.253042:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862944128 00000100:00100000:0.0:1787560955.253060:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862943616 00000100:00100000:0.0:1787560955.253063:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862943616 00000100:00100000:0.0:1787560955.253085:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862944384 00000100:00100000:0.0:1787560955.253088:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862944384 00000100:00100000:0.0:1787560955.253116:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787560955.253122:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862944128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560955.253154:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862944128:12345-0@lo:400:kworker.0 Request processed in 32us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560955.253160:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787560955.253173:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787560955.253178:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862943616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560955.253207:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862943616:12345-0@lo:400:kworker.0 Request processed in 29us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560955.253212:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787560955.253224:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787560955.253230:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862944384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560955.253267:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862944384:12345-0@lo:400:kworker.0 Request processed in 38us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560955.253272:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1787560955.253296:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787560955.253323:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caffcb0a300 x1874392862943616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560955.253336:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862943616:0@lo:400:kworker.0 00010000:00080000:0.0:1787560955.253346:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caffcb09500 x1874392862944384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560955.253354:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862944384:0@lo:400:kworker.0 00000100:00100000:0.0:1787560955.253379:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c33dd467-64b2-4362-8604-d1a6489592bb:3625:1874392862943360:0@lo:400:kworker.0 00010000:00080000:0.0:1787560955.253398:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caffcb08700 x1874392862944128/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560955.253406:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862944128:0@lo:400:kworker.0 00000100:00100000:0.0:1787560955.253415:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862943744:0@lo:400:kworker.0 00000100:00100000:0.0:1787560955.253485:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862943872:0@lo:8:kworker.0 00000100:00100000:0.0:1787560955.253517:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560955.253535:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862944000:0@lo:8:kworker.0 00000100:00100000:0.0:1787560955.253557:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560955.254018:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560955.254057:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874392862944256:0@lo:400:kworker.0 00000100:00100000:1.0:1787560955.254085:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560955.254124:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862944256 00000100:00100000:1.0:1787560955.254129:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862944256 00000100:00100000:1.0:1787560955.254171:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787560955.254178:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874392862944256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560955.254216:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874392862944256:12345-0@lo:400:kworker.0 Request processed in 39us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560955.254223:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787560955.254318:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862943872 00000100:00100000:1.0:1787560955.254323:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862943872 00000100:00100000:0.0:1787560955.254446:0:23481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862943488 00000100:00100000:0.0:1787560955.254451:0:23481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862943488 00000100:00100000:0.0:1787560955.254478:0:23481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787560955.254485:0:23481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862943488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560955.254523:0:23481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862943488:12345-0@lo:400:kworker.0 Request processed in 38us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560955.254529:0:23481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1787560955.255490:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560955.256169:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862944000 00000100:00100000:1.0:1787560955.256179:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862944000 00000100:00100000:3.0:1787560955.256738:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787560955.256756:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3622:x1874392862943872:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787560955.256790:0:24248:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 674 last 0 00000020:00000080:3.0:1787560955.256832:0:24248:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4642c20bf2f3591a 00002000:00100000:3.0:1787560955.256848:0:24248:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9cafc74c1000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1787560955.256853:0:24248:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1787560955.256855:0:24248:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787560955.257044:0:24248:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1787560955.257070:0:24248:0:(import.c:65:import_set_state_nolock()) ffff9cafc74c2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787560955.257160:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3622:x1874392862943872:12345-0@lo:8:kworker.0 Request processed in 405us (3641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560955.257167:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787560955.257186:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787560955.257190:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3622:x1874392862944000:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787560955.257204:0:24248:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787560955.257232:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3622:x1874392862944000:12345-0@lo:8:kworker.0 Request processed in 40us (3674us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787560955.257237:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787560955.257288:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caffcb0b800 x1874392862943872/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787560975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560955.257299:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787560955.257307:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1787560955.257314:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787560955.257319:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787560955.257321:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffcbc7800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787560955.257343:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787560955.257357:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862943872:0@lo:8:kworker.0 00000100:00080000:3.0:1787560955.257376:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec3383000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787560955.257381:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787560955.257385:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862944000:0@lo:8:kworker.0 00000004:00080000:3.0:1787560955.257477:0:23483:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787560955.257499:0:23483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23483:1874392862944640:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1787560955.257534:0:23483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560955.257554:0:23483:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787560955.257565:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862944512:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787560955.257790:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560955.257836:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862944640 00000100:00100000:3.0:1787560955.257841:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862944640 00000100:00100000:3.0:1787560955.257877:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787560955.257883:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23483:x1874392862944640:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1787560955.258118:0:24251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862944512 00000100:00100000:3.0:1787560955.258122:0:24251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862944512 00000100:00100000:3.0:1787560955.258149:0:24251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787560955.258156:0:24251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3625:x1874392862944512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787560955.258174:0:24251:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787560955.258212:0:24251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3625:x1874392862944512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560955.258219:0:24251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787560955.258236:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787560955.258258:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec407d880 x1874392862944512/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560955.258279:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862944512:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1787560955.259055:0:23482:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787560955.259147:0:23482:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 674598714820ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787560955.259155:0:23482:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1787560955.263209:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862943488:0@lo:400:kworker.0 00010000:00080000:1.0:1787560955.263242:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caffcb08e00 x1874392862944256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560955.263919:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874392862944256:0@lo:400:kworker.0 00000004:00080000:0.0:1787560955.267580:0:23473:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:3.0:1787560955.268377:0:24248:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1787560955.268385:0:24248:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1787560955.268516:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23483:x1874392862944640:12345-0@lo:7:osp-pre-0-1.0 Request processed in 10628us (10976us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560955.268527:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787560955.272761:0:23483:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec407e300 x1874392862944640/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787560971 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560955.272783:0:23483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23483:1874392862944640:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1787560955.272802:0:23483:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:0.0:1787560955.272878:0:23483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23483:1874392862944768:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1787560955.272973:0:23483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560955.273019:0:23483:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec2c86180 going to sleep for 11 seconds 00000100:00100000:3.0:1787560955.273843:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862944768 00000100:00100000:3.0:1787560955.273857:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862944768 00000100:00100000:3.0:1787560955.273938:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787560955.273949:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23483:x1874392862944768:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787560955.273985:0:24249:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1787560955.274047:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23483:x1874392862944768:12345-0@lo:5:osp-pre-0-1.0 Request processed in 99us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560955.274054:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787560955.274103:0:23483:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caffbaf5500 x1874392862944768/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787560971 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560955.274117:0:23483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23483:1874392862944768:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1787560955.274130:0:23483:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1787560955.274172:0:23483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23483:1874392862944896:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1787560955.274200:0:23483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560955.274219:0:23483:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560955.274231:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862944896 00000100:00100000:3.0:1787560955.274235:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862944896 00000100:00100000:3.0:1787560955.274272:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787560955.274278:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23483:x1874392862944896:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787560955.274330:0:24248:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:1.0:1787560955.334356:0:24244:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1787560955.334369:0:24244:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787560955.342060:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23483:x1874392862944896:12345-0@lo:5:osp-pre-0-1.0 Request processed in 67771us (67848us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1787560955.342082:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787560955.342161:0:23483:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec407d880 x1874392862944896/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787560971 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560955.342188:0:23483:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1787560955.342195:0:23483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23483:1874392862944896:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1787560955.342210:0:23483:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1787560955.342259:0:23483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23483:1874392862945024:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1787560955.342300:0:23483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560955.342369:0:23483:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560955.342422:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862945024 00000100:00100000:2.0:1787560955.342588:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862945024 00000100:00100000:2.0:1787560955.342734:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787560955.342755:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23483:x1874392862945024:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1787560955.343045:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23483:x1874392862945024:12345-0@lo:900:osp-pre-0-1.0 Request processed in 292us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560955.343053:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787560955.343193:0:23483:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caec407d880 x1874392862945024/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787560971 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560955.343205:0:23483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23483:1874392862945024:0@lo:900:osp-pre-0-1.0 00010000:00010000:0.0:1787560955.380948:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560956.403602:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560956.467629:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787560956.467664:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862945152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787560956.467766:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560956.467827:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862945152 00000100:00100000:1.0:1787560956.467837:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862945152 00000100:00100000:1.0:1787560956.467908:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787560956.467919:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862945152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787560956.467965:0:22745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787560956.468022:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862945152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560956.468029:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787560956.468079:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862945152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787560956.468167:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787560956.468179:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862945280:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560956.468215:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560956.468247:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862945280 00000100:00100000:3.0:1787560956.468251:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862945280 00000100:00100000:3.0:1787560956.468294:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787560956.468302:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862945280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787560956.468325:0:22746:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787560956.468360:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862945280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560956.468366:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787560956.468397:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862945280:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787560957.436505:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560958.452882:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787560958.901219:0:22774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787560959.475657:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560960.499938:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560960.563709:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c33dd467-64b2-4362-8604-d1a6489592bb:3624:1874392862945408:0@lo:400:kworker.0 00000100:00100000:1.0:1787560960.563793:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787560960.564398:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560960.564404:0:15403:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787560960.564406:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560960.564410:0:15403:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787560960.570445:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787560960.570468:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862945792:0@lo:400:kworker.0 00000100:00100000:1.0:1787560960.570539:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560960.570683:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862945408 00000100:00100000:1.0:1787560960.570692:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862945408 00000100:00100000:1.0:1787560960.570744:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787560960.570753:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4220050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+21:3624:x1874392862945408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560960.570807:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4220050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+21:3624:x1874392862945408:12345-0@lo:400:kworker.0 Request processed in 55us (7013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560960.570814:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787560960.570877:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862945792 00000100:00100000:1.0:1787560960.570880:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862945792 00000100:00100000:1.0:1787560960.570915:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787560960.570921:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862945792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560960.570955:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862945792:12345-0@lo:400:kworker.0 Request processed in 34us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560960.570962:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787560960.570983:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862945920:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787560960.571011:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560960.571044:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862945792:0@lo:400:kworker.0 00000100:00100000:1.0:1787560960.571056:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c33dd467-64b2-4362-8604-d1a6489592bb:3624:1874392862945408:0@lo:400:kworker.0 00000100:00100000:1.0:1787560960.571087:0:24251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862945920 00000100:00100000:1.0:1787560960.571091:0:24251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862945920 00000100:00100000:1.0:1787560960.571124:0:24251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787560960.571131:0:24251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862945920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787560960.571152:0:24251:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787560960.571185:0:24251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862945920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560960.571191:0:24251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787560960.571206:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787560960.571227:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caffcb0ad80 x1874392862945920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560960.571243:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862945920:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787560960.571527:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560960.571538:0:15403:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787560960.571541:0:15403:0:(import.c:65:import_set_state_nolock()) ffff9caec3383000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787560960.571546:0:15403:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 674 00000100:00080000:2.0:1787560960.571549:0:15403:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787560960.571554:0:15403:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9caec3383000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560960.571577:0:15403:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafc46eb480 x1874392862946048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787560960.571714:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862946432:0@lo:400:kworker.0 00000100:00100000:2.0:1787560960.571746:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560960.571779:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862945536:0@lo:400:kworker.0 00000100:00100000:2.0:1787560960.571803:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560960.571819:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862946176:0@lo:400:kworker.0 00000100:00100000:2.0:1787560960.571836:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560960.571852:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787560960.571859:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862945664:0@lo:400:kworker.0 00000100:00100000:2.0:1787560960.571882:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560960.571899:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862946304:0@lo:400:kworker.0 00000100:00100000:2.0:1787560960.571921:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560960.571946:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862946048:0@lo:8:kworker.0 00000100:00100000:2.0:1787560960.571969:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560960.571999:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862946432 00000100:00100000:2.0:1787560960.572004:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862946432 00000100:00100000:2.0:1787560960.572036:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862946176 00000100:00100000:2.0:1787560960.572039:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862946176 00000100:00100000:2.0:1787560960.572050:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862945664 00000100:00100000:2.0:1787560960.572053:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862945664 00000100:00100000:2.0:1787560960.572075:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862946304 00000100:00100000:2.0:1787560960.572079:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862946304 00000100:00100000:2.0:1787560960.572093:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787560960.572100:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862946432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560960.572139:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862946432:12345-0@lo:400:kworker.0 Request processed in 39us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560960.572146:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787560960.572162:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787560960.572167:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862946176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560960.572198:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862946176:12345-0@lo:400:kworker.0 Request processed in 30us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560960.572204:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787560960.572216:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787560960.572221:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862945664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560960.572246:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862945664:12345-0@lo:400:kworker.0 Request processed in 25us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560960.572252:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787560960.572262:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787560960.572268:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862946304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560960.574480:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1874392862946304:12345-0@lo:400:kworker.0 Request processed in 2201us (2547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560960.574497:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787560960.574563:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862945536 00000100:00100000:2.0:1787560960.574576:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862945536 00000100:00100000:2.0:1787560960.574959:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787560960.574969:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862945536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560960.575070:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862945536:12345-0@lo:400:kworker.0 Request processed in 103us (3266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560960.575078:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787560960.575117:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862946048 00000100:00100000:2.0:1787560960.575122:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862946048 00000100:00100000:2.0:1787560960.575146:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787560960.575152:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1874392862946048:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787560960.575175:0:24250:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787560960.575212:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1874392862946048:12345-0@lo:8:kworker.0 Request processed in 60us (3242us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787560960.575218:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787560960.575235:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787560960.575240:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787560960.575284:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec3383000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787560960.575303:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787560960.575307:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862946048:0@lo:8:kworker.0 00010000:00080000:2.0:1787560960.575350:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafc46eb800 x1874392862946432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560960.575362:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862946432:0@lo:400:kworker.0 00010000:00080000:2.0:1787560960.575393:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafc46eb100 x1874392862945664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560960.575402:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862945664:0@lo:400:kworker.0 00010000:00080000:2.0:1787560960.575413:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafc46e8380 x1874392862946304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560960.575461:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1874392862946304:0@lo:400:kworker.0 00000100:00100000:2.0:1787560960.575476:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862945536:0@lo:400:kworker.0 00010000:00080000:2.0:1787560960.575487:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafc46ebb80 x1874392862946176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560960.575494:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862946176:0@lo:400:kworker.0 00000020:01000004:2.0:1787560961.487210:0:25062:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787560961.487214:0:25062:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787560961.487215:0:25062:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787560961.487347:0:25062:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9caffc903800 00000020:01000004:2.0:1787560961.487364:0:25062:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787560961.487380:0:25062:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787560961.487405:0:25062:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9caec4024d28) 00000020:00000080:2.0:1787560961.487526:0:25062:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00010000:00010000:3.0:1787560961.523637:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1787560961.537328:0:25062:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787560961.537919:0:25062:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787560961.538304:0:25062:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787560961.538551:0:25062:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1787560961.538795:0:25062:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787560961.538970:0:25062:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787560961.539141:0:25062:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:1.0:1787560961.541873:0:25062:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787560961.542077:0:25062:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787560961.542092:0:25062:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787560961.542105:0:25062:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4642c20bf2f35928 00000020:01000004:1.0:1787560961.542113:0:25062:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787560961.542134:0:25062:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.129@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787560961.542138:0:25062:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787560961.542145:0:25062:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787560961.542177:0:25062:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1787560961.542181:0:25062:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.129@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787560961.550730:0:25062:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787560961.550781:0:25062:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.129@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1787560961.550786:0:25062:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787560961.550788:0:25062:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787560961.550789:0:25062:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787560961.550791:0:25062:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787560961.550792:0:25062:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787560961.550794:0:25062:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787560961.550795:0:25062:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787560961.550797:0:25062:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787560961.550799:0:25062:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787560961.550803:0:25062:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1787560961.550805:0:25062:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787560961.550806:0:25062:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787560961.550808:0:25062:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787560961.550808:0:25062:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787560961.550809:0:25062:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787560961.550811:0:25062:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787560961.550811:0:25062:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787560961.550813:0:25062:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787560961.550814:0:25062:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787560961.550841:0:25062:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787560961.550862:0:25062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862946560:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787560961.550933:0:25062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560961.551034:0:25062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd1770000 going to sleep for 11 seconds 00000100:00100000:2.0:1787560961.551079:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862946560 00000100:00100000:2.0:1787560961.551089:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862946560 00000100:00100000:2.0:1787560961.551179:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787560961.551191:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4220450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+21:25062:x1874392862946560:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787560961.551226:0:22734:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787560961.551230:0:22734:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1787560961.551234:0:22734:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787560961.551607:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4220450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+21:25062:x1874392862946560:12345-0@lo:253:mount.lustre.0 Request processed in 417us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560961.551616:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787560961.551818:0:25062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862946560:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787560961.551830:0:25062:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787560961.551842:0:25062:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787560961.551844:0:25062:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787560961.551845:0:25062:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787560961.551846:0:25062:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787560961.551847:0:25062:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787560961.551848:0:25062:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787560961.551849:0:25062:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787560961.551851:0:25062:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787560961.551852:0:25062:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787560961.551876:0:25062:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9caffc903800 from lustre-OST0001 10000000:01000000:0.0:1787560961.551908:0:25062:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787560961.551911:0:25062:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787560961.551922:0:25062:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9caff324cd28 local copy 00010000:00010000:0.0:1787560961.551932:0:25062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f35642 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35649 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560961.552018:0:25062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862946688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787560961.552052:0:25062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560961.552125:0:25062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd1770e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787560961.552163:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862946688 00000100:00100000:2.0:1787560961.552169:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862946688 00000100:00100000:2.0:1787560961.552207:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787560961.552215:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4223850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+21:25062:x1874392862946688:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560961.552301:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4223850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+21:25062:x1874392862946688:12345-0@lo:501:mount.lustre.0 Request processed in 86us (247us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787560961.552309:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787560961.552462:0:25062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862946688:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787560961.552477:0:25062:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787560961.552493:0:25062:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787560961.552499:0:25062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f35642 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35649 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.552508:0:25062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffca49000/0x4642c20bf2f35642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35649 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560961.552529:0:25062:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9caffc903800 10000000:01000000:0.0:1787560961.552533:0:25062:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787560961.552538:0:25062:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787560961.552546:0:25062:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787560961.552550:0:25062:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787560961.552554:0:25062:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787560961.552578:0:25062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe800/0x4642c20bf2f3592f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.552585:0:25062:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe800/0x4642c20bf2f3592f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.552594:0:25062:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe800/0x4642c20bf2f3592f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560961.552716:0:25062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862946816:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787560961.552745:0:25062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560961.552767:0:25062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd1770e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787560961.552822:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862946816 00000100:00100000:2.0:1787560961.552827:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862946816 00000100:00100000:2.0:1787560961.552887:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787560961.552896:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4220c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+21:25062:x1874392862946816:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787560961.552908:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560961.552923:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca49200/0x4642c20bf2f35936 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f3592f expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.552946:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca49200/0x4642c20bf2f35936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f3592f expref: 22 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.552956:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca49200/0x4642c20bf2f35936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f3592f expref: 22 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.552966:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca49200, rc 0) 00000100:00100000:2.0:1787560961.553005:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4220c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+22:25062:x1874392862946816:12345-0@lo:101:mount.lustre.0 Request processed in 110us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560961.553011:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787560961.553084:0:25062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862946816:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787560961.553099:0:25062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe800/0x4642c20bf2f3592f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35936 expref: -99 pid: 25062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.553109:0:25062:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe800/0x4642c20bf2f3592f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35936 expref: -99 pid: 25062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787560961.554261:0:25062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:3.0:1787560961.554930:0:25062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787560961.557119:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1787560961.557174:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1787560961.557188:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1787560961.557202:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1787560961.557215:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1787560961.557227:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1787560961.557241:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1787560961.557253:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1787560961.557263:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:3.0:1787560961.557286:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:3.0:1787560961.557292:0:25062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:3.0:1787560961.557400:0:25062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862946944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560961.557760:0:25062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560961.557834:0:25062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8900c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560961.557875:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862946944 00000100:00100000:1.0:1787560961.557882:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862946944 00000100:00100000:1.0:1787560961.557970:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787560961.557981:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4222850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+22:25062:x1874392862946944:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560961.558132:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4222850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+22:25062:x1874392862946944:12345-0@lo:501:mount.lustre.0 Request processed in 152us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560961.558140:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787560961.558212:0:25062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862946944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560961.558244:0:25062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862947072:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787560961.558287:0:25062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560961.558352:0:25062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8900c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560961.558411:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862947072 00000100:00100000:2.0:1787560961.558417:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862947072 00000100:00100000:2.0:1787560961.558470:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787560961.558477:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4223450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+22:25062:x1874392862947072:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787560961.559158:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4223450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+22:25062:x1874392862947072:12345-0@lo:503:mount.lustre.0 Request processed in 678us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560961.559176:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787560961.559269:0:25062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862947072:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787560961.559775:0:25062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787560961.559868:0:25062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862947200:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787560961.559918:0:25062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560961.559947:0:25062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8900c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560961.560082:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862947200 00000100:00100000:2.0:1787560961.560092:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862947200 00000100:00100000:2.0:1787560961.560132:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787560961.560142:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4221850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+22:25062:x1874392862947200:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560961.560530:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4221850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+22:25062:x1874392862947200:12345-0@lo:502:mount.lustre.0 Request processed in 388us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560961.560538:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787560961.560706:0:25062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862947200:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787560961.560902:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1787560961.560934:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1787560961.560947:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1787560961.560960:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1787560961.560981:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1787560961.560996:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1787560961.561012:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1787560961.561026:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1787560961.561039:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:3.0:1787560961.561067:0:25062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862947328:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787560961.561110:0:25062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560961.561138:0:25062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8900c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560961.561221:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862947328 00000100:00100000:1.0:1787560961.561228:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862947328 00000100:00100000:3.0:1787560961.561372:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787560961.561380:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4221450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+22:25062:x1874392862947328:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787560961.561703:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4221450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+22:25062:x1874392862947328:12345-0@lo:502:mount.lustre.0 Request processed in 322us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560961.561709:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787560961.561882:0:25062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862947328:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787560961.562000:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1787560961.562012:0:25062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1787560961.562776:0:25066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787560961.562784:0:25066:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1787560961.562791:0:25066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787560961.562793:0:25066:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787560961.562799:0:25066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787560961.562815:0:25066:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9cafef9f99b8) 00000020:00000080:1.0:1787560961.562848:0:25066:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787560961.562856:0:25066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787560961.562942:0:25066:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9caffc903800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787560961.562951:0:25066:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787560961.562957:0:25066:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4642c20bf2f35944 00010000:00010000:2.0:1787560961.567160:0:25066:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1787560961.567718:0:25066:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:2.0:1787560961.569065:0:25066:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1787560961.570321:0:25066:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787560961.570332:0:25066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560961.570338:0:25066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560961.570341:0:25066:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787560961.570344:0:25066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560961.570348:0:25066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560961.570350:0:25066:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787560961.570353:0:25066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787560961.570355:0:25066:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787560961.570357:0:25066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560961.570359:0:25066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560961.570361:0:25066:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787560961.570364:0:25066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787560961.570366:0:25066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560961.570367:0:25066:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787560961.570370:0:25066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787560961.570394:0:25066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787560961.570403:0:25066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787560961.570404:0:25066:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787560961.570408:0:25066:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1787560961.570722:0:25062:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787560961.570754:0:25062:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787560961.570781:0:25062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe800/0x4642c20bf2f3592f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35936 expref: -99 pid: 25062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560961.570796:0:25062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffcbfe800/0x4642c20bf2f3592f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35936 expref: -99 pid: 25062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560961.570806:0:25062:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9caffc903800 from 1 10000000:01000000:3.0:1787560961.570810:0:25062:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787560961.570853:0:25062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f3594b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560961.570863:0:25062:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f3594b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560961.570887:0:25062:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f3594b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560961.570913:0:25062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862947456:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787560961.570986:0:25062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560961.571038:0:25062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc890240 going to sleep for 11 seconds 00000100:00100000:0.0:1787560961.571136:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862947456 00000100:00100000:0.0:1787560961.571146:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862947456 00000100:00100000:0.0:1787560961.571204:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787560961.571215:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4222450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+22:25062:x1874392862947456:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787560961.571228:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560961.571241:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffcbffc00/0x4642c20bf2f35952 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f3594b expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.571277:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffcbffc00/0x4642c20bf2f35952 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f3594b expref: 23 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.571287:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffcbffc00/0x4642c20bf2f35952 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f3594b expref: 23 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.571297:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbffc00, rc 0) 00000100:00100000:0.0:1787560961.571355:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4222450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+23:25062:x1874392862947456:12345-0@lo:101:mount.lustre.0 Request processed in 142us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560961.571362:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787560961.571475:0:25062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862947456:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787560961.571490:0:25062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f3594b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35952 expref: -99 pid: 25062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.571499:0:25062:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f3594b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35952 expref: -99 pid: 25062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787560961.572402:0:25062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1787560961.572739:0:25062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787560961.572927:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1787560961.572951:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1787560961.572964:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1787560961.572978:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1787560961.572990:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1787560961.573002:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1787560961.573013:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1787560961.573025:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1787560961.573040:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1787560961.573053:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1787560961.573084:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1787560961.573104:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1787560961.573110:0:25062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1787560961.573178:0:25062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862947584:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560961.573229:0:25062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560961.573262:0:25062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560961.573387:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862947584 00000100:00100000:0.0:1787560961.573395:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862947584 00000100:00100000:0.0:1787560961.573471:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787560961.573480:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4220850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+23:25062:x1874392862947584:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560961.574918:0:25062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862947584:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787560961.574975:0:25062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862947712:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787560961.575052:0:25062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560961.575095:0:25062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560961.575139:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862947712 00000100:00100000:3.0:1787560961.575147:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862947712 00000100:00100000:3.0:1787560961.575234:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787560961.575245:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4221050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+24:25062:x1874392862947712:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787560961.575507:0:25062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862947712:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787560961.575537:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4220850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+24:25062:x1874392862947584:12345-0@lo:501:mount.lustre.0 Request processed in 118us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560961.575546:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787560961.575804:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4221050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+23:25062:x1874392862947712:12345-0@lo:503:mount.lustre.0 Request processed in 562us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560961.575812:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000040:00080000:1.0:1787560961.576228:0:25062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787560961.576312:0:25062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862947840:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787560961.576837:0:25062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560961.576927:0:25062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffb8ba240 going to sleep for 11 seconds 00000100:00100000:2.0:1787560961.576962:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862947840 00000100:00100000:2.0:1787560961.576969:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862947840 00000100:00100000:2.0:1787560961.577045:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787560961.577055:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+23:25062:x1874392862947840:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560961.577221:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+23:25062:x1874392862947840:12345-0@lo:502:mount.lustre.0 Request processed in 166us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560961.577230:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787560961.577329:0:25062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862947840:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787560961.577900:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1787560961.577927:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1787560961.577938:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1787560961.577949:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1787560961.577959:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1787560961.577970:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1787560961.577981:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1787560961.577992:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1787560961.578003:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1787560961.578015:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1787560961.578025:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1787560961.578052:0:25062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862947968:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787560961.578096:0:25062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560961.578170:0:25062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8900c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560961.578203:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862947968 00000100:00100000:2.0:1787560961.578209:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862947968 00000100:00100000:2.0:1787560961.578279:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787560961.578288:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+23:25062:x1874392862947968:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560961.578378:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+23:25062:x1874392862947968:12345-0@lo:502:mount.lustre.0 Request processed in 91us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560961.578385:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787560961.578463:0:25062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862947968:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787560961.578498:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1787560961.578505:0:25062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787560961.579693:0:25069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560961.579704:0:25069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560961.579716:0:25069:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787560961.579725:0:25069:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9caffc903800 00000020:00000080:3.0:1787560961.579728:0:25069:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787560961.579736:0:25069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560961.579738:0:25069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560961.579740:0:25069:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787560961.579742:0:25069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560961.579744:0:25069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560961.579745:0:25069:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787560961.579749:0:25069:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9caffc903800 00000020:00000080:3.0:1787560961.579750:0:25069:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787560961.579811:0:25069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560961.579815:0:25069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560961.579816:0:25069:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787560961.579819:0:25069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560961.579821:0:25069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560961.579822:0:25069:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787560961.579825:0:25069:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9caffc903800 00000020:00000080:3.0:1787560961.579827:0:25069:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787560961.579844:0:25069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560961.579847:0:25069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560961.579848:0:25069:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787560961.579850:0:25069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787560961.579853:0:25069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560961.579854:0:25069:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787560961.579857:0:25069:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9caffc903800 00000020:00000080:3.0:1787560961.579859:0:25069:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787560961.579888:0:25069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787560961.579891:0:25069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787560961.579892:0:25069:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787560961.579895:0:25069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1787560961.582744:0:25062:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787560961.582791:0:25062:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787560961.582842:0:25062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f3594b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35952 expref: -99 pid: 25062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.582854:0:25062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f3594b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35952 expref: -99 pid: 25062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560961.582912:0:25062:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787560961.582915:0:25062:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9caffc903800 10000000:01000000:0.0:1787560961.582928:0:25062:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9caffc903800 10000000:01000000:0.0:1787560961.582932:0:25062:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787560961.582939:0:25062:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9caffc903800 from 1 10000000:01000000:0.0:1787560961.582941:0:25062:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787560961.582976:0:25062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbff200/0x4642c20bf2f35959 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.582985:0:25062:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffcbff200/0x4642c20bf2f35959 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.582996:0:25062:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffcbff200/0x4642c20bf2f35959 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560961.583020:0:25062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862948096:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787560961.583088:0:25062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560961.583144:0:25062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd871f780 going to sleep for 11 seconds 00000100:00100000:3.0:1787560961.583196:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862948096 00000100:00100000:3.0:1787560961.583379:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862948096 00000100:00100000:3.0:1787560961.583501:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787560961.583511:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+23:25062:x1874392862948096:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787560961.583527:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560961.583540:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f35960 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f35959 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560961.583562:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f35960 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f35959 expref: 24 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560961.583572:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafda2f6800/0x4642c20bf2f35960 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35959 expref: 24 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560961.583579:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f6800, rc 0) 00000100:00100000:3.0:1787560961.583630:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+24:25062:x1874392862948096:12345-0@lo:101:mount.lustre.0 Request processed in 122us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560961.583637:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787560961.585698:0:25062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862948096:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787560961.585791:0:25062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffcbff200/0x4642c20bf2f35959 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35960 expref: -99 pid: 25062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.585806:0:25062:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffcbff200/0x4642c20bf2f35959 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35960 expref: -99 pid: 25062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560961.587919:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560941/real 1787560941] req@ffff9caffcbba300 x1874392862936832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560961 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560961.587946:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9caffcbba300 x1874392862936832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560961 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560961.587955:0:3622:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787560941/real 1787560941] req@ffff9caffcbbad80 x1874392862936960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560961 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560961.587979:0:3622:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9caffcbbad80 x1874392862936960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787560961 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787560961.587995:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffff55000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787560961.588009:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787560961.588013:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862936832:0@lo:8:kworker.0 00000100:00080000:3.0:1787560961.588018:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafc58be000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787560961.588023:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787560961.588026:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862936960:0@lo:8:kworker.0 00000100:00100000:2.0:1787560961.588100:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862948224:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1787560961.588120:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560961.588124:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787560961.588126:0:8:0:(import.c:65:import_set_state_nolock()) ffff9caffff55000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787560961.588130:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 660 00000100:00080000:3.0:1787560961.588134:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787560961.588140:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9caffff55000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560961.588158:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffcbbbb80 x1874392862948480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787560961.588165:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787560961.588169:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787560961.588173:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787560961.588174:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cafc58be000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787560961.588177:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 660 00000100:00080000:3.0:1787560961.588179:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787560961.588182:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cafc58be000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1787560961.588191:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffcbba680 x1874392862948608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787560961.588210:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862948352:0@lo:400:kworker.0 00000100:00080000:3.0:1787560961.588229:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1787560961.588232:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787560961.588233:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787560961.588235:0:8:0:(import.c:65:import_set_state_nolock()) ffff9caec3383000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787560961.588238:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 679 00000100:00080000:3.0:1787560961.588240:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1787560961.588244:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9caec3383000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560961.588248:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787560961.588253:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862948736:0@lo:400:kworker.0 00000100:00100000:3.0:1787560961.588256:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caec407d880 x1874392862949120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787560961.588276:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560961.588289:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862948480:0@lo:8:kworker.0 00000100:00100000:2.0:1787560961.588293:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862949248:0@lo:400:kworker.0 00000100:00100000:2.0:1787560961.588311:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560961.588314:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560961.588340:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862948608:0@lo:8:kworker.0 00000100:00100000:3.0:1787560961.588360:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560961.588374:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862949120:0@lo:8:kworker.0 00000100:00100000:0.0:1787560961.588386:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862948480 00000100:00100000:3.0:1787560961.588393:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560961.588394:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862948480 00000100:00100000:0.0:1787560961.588414:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862948608 00000100:00100000:0.0:1787560961.588417:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862948608 00000100:00100000:0.0:1787560961.588426:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862949120 00000100:00100000:0.0:1787560961.588428:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862949120 00000100:00100000:0.0:1787560961.588457:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787560961.588465:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3622:x1874392862948480:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787560961.588491:0:24248:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 680 last 0 00000020:00000080:0.0:1787560961.588517:0:24248:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4642c20bf2f35967 00002000:00100000:0.0:1787560961.588531:0:24248:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9cafc6f11000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787560961.588536:0:24248:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787560961.588538:0:24248:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787560961.588611:0:24248:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787560961.588633:0:24248:0:(import.c:65:import_set_state_nolock()) ffff9cafc6f13000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787560961.588702:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3622:x1874392862948480:12345-0@lo:8:kworker.0 Request processed in 236us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560961.588709:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787560961.588724:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787560961.588729:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3622:x1874392862948608:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787560961.588764:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3622:x1874392862948608:12345-0@lo:8:kworker.0 Request processed in 33us (403us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787560961.588769:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787560961.588776:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caffcbbbb80 x1874392862948480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787560986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560961.588781:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787560961.588785:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3622:x1874392862949120:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787560961.588786:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787560961.588792:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787560961.588799:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787560961.588805:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787560961.588807:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caffff55000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787560961.588814:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3622:x1874392862949120:12345-0@lo:8:kworker.0 Request processed in 27us (419us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787560961.588819:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000004:00080000:3.0:1787560961.588820:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787560961.588824:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862948480:0@lo:8:kworker.0 00000100:00100000:3.0:1787560961.588835:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000004:00080000:0.0:1787560961.588840:0:22764:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00080000:3.0:1787560961.588844:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafc58be000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787560961.588848:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787560961.588851:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862948608:0@lo:8:kworker.0 00000100:00100000:3.0:1787560961.588859:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787560961.588862:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec3383000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787560961.588865:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787560961.588867:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862949120:0@lo:8:kworker.0 00000004:00080000:0.0:1787560961.588897:0:22764:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 680928465456ns, next at 0ns, rc = 0 00000004:00080000:3.0:1787560961.588899:0:22765:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00080000:00080000:0.0:1787560961.588902:0:22764:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1787560961.588913:0:22765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48f9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22765:1874392862949760:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787560961.588937:0:22765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560961.588950:0:22765:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8900c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560961.589046:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862949760 00000100:00100000:0.0:1787560961.589051:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862949760 00000100:00100000:0.0:1787560961.589090:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787560961.589097:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22765:x1874392862949760:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:3.0:1787560961.589945:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787560961.590128:0:22720:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1787560961.590495:0:23481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862948224 00000100:00100000:3.0:1787560961.590501:0:23481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862948224 00000100:00100000:3.0:1787560961.590535:0:23481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862948352 00000100:00100000:3.0:1787560961.590538:0:23481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862948352 00000100:00100000:3.0:1787560961.590777:0:23481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787560961.590790:0:23481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3624:x1874392862948224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787560961.590822:0:23481:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787560961.590882:0:23481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3624:x1874392862948224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (2716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560961.590888:0:23481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787560961.590905:0:23481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787560961.590911:0:23481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862948352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560961.590939:0:23481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862948352:12345-0@lo:400:kworker.0 Request processed in 29us (2706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560961.590954:0:23481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787560961.590978:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862949376:0@lo:400:kworker.0 00000100:00100000:3.0:1787560961.591011:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560961.591038:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787560961.591044:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862949888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787560961.591066:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560961.591089:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862948864:0@lo:400:kworker.0 00000100:00100000:3.0:1787560961.591110:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560961.591120:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862949504:0@lo:400:kworker.0 00000100:00100000:3.0:1787560961.591139:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560961.591150:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787560961.591156:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862948992:0@lo:400:kworker.0 00000100:00100000:3.0:1787560961.591176:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560961.591187:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862949632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787560961.591205:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560961.591246:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862948224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560961.591264:0:23481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862949888 00000100:00100000:3.0:1787560961.591267:0:23481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862949888 00000100:00100000:3.0:1787560961.591281:0:23481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862948864 00000100:00100000:3.0:1787560961.591283:0:23481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862948864 00000100:00100000:3.0:1787560961.591293:0:23481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787560961.591298:0:23481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3626:x1874392862949888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787560961.591314:0:23481:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787560961.591346:0:23481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3626:x1874392862949888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 47us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560961.591360:0:23481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787560961.591373:0:23481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787560961.591378:0:23481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862948864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560961.591410:0:23481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862948864:12345-0@lo:400:kworker.0 Request processed in 31us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560961.591416:0:23481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787560961.591461:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862949888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787560961.591483:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862948864:0@lo:400:kworker.0 00000100:00100000:2.0:1787560961.591738:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862948736 00000100:00100000:2.0:1787560961.591743:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862948736 00000100:00100000:2.0:1787560961.591766:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862949248 00000100:00100000:2.0:1787560961.591769:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862949248 00000100:00100000:2.0:1787560961.591778:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862949376 00000100:00100000:2.0:1787560961.591780:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862949376 00000100:00100000:2.0:1787560961.591790:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862949504 00000100:00100000:2.0:1787560961.591793:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862949504 00000100:00100000:2.0:1787560961.591806:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787560961.591812:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862948736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560961.591847:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862948736:12345-0@lo:400:kworker.0 Request processed in 35us (3570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560961.591853:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787560961.591866:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787560961.591872:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862949248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560961.591898:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1874392862949248:12345-0@lo:400:kworker.0 Request processed in 27us (3586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560961.591904:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787560961.591915:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787560961.591920:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862949376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560961.591957:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862949376:12345-0@lo:400:kworker.0 Request processed in 37us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560961.591963:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787560961.591975:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787560961.591980:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862949504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560961.592026:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862949504:12345-0@lo:400:kworker.0 Request processed in 45us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560961.592041:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787560961.592061:0:24250:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787560961.592069:0:24250:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787560961.592087:0:24249:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787560961.592093:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862948992 00000100:00100000:2.0:1787560961.592096:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862948992 00000100:00100000:2.0:1787560961.592110:0:24249:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787560961.592115:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787560961.592121:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862948992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560961.592151:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862948992:12345-0@lo:400:kworker.0 Request processed in 30us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560961.592157:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787560961.592240:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caff48fad80 x1874392862949376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560961.592251:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862949376:0@lo:400:kworker.0 00010000:00080000:2.0:1787560961.592291:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caffcbbb480 x1874392862948992/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787560977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560961.592301:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862948992:0@lo:400:kworker.0 00010000:00080000:2.0:1787560961.592311:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caff48fa300 x1874392862949504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560961.592319:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862949504:0@lo:400:kworker.0 00010000:00080000:2.0:1787560961.592345:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caff48fbb80 x1874392862949248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560961.592353:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1874392862949248:0@lo:400:kworker.0 00010000:00080000:2.0:1787560961.592365:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caffcbbaa00 x1874392862948736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560961.592373:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862948736:0@lo:400:kworker.0 00000100:00100000:2.0:1787560961.592395:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862948352:0@lo:400:kworker.0 00000100:00100000:1.0:1787560961.592790:0:24251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862949632 00000100:00100000:1.0:1787560961.592797:0:24251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862949632 00000100:00100000:1.0:1787560961.592833:0:24251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787560961.592840:0:24251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3623:x1874392862949632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787560961.592854:0:24251:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787560961.592895:0:24251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3623:x1874392862949632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (1688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560961.592902:0:24251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787560961.594161:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caff48fb100 x1874392862949632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560977 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560961.594184:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862949632:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787560961.598134:0:25062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1787560961.598510:0:25062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787560961.598790:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1787560961.598822:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1787560961.598836:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1787560961.598849:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1787560961.598861:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1787560961.598873:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1787560961.598903:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1787560961.598917:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1787560961.598930:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1787560961.598942:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1787560961.598954:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1787560961.598966:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1787560961.598979:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1787560961.598990:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1787560961.599002:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1787560961.599014:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1787560961.599026:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1787560961.599038:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1787560961.599051:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1787560961.599062:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1787560961.599075:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1787560961.599087:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1787560961.599113:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1787560961.599128:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1787560961.599140:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1787560961.599152:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1787560961.599164:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1787560961.599176:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1787560961.599189:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1787560961.599200:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1787560961.599212:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1787560961.599225:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1787560961.599237:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1787560961.599249:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1787560961.599273:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1787560961.599285:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1787560961.599297:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1787560961.599309:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1787560961.599336:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1787560961.599350:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1787560961.599361:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1787560961.599374:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1787560961.599388:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1787560961.599401:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1787560961.599414:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1787560961.599425:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1787560961.599466:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1787560961.599481:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1787560961.599587:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1787560961.599612:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1787560961.599628:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1787560961.599633:0:25062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1787560961.599763:0:25062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb09c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862950016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560961.599842:0:25062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560961.599896:0:25062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd092b300 going to sleep for 11 seconds 00000100:00100000:3.0:1787560961.600066:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862950016 00000100:00100000:3.0:1787560961.600075:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862950016 00000100:00100000:3.0:1787560961.600128:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787560961.600138:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+24:25062:x1874392862950016:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787560961.600260:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+24:25062:x1874392862950016:12345-0@lo:501:mount.lustre.0 Request processed in 123us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560961.600267:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787560961.600352:0:25062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb09c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862950016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787560961.600387:0:25062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb09c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862950144:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787560961.600483:0:25062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560961.600528:0:25062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd092b300 going to sleep for 11 seconds 00000100:00100000:3.0:1787560961.603971:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862950144 00000100:00100000:3.0:1787560961.603987:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862950144 00000100:00100000:3.0:1787560961.606413:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787560961.606447:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+24:25062:x1874392862950144:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787560961.606606:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+24:25062:x1874392862950144:12345-0@lo:503:mount.lustre.0 Request processed in 181us (6177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560961.606626:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00002000:00080000:0.0:1787560961.607400:0:24248:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1787560961.607410:0:24248:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1787560961.607416:0:24248:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00000100:00100000:2.0:1787560961.607898:0:25062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb09c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862950144:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787560961.608334:0:25062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787560961.608414:0:25062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862950272:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560961.609814:0:25062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560961.609864:0:25062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787560961.614524:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862950272 00000100:00100000:3.0:1787560961.614541:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862950272 00000100:00100000:3.0:1787560961.614618:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787560961.614630:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+24:25062:x1874392862950272:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787560961.614817:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+24:25062:x1874392862950272:12345-0@lo:502:mount.lustre.0 Request processed in 189us (5005us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560961.614825:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787560961.616313:0:25062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862950272:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787560961.616602:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1787560961.616638:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1787560961.616652:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1787560961.616664:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1787560961.616692:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1787560961.616705:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1787560961.616718:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1787560961.616732:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1787560961.616745:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1787560961.616774:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1787560961.616788:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1787560961.616800:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1787560961.616813:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1787560961.616825:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1787560961.616836:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1787560961.616848:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1787560961.616861:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1787560961.616884:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1787560961.616896:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1787560961.616907:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1787560961.616918:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1787560961.616930:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1787560961.616942:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1787560961.616956:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1787560961.616968:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1787560961.616993:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1787560961.617008:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1787560961.617021:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1787560961.617032:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1787560961.617045:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1787560961.617057:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1787560961.617069:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1787560961.617081:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1787560961.617093:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1787560961.617107:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1787560961.617118:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1787560961.617131:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1787560961.617143:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1787560961.617156:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1787560961.617169:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1787560961.617181:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1787560961.617206:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1787560961.617222:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1787560961.617236:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1787560961.617249:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1787560961.617261:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1787560961.617273:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1787560961.617286:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1787560961.617336:0:25062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862950400:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560961.617419:0:25062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560961.617483:0:25062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787560961.617563:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862950400 00000100:00100000:3.0:1787560961.617570:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862950400 00000100:00100000:3.0:1787560961.617619:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787560961.617629:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+24:25062:x1874392862950400:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787560961.617746:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+24:25062:x1874392862950400:12345-0@lo:502:mount.lustre.0 Request processed in 118us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560961.617753:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787560961.621864:0:25062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862950400:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787560961.622098:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1787560961.622129:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1787560961.622170:0:25062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862950528:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787560961.622241:0:25062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560961.624050:0:25062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2e40 going to sleep for 11 seconds 00002000:00010000:0.0:1787560961.626032:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787560961.626046:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085e02259/0x4642c20bf2f3596e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.626070:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1787560961.626074:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560961.626081:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085e02259/0x4642c20bf2f3596e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.626099:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085e02259/0x4642c20bf2f3596e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.626110:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085e02259/0x4642c20bf2f3596e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.626118:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085e02259/0x4642c20bf2f3596e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.626145:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787560961.626562:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787560961.626568:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a08793e/0x4642c20bf2f35975 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.626577:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1787560961.626580:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560961.626585:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a08793e/0x4642c20bf2f35975 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.626655:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a08793e/0x4642c20bf2f35975 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.626686:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a08793e/0x4642c20bf2f35975 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.626695:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a08793e/0x4642c20bf2f35975 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.626715:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787560961.626983:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787560961.626989:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000deac983/0x4642c20bf2f3597c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.626999:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1787560961.627002:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560961.627007:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000deac983/0x4642c20bf2f3597c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.627016:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000deac983/0x4642c20bf2f3597c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.627025:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000deac983/0x4642c20bf2f3597c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.627032:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000deac983/0x4642c20bf2f3597c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.627054:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787560961.627314:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787560961.627323:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085e02259/0x4642c20bf2f3596e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.627332:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbff000 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:2.0:1787560961.627337:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085e02259/0x4642c20bf2f3596e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.627347:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085e02259/0x4642c20bf2f3596e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.627370:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085e02259/0x4642c20bf2f3596e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.627378:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085e02259/0x4642c20bf2f3596e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.627398:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787560961.627408:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a08793e/0x4642c20bf2f35975 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.627416:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbff600 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:2.0:1787560961.627419:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a08793e/0x4642c20bf2f35975 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.627447:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a08793e/0x4642c20bf2f35975 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.627461:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a08793e/0x4642c20bf2f35975 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.627469:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a08793e/0x4642c20bf2f35975 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.627484:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560961.627487:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000deac983/0x4642c20bf2f3597c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.627494:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbffe00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:2.0:1787560961.627498:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000deac983/0x4642c20bf2f3597c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.627506:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000deac983/0x4642c20bf2f3597c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.627528:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000deac983/0x4642c20bf2f3597c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.627535:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000deac983/0x4642c20bf2f3597c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.627548:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560961.627550:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560961.627552:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787560961.627743:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787560961.627749:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcf6b654/0x4642c20bf2f35983 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.627758:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1787560961.627761:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560961.627765:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcf6b654/0x4642c20bf2f35983 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.627775:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcf6b654/0x4642c20bf2f35983 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.627785:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcf6b654/0x4642c20bf2f35983 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.627791:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bcf6b654/0x4642c20bf2f35983 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.629713:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787560961.630057:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862950528 00000100:00100000:1.0:1787560961.630068:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862950528 00010000:00010000:2.0:1787560961.630452:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560961.630463:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bcf6b654/0x4642c20bf2f35983 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.630478:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3088a00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:2.0:1787560961.630484:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcf6b654/0x4642c20bf2f35983 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.630496:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcf6b654/0x4642c20bf2f35983 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.630521:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bcf6b654/0x4642c20bf2f35983 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.630529:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcf6b654/0x4642c20bf2f35983 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.630574:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560961.630576:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560961.630578:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560961.630754:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787560961.630768:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+24:25062:x1874392862950528:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787560961.630961:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+24:25062:x1874392862950528:12345-0@lo:502:mount.lustre.0 Request processed in 195us (8719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560961.630970:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787560961.632905:0:25062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862950528:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787560961.633019:0:25062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1787560961.633038:0:25062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787560961.633854:0:25076:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787560961.633870:0:25076:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9cafef9fcd28) 00000020:00000080:1.0:1787560961.633895:0:25076:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1787560961.634004:0:25076:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9caffc903800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787560961.634009:0:25076:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9caffc903800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787560961.634012:0:25076:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9caffc903800 3 00010000:00080000:1.0:1787560961.634051:0:25076:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9caec3010000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.129@tcp at head 00010000:00010000:1.0:1787560961.637485:0:25076:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00010000:00010000:0.0:1787560961.638753:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787560961.638848:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787560961.638860:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4ff8c50/0x4642c20bf2f35991 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.638877:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=680s v=(0 0) 00010000:00010000:0.0:1787560961.638892:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560961.638899:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4ff8c50/0x4642c20bf2f35991 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.638916:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4ff8c50/0x4642c20bf2f35991 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.638928:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4ff8c50/0x4642c20bf2f35991 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.638937:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4ff8c50/0x4642c20bf2f35991 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.638956:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787560961.639149:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560961.639156:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4ff8c50/0x4642c20bf2f35991 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.639166:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3089200 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560961.639171:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4ff8c50/0x4642c20bf2f35991 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.639181:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4ff8c50/0x4642c20bf2f35991 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.639199:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4ff8c50/0x4642c20bf2f35991 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.639218:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4ff8c50/0x4642c20bf2f35991 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.639236:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560961.639238:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560961.639239:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787560961.640047:0:25076:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787560961.640099:0:25076:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787560961.640111:0:25076:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4642c20bf2f35998 00000100:00080000:1.0:1787560961.640122:0:25076:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787560961.640127:0:25076:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9caec3010000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1787560961.640164:0:25076:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caffcb0ad80 x1874392862950656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787560961.640200:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1874392862950656:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787560961.640280:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787560961.640337:0:25076:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787560961.640626:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862950656 00000100:00100000:2.0:1787560961.640634:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862950656 00000100:00100000:2.0:1787560961.640663:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787560961.640680:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1874392862950656:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787560961.640702:0:22742:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 680 last 0 00000020:00000080:2.0:1787560961.640733:0:22742:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4642c20bf2f3599f 00000004:00100000:2.0:1787560961.640749:0:22742:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787560961.640782:0:22742:0:(import.c:65:import_set_state_nolock()) ffff9caec233d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787560961.640847:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1874392862950656:12345-0@lo:38:llog_process_th.0 Request processed in 167us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560961.640855:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787560961.641100:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9caffcb0ad80 x1874392862950656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787560971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560961.641111:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787560961.641118:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1787560961.641124:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787560961.641128:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787560961.641131:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec3010000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787560961.641136:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1874392862950656:0@lo:38:llog_process_th.0 00002000:00010000:1.0:1787560961.641314:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560961.641323:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000681482f1/0x4642c20bf2f359a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.641339:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=680s v=(0 0) 00010000:00010000:1.0:1787560961.641343:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560961.641349:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000681482f1/0x4642c20bf2f359a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.641363:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000681482f1/0x4642c20bf2f359a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.641387:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000681482f1/0x4642c20bf2f359a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.641394:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000681482f1/0x4642c20bf2f359a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787560961.641611:0:25076:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787560961.641628:0:25076:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9caec40219b8) 00000020:00000080:2.0:1787560961.641647:0:25076:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1787560961.641744:0:25076:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9caffc903800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787560961.641748:0:25076:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9caffc903800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787560961.641750:0:25076:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9caffc903800 3 00010000:00080000:2.0:1787560961.641785:0:25076:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9caec233f800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.129@tcp at head 00010000:00010000:2.0:1787560961.643381:0:25076:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1787560961.643658:0:25076:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1787560961.643724:0:25076:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787560961.643736:0:25076:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x4642c20bf2f359b4 00000100:00080000:2.0:1787560961.643745:0:25076:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787560961.643750:0:25076:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9caec233f800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560961.643784:0:25076:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cafc46eb480 x1874392862950784/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787560961.643807:0:25076:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00010000:00010000:1.0:1787560961.644088:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787560961.644694:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560961.644705:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5669a43/0x4642c20bf2f359bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.644723:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=680s v=(0 0) 00010000:00010000:1.0:1787560961.644728:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560961.644735:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5669a43/0x4642c20bf2f359bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.644747:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5669a43/0x4642c20bf2f359bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.644756:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5669a43/0x4642c20bf2f359bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.644762:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5669a43/0x4642c20bf2f359bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.649717:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787560961.649729:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000681482f1/0x4642c20bf2f359a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.649742:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880a00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560961.649747:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000681482f1/0x4642c20bf2f359a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.649758:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000681482f1/0x4642c20bf2f359a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.649796:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000681482f1/0x4642c20bf2f359a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.649804:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000681482f1/0x4642c20bf2f359a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.649823:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560961.649827:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5669a43/0x4642c20bf2f359bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.649833:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881e00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560961.649836:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5669a43/0x4642c20bf2f359bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.649844:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5669a43/0x4642c20bf2f359bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.649854:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5669a43/0x4642c20bf2f359bb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.649861:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560961.649862:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560961.649864:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560961.650125:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1874392862950784:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787560961.650203:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560961.651146:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862950784 00000100:00100000:0.0:1787560961.651158:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862950784 00000100:00100000:0.0:1787560961.651200:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787560961.651209:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1874392862950784:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787560961.651241:0:22741:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 680 last 0 00000020:00000080:0.0:1787560961.651284:0:22741:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x4642c20bf2f359c2 00000004:00100000:0.0:1787560961.651300:0:22741:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787560961.651336:0:22741:0:(import.c:65:import_set_state_nolock()) ffff9cafc6f16000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787560961.651410:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1874392862950784:12345-0@lo:38:llog_process_th.0 Request processed in 199us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560961.651417:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787560961.651717:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787560961.651727:0:24248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5669a43/0x4642c20bf2f359bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787560961.652230:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560961.652239:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079d09c86/0x4642c20bf2f359c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.652253:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=680s v=(0 0) 00010000:00010000:1.0:1787560961.652258:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560961.652265:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079d09c86/0x4642c20bf2f359c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.652278:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079d09c86/0x4642c20bf2f359c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.652287:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079d09c86/0x4642c20bf2f359c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.652294:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079d09c86/0x4642c20bf2f359c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.652313:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787560961.652576:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560961.652583:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7e65c7c/0x4642c20bf2f359d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787560961.652896:0:25076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1787560961.652996:0:25062:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787560961.653066:0:25062:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787560961.653082:0:25062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffcbff200/0x4642c20bf2f35959 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35960 expref: -99 pid: 25062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.653091:0:25062:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffcbff200/0x4642c20bf2f35959 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35960 expref: -99 pid: 25062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787560961.653154:0:25062:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787560961.653157:0:25062:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787560961.653158:0:25062:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560961.653160:0:25062:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560961.653161:0:25062:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560961.653162:0:25062:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560961.653164:0:25062:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787560961.653166:0:25062:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560961.653167:0:25062:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787560961.653171:0:25062:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1787560961.653173:0:25062:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787560961.653174:0:25062:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787560961.653176:0:25062:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560961.653177:0:25062:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560961.653178:0:25062:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560961.653179:0:25062:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560961.653180:0:25062:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787560961.653186:0:25062:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560961.653187:0:25062:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787560961.653212:0:25062:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787560961.653232:0:25062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862950912:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787560961.653304:0:25062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560961.653350:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862950912 00000100:00100000:2.0:1787560961.653359:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862950912 00000100:00100000:2.0:1787560961.653407:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787560961.653417:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+24:25062:x1874392862950912:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787560961.653476:0:22733:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787560961.653489:0:22733:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1787560961.653787:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cafc46eb480 x1874392862950784/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787560971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560961.653799:0:3622:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787560961.653809:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1787560961.653816:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787560961.653822:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787560961.653826:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec233f800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787560961.653836:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1874392862950784:0@lo:38:llog_process_th.0 00010000:00010000:1.0:1787560961.654718:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=680s v=(0 0) 00010000:00010000:1.0:1787560961.654723:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560961.654731:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7e65c7c/0x4642c20bf2f359d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.654747:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7e65c7c/0x4642c20bf2f359d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.654758:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7e65c7c/0x4642c20bf2f359d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.654766:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7e65c7c/0x4642c20bf2f359d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.654779:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787560961.655214:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560961.655220:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016c3ba0b/0x4642c20bf2f359d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.655229:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=680s v=(0 0) 00010000:00010000:1.0:1787560961.655232:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560961.655237:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016c3ba0b/0x4642c20bf2f359d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.655245:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016c3ba0b/0x4642c20bf2f359d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.655263:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016c3ba0b/0x4642c20bf2f359d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.655269:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016c3ba0b/0x4642c20bf2f359d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.655276:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787560961.655534:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560961.655540:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000686f09a1/0x4642c20bf2f359de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.655548:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=680s v=(0 0) 00010000:00010000:1.0:1787560961.655551:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560961.655555:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000686f09a1/0x4642c20bf2f359de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.655564:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000686f09a1/0x4642c20bf2f359de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.655572:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000686f09a1/0x4642c20bf2f359de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.655580:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000686f09a1/0x4642c20bf2f359de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.656209:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 20000000:01000000:2.0:1787560961.656813:0:22733:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787560961.656826:0:22733:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787560961.656867:0:22756:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787560961.656872:0:22756:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787560961.656888:0:22756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9caffca49800/0x4642c20bf2f359e5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.656902:0:22756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f35905 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f358fe expref: 24 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.656910:0:22756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f35913 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f3590c expref: 24 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.656916:0:22756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9caffca49800/0x4642c20bf2f359e5 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.656952:0:22756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f35913 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f3590c expref: 24 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.656966:0:22756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f35913 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f3590c expref: 24 pid: 22734 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560961.656995:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafc46eb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22756:1874392862951040:0@lo:104: 00000100:00100000:2.0:1787560961.657066:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787560961.657111:0:22756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f35905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f358fe expref: 24 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.657119:0:22756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f35905 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f358fe expref: 24 pid: 22735 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560961.657127:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bae680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22756:1874392862951168:0@lo:104: 00000100:00100000:2.0:1787560961.657146:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560961.657161:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b20c0 going to sleep for 11 seconds 00002000:00010000:1.0:1787560961.657371:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560961.657378:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005283323a/0x4642c20bf2f359ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.657390:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=680s v=(0 0) 00010000:00010000:1.0:1787560961.657394:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560961.657399:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005283323a/0x4642c20bf2f359ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.657411:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005283323a/0x4642c20bf2f359ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.657421:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005283323a/0x4642c20bf2f359ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.657428:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005283323a/0x4642c20bf2f359ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.657452:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1787560961.658507:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787560961.658520:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079d09c86/0x4642c20bf2f359c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.658531:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3881400 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560961.658536:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079d09c86/0x4642c20bf2f359c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.658558:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079d09c86/0x4642c20bf2f359c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.658578:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079d09c86/0x4642c20bf2f359c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.658585:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079d09c86/0x4642c20bf2f359c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787560961.658775:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560961.658783:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e17b388a/0x4642c20bf2f359f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.658792:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=680s v=(0 0) 00010000:00010000:1.0:1787560961.658803:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560961.658808:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e17b388a/0x4642c20bf2f359f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.658819:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e17b388a/0x4642c20bf2f359f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.658827:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e17b388a/0x4642c20bf2f359f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.658835:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e17b388a/0x4642c20bf2f359f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.658844:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00000100:00100000:2.0:1787560961.659181:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862951040 00000100:00100000:2.0:1787560961.659191:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862951040 00000100:00100000:2.0:1787560961.659232:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862951168 00000100:00100000:2.0:1787560961.659236:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862951168 00000100:00100000:2.0:1787560961.659251:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787560961.659260:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3badf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c33dd467-64b2-4362-8604-d1a6489592bb+4:22756:x1874392862951040:12345-0@lo:104: 00010000:00010000:2.0:1787560961.659273:0:22723:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9caffca49a00/0x4642c20bf2f3590c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f35913 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.659344:0:22723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1787560961.659350:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3badf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c33dd467-64b2-4362-8604-d1a6489592bb+4:22756:x1874392862951040:12345-0@lo:104: Request processed in 92us (2285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560961.659357:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787560961.659373:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787560961.659379:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3baf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c33dd467-64b2-4362-8604-d1a6489592bb+3:22756:x1874392862951168:12345-0@lo:104: 00010000:00010000:2.0:1787560961.659387:0:22723:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9caec3880c00/0x4642c20bf2f358fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f35905 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560961.659420:0:22723:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1787560961.659426:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3baf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c33dd467-64b2-4362-8604-d1a6489592bb+3:22756:x1874392862951168:12345-0@lo:104: Request processed in 48us (2280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560961.659447:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787560961.659501:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+24:25062:x1874392862950912:12345-0@lo:253:mount.lustre.0 Request processed in 6085us (6196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560961.659509:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787560961.659555:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46eb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22756:1874392862951040:0@lo:104: 00000100:00100000:2.0:1787560961.659565:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bae680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22756:1874392862951168:0@lo:104: 00010000:00010000:2.0:1787560961.659585:0:22756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9caffca49800/0x4642c20bf2f359e5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787560961.659859:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560961.659866:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022e470e6/0x4642c20bf2f359fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.659876:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=680s v=(0 0) 00010000:00010000:1.0:1787560961.659880:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560961.659885:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022e470e6/0x4642c20bf2f359fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.659896:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022e470e6/0x4642c20bf2f359fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.659905:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022e470e6/0x4642c20bf2f359fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.659921:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022e470e6/0x4642c20bf2f359fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.659929:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1787560961.660227:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560961.660233:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb829444/0x4642c20bf2f35a01 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.660242:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=680s v=(0 0) 00010000:00010000:1.0:1787560961.660245:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560961.660250:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb829444/0x4642c20bf2f35a01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.660259:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb829444/0x4642c20bf2f35a01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.660266:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb829444/0x4642c20bf2f35a01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.660273:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb829444/0x4642c20bf2f35a01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.660283:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00000100:00100000:2.0:1787560961.660827:0:25062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec10b2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560961.660850:0:25062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafc46ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c33dd467-64b2-4362-8604-d1a6489592bb:25062:1874392862950912:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787560961.660863:0:25062:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787560961.660866:0:25062:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787560961.660868:0:25062:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787560961.660870:0:25062:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787560961.660871:0:25062:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787560961.660872:0:25062:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787560961.660873:0:25062:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787560961.660874:0:25062:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787560961.660876:0:25062:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787560961.660877:0:25062:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787560961.660889:0:25062:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00002000:00010000:1.0:1787560961.661533:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560961.661541:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000346beb99/0x4642c20bf2f35a08 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.661560:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=680s v=(0 0) 00010000:00010000:1.0:1787560961.661564:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560961.661569:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000346beb99/0x4642c20bf2f35a08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.661580:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000346beb99/0x4642c20bf2f35a08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.661588:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000346beb99/0x4642c20bf2f35a08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.661703:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1787560961.661710:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caffca49a00/0x4642c20bf2f3590c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f35913 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.661718:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49a00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:0.0:1787560961.661722:0:22728:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caffca49a00/0x4642c20bf2f3590c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f35913 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.661730:0:22728:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caffca49a00/0x4642c20bf2f3590c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f35913 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560961.661737:0:22728:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caffca49a00/0x4642c20bf2f3590c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f35913 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560961.661743:0:22728:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787560961.661820:0:22728:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caffca49a00/0x4642c20bf2f3590c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35913 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.661837:0:22728:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787560961.661859:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caffca49a00/0x4642c20bf2f3590c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35913 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.661866:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caffca49a00/0x4642c20bf2f3590c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35913 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.661878:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1787560961.661882:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7e65c7c/0x4642c20bf2f359d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.661890:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880400 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560961.661894:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7e65c7c/0x4642c20bf2f359d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.661902:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7e65c7c/0x4642c20bf2f359d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.661916:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7e65c7c/0x4642c20bf2f359d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.661923:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7e65c7c/0x4642c20bf2f359d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.661937:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1787560961.661941:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caec3880c00/0x4642c20bf2f358fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f35905 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.661956:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3880c00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:0.0:1787560961.661959:0:22728:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caec3880c00/0x4642c20bf2f358fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f35905 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.661965:0:22728:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caec3880c00/0x4642c20bf2f358fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f35905 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787560961.661970:0:22728:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caec3880c00/0x4642c20bf2f358fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f35905 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560961.661975:0:22728:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787560961.661999:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000346beb99/0x4642c20bf2f35a08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.662010:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1787560961.662495:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560961.662502:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002490e79c/0x4642c20bf2f35a0f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.662511:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=680s v=(0 0) 00010000:00010000:1.0:1787560961.662515:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560961.662520:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002490e79c/0x4642c20bf2f35a0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.662530:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002490e79c/0x4642c20bf2f35a0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.662560:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002490e79c/0x4642c20bf2f35a0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.662568:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002490e79c/0x4642c20bf2f35a0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.662577:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1787560961.663260:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560961.663266:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f4dd5ed/0x4642c20bf2f35a16 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.663276:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1787560961.663280:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560961.663284:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f4dd5ed/0x4642c20bf2f35a16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.663296:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f4dd5ed/0x4642c20bf2f35a16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.663303:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f4dd5ed/0x4642c20bf2f35a16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.663310:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f4dd5ed/0x4642c20bf2f35a16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.663330:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:1.0:1787560961.663520:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00000001:00000004:2.0:1787560961.665720:0:25062:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00010000:1.0:1787560961.667243:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560961.667256:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b24b114b/0x4642c20bf2f35a1d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.667273:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1787560961.667278:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560961.667285:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b24b114b/0x4642c20bf2f35a1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.667300:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b24b114b/0x4642c20bf2f35a1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.667310:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b24b114b/0x4642c20bf2f35a1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.667319:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b24b114b/0x4642c20bf2f35a1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.667330:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00080000:3.0:1787560961.668367:0:25062:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787560961.668374:0:25062:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787560961.668408:0:25062:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787560961.668479:0:25062:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.129@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787560961.668497:0:25062:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1787560961.668517:0:25062:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1787560961.669466:0:25062:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00002000:00010000:1.0:1787560961.669803:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560961.669811:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b1f6e53/0x4642c20bf2f35a24 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.669826:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1787560961.669836:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560961.669843:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b1f6e53/0x4642c20bf2f35a24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.669856:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b1f6e53/0x4642c20bf2f35a24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.669866:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b1f6e53/0x4642c20bf2f35a24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.669874:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b1f6e53/0x4642c20bf2f35a24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.669885:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:1.0:1787560961.673831:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560961.673845:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba72076c/0x4642c20bf2f35a2b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.673862:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1787560961.673867:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560961.673874:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba72076c/0x4642c20bf2f35a2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.673888:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba72076c/0x4642c20bf2f35a2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.673899:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba72076c/0x4642c20bf2f35a2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.673922:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba72076c/0x4642c20bf2f35a2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.673934:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00000020:00000004:3.0:1787560961.674352:0:25062:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787560961.675514:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c33dd467-64b2-4362-8604-d1a6489592bb:3626:1874392862951296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560961.675586:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787560961.676075:0:22728:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caec3880c00/0x4642c20bf2f358fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35905 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676086:0:22728:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787560961.676111:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caec3880c00/0x4642c20bf2f358fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35905 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676118:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caec3880c00/0x4642c20bf2f358fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35905 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560961.676143:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2005c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c33dd467-64b2-4362-8604-d1a6489592bb:3623:1874392862951424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560961.676170:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560961.676213:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862951296 00000100:00100000:0.0:1787560961.676219:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862951296 00010000:00010000:0.0:1787560961.676243:0:22727:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f35913 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f3590c expref: 24 pid: 22734 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560961.676276:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862951424 00000100:00100000:0.0:1787560961.676280:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862951424 00010000:00010000:0.0:1787560961.676292:0:22727:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f35905 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f358fe expref: 25 pid: 22735 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560961.676304:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787560961.676310:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2006300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c33dd467-64b2-4362-8604-d1a6489592bb+25:3626:x1874392862951296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787560961.676322:0:22727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560961.676327:0:22727:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f35913 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f3590c expref: 25 pid: 22734 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676337:0:22727:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f35913 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f3590c expref: 25 pid: 22734 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676351:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f35913 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f3590c expref: 25 pid: 22734 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676364:0:22727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560961.676401:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2006300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c33dd467-64b2-4362-8604-d1a6489592bb+24:3626:x1874392862951296:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560961.676408:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787560961.676423:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787560961.676457:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2004380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c33dd467-64b2-4362-8604-d1a6489592bb+23:3623:x1874392862951424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787560961.676465:0:22727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560961.676470:0:22727:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f35905 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f358fe expref: 23 pid: 22735 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676478:0:22727:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f35905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f358fe expref: 23 pid: 22735 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676495:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca49c00/0x4642c20bf2f35905 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f358fe expref: 23 pid: 22735 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676507:0:22727:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9caffca49800/0x4642c20bf2f359e5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676514:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca49800/0x4642c20bf2f359e5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787560961.676528:0:22727:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.019656380s 00010000:00010000:0.0:1787560961.676532:0:22727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9caffca49800/0x4642c20bf2f359e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676539:0:22727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9caffca49800/0x4642c20bf2f359e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676545:0:22727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9caffca49800/0x4642c20bf2f359e5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676552:0:22727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9caffca49800/0x4642c20bf2f359e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676559:0:22727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49800 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560961.676563:0:22727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9caffca49800/0x4642c20bf2f359e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676571:0:22727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9caffca49800/0x4642c20bf2f359e5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676585:0:22727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9caffca49800/0x4642c20bf2f359e5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676602:0:22727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787560961.676630:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2004380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c33dd467-64b2-4362-8604-d1a6489592bb+22:3623:x1874392862951424:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560961.676637:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787560961.676690:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c33dd467-64b2-4362-8604-d1a6489592bb:3626:1874392862951296:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787560961.676714:0:22756:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9caffca49800/0x4642c20bf2f359e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676722:0:22756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9caffca49800/0x4642c20bf2f359e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676728:0:22756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca49800/0x4642c20bf2f359e5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560961.676751:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2005c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c33dd467-64b2-4362-8604-d1a6489592bb:3623:1874392862951424:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787560961.676764:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:0.0:1787560961.676770:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000686f09a1/0x4642c20bf2f359de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676778:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ffc00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560961.676781:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000686f09a1/0x4642c20bf2f359de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676789:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000686f09a1/0x4642c20bf2f359de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676815:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000686f09a1/0x4642c20bf2f359de lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676821:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000686f09a1/0x4642c20bf2f359de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676839:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1787560961.676842:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005283323a/0x4642c20bf2f359ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676849:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021fe000 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560961.676853:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005283323a/0x4642c20bf2f359ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676860:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005283323a/0x4642c20bf2f359ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676870:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005283323a/0x4642c20bf2f359ec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676878:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005283323a/0x4642c20bf2f359ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676891:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1787560961.676895:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e17b388a/0x4642c20bf2f359f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676907:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ff000 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560961.676910:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e17b388a/0x4642c20bf2f359f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676918:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e17b388a/0x4642c20bf2f359f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676927:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e17b388a/0x4642c20bf2f359f3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676935:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e17b388a/0x4642c20bf2f359f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676948:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1787560961.676951:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022e470e6/0x4642c20bf2f359fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676958:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021fec00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560961.676961:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022e470e6/0x4642c20bf2f359fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676968:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022e470e6/0x4642c20bf2f359fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676977:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022e470e6/0x4642c20bf2f359fa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.676989:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022e470e6/0x4642c20bf2f359fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677002:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1787560961.677006:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb829444/0x4642c20bf2f35a01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677012:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ff800 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560961.677015:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb829444/0x4642c20bf2f35a01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677023:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb829444/0x4642c20bf2f35a01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677033:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb829444/0x4642c20bf2f35a01 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677041:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb829444/0x4642c20bf2f35a01 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677052:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787560961.677055:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000346beb99/0x4642c20bf2f35a08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677061:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021fe400 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560961.677070:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000346beb99/0x4642c20bf2f35a08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677077:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000346beb99/0x4642c20bf2f35a08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677087:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000346beb99/0x4642c20bf2f35a08 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677094:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000346beb99/0x4642c20bf2f35a08 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677107:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787560961.677110:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002490e79c/0x4642c20bf2f35a0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677116:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ff600 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560961.677118:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002490e79c/0x4642c20bf2f35a0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677125:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002490e79c/0x4642c20bf2f35a0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677134:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002490e79c/0x4642c20bf2f35a0f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677141:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002490e79c/0x4642c20bf2f35a0f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677160:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787560961.677164:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f4dd5ed/0x4642c20bf2f35a16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677170:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ffe00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560961.677173:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f4dd5ed/0x4642c20bf2f35a16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677180:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f4dd5ed/0x4642c20bf2f35a16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677190:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f4dd5ed/0x4642c20bf2f35a16 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677197:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f4dd5ed/0x4642c20bf2f35a16 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677209:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787560961.677213:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b24b114b/0x4642c20bf2f35a1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677218:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021fee00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560961.677221:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b24b114b/0x4642c20bf2f35a1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677241:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b24b114b/0x4642c20bf2f35a1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677251:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b24b114b/0x4642c20bf2f35a1d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677257:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b24b114b/0x4642c20bf2f35a1d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677282:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787560961.677286:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b1f6e53/0x4642c20bf2f35a24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677293:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ff400 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560961.677296:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b1f6e53/0x4642c20bf2f35a24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677306:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b1f6e53/0x4642c20bf2f35a24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677315:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b1f6e53/0x4642c20bf2f35a24 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677321:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b1f6e53/0x4642c20bf2f35a24 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677347:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560961.677350:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba72076c/0x4642c20bf2f35a2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677357:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021fe800 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560961.677360:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba72076c/0x4642c20bf2f35a2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677368:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba72076c/0x4642c20bf2f35a2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677377:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba72076c/0x4642c20bf2f35a2b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677383:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba72076c/0x4642c20bf2f35a2b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.677396:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560961.677397:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560961.677399:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787560961.678547:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787560961.678559:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4ff8c50/0x4642c20bf2f35a32 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.678575:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1787560961.678643:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560961.678652:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4ff8c50/0x4642c20bf2f35a32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.678675:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4ff8c50/0x4642c20bf2f35a32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.678686:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4ff8c50/0x4642c20bf2f35a32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.678693:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4ff8c50/0x4642c20bf2f35a32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.678712:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787560961.678987:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560961.678994:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4ff8c50/0x4642c20bf2f35a32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.679003:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3089200 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560961.679007:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4ff8c50/0x4642c20bf2f35a32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.679015:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4ff8c50/0x4642c20bf2f35a32 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.679032:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4ff8c50/0x4642c20bf2f35a32 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.679040:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4ff8c50/0x4642c20bf2f35a32 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.679058:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560961.679060:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560961.679062:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787560961.679214:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787560961.679220:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008aa2dc43/0x4642c20bf2f35a39 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.679230:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1787560961.679233:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560961.679238:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008aa2dc43/0x4642c20bf2f35a39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.679248:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008aa2dc43/0x4642c20bf2f35a39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.679256:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008aa2dc43/0x4642c20bf2f35a39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.679270:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008aa2dc43/0x4642c20bf2f35a39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.682723:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787560961.687014:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787560961.687026:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088199bba/0x4642c20bf2f35a40 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.687043:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1787560961.687047:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560961.687054:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088199bba/0x4642c20bf2f35a40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.687069:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088199bba/0x4642c20bf2f35a40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.687081:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088199bba/0x4642c20bf2f35a40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.687090:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088199bba/0x4642c20bf2f35a40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.687966:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787560961.687983:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008aa2dc43/0x4642c20bf2f35a39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.687994:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3088200 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560961.687999:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008aa2dc43/0x4642c20bf2f35a39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.688010:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008aa2dc43/0x4642c20bf2f35a39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.688029:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008aa2dc43/0x4642c20bf2f35a39 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.688035:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008aa2dc43/0x4642c20bf2f35a39 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.689344:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560961.689353:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088199bba/0x4642c20bf2f35a40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.689364:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3088800 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560961.689368:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088199bba/0x4642c20bf2f35a40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.689377:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088199bba/0x4642c20bf2f35a40 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.689406:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088199bba/0x4642c20bf2f35a40 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.689415:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560961.689417:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560961.689420:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560961.689911:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560961.689914:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560961.689917:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560961.689974:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787560961.689986:0:24248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088199bba/0x4642c20bf2f35a40 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.690393:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016c3ba0b/0x4642c20bf2f359d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.690404:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021fe600 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560961.690407:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016c3ba0b/0x4642c20bf2f359d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.690416:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016c3ba0b/0x4642c20bf2f359d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.690479:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016c3ba0b/0x4642c20bf2f359d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.690488:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016c3ba0b/0x4642c20bf2f359d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560961.690508:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560961.690510:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560961.690511:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787560961.690750:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787560961.690757:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009de69ca/0x4642c20bf2f35a47 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.690769:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1787560961.690773:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560961.690780:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009de69ca/0x4642c20bf2f35a47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.690792:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009de69ca/0x4642c20bf2f35a47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.690801:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009de69ca/0x4642c20bf2f35a47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.690809:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009de69ca/0x4642c20bf2f35a47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.690828:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560961.691072:0:25080:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560961.691080:0:25080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009de69ca/0x4642c20bf2f35a47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560961.691089:0:25080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3089400 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560961.691092:0:25080:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009de69ca/0x4642c20bf2f35a47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560961.691101:0:25080:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009de69ca/0x4642c20bf2f35a47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560961.691116:0:25080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009de69ca/0x4642c20bf2f35a47 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560961.691124:0:25080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009de69ca/0x4642c20bf2f35a47 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560961.691139:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560961.691141:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560961.691143:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787560961.691778:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787560961.691785:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5274811/0x4642c20bf2f35a4e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.691794:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1787560961.691798:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560961.691811:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5274811/0x4642c20bf2f35a4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.691821:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5274811/0x4642c20bf2f35a4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.691830:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5274811/0x4642c20bf2f35a4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.691837:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5274811/0x4642c20bf2f35a4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.691855:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787560961.692716:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787560961.692724:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000801ac15a/0x4642c20bf2f35a55 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.692734:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1787560961.692738:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560961.692742:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000801ac15a/0x4642c20bf2f35a55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.692752:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000801ac15a/0x4642c20bf2f35a55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.692761:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000801ac15a/0x4642c20bf2f35a55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.692783:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000801ac15a/0x4642c20bf2f35a55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.692797:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787560961.694792:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787560961.694804:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c944aeb/0x4642c20bf2f35a5c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.694821:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1787560961.694824:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560961.694830:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c944aeb/0x4642c20bf2f35a5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.694842:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c944aeb/0x4642c20bf2f35a5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.694852:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c944aeb/0x4642c20bf2f35a5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.694860:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c944aeb/0x4642c20bf2f35a5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.694871:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787560961.698937:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787560961.698949:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc23c02b/0x4642c20bf2f35a63 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.698976:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1787560961.698981:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560961.698988:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc23c02b/0x4642c20bf2f35a63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.699003:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc23c02b/0x4642c20bf2f35a63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.699013:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc23c02b/0x4642c20bf2f35a63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.699021:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc23c02b/0x4642c20bf2f35a63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.699034:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1787560961.699238:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787560961.699246:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5274811/0x4642c20bf2f35a4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.699255:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3088000 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560961.699260:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5274811/0x4642c20bf2f35a4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.699269:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5274811/0x4642c20bf2f35a4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.699301:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5274811/0x4642c20bf2f35a4e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.699309:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5274811/0x4642c20bf2f35a4e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.699330:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787560961.699334:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000801ac15a/0x4642c20bf2f35a55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.699340:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3089800 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560961.699344:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000801ac15a/0x4642c20bf2f35a55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.699350:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000801ac15a/0x4642c20bf2f35a55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.699359:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000801ac15a/0x4642c20bf2f35a55 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.699366:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000801ac15a/0x4642c20bf2f35a55 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.699378:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787560961.699381:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c944aeb/0x4642c20bf2f35a5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.699393:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3089c00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560961.699397:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c944aeb/0x4642c20bf2f35a5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.699404:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c944aeb/0x4642c20bf2f35a5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.699415:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c944aeb/0x4642c20bf2f35a5c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.699422:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c944aeb/0x4642c20bf2f35a5c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.699478:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560961.699482:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc23c02b/0x4642c20bf2f35a63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.699489:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3088600 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560961.699492:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc23c02b/0x4642c20bf2f35a63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.699498:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc23c02b/0x4642c20bf2f35a63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.699508:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc23c02b/0x4642c20bf2f35a63 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.699522:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc23c02b/0x4642c20bf2f35a63 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.699550:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560961.699552:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560961.699553:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560961.699561:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560961.699567:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787560961.700982:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787560961.700992:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060aa096b/0x4642c20bf2f35a6a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.701007:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1787560961.701012:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560961.701019:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060aa096b/0x4642c20bf2f35a6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.701030:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060aa096b/0x4642c20bf2f35a6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.701041:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060aa096b/0x4642c20bf2f35a6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.701049:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060aa096b/0x4642c20bf2f35a6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.701083:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787560961.701272:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560961.701279:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060aa096b/0x4642c20bf2f35a6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.701286:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3088c00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560961.701291:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060aa096b/0x4642c20bf2f35a6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.701300:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060aa096b/0x4642c20bf2f35a6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.701315:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060aa096b/0x4642c20bf2f35a6a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.701321:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060aa096b/0x4642c20bf2f35a6a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.701352:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560961.701354:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560961.701355:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787560961.703474:0:24248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787560961.703488:0:24248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f184f022/0x4642c20bf2f35a71 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.703502:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1787560961.703512:0:24248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560961.703519:0:24248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f184f022/0x4642c20bf2f35a71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.703532:0:24248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f184f022/0x4642c20bf2f35a71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.703543:0:24248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f184f022/0x4642c20bf2f35a71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.703550:0:24248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f184f022/0x4642c20bf2f35a71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.703566:0:24248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1787560961.703646:0:24248:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:0.0:1787560961.703751:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22765:x1874392862949760:12345-0@lo:5:osp-pre-0-0.0 Request processed in 114650us (114809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560961.703761:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1787560961.703791:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560961.703798:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f184f022/0x4642c20bf2f35a71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.703807:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3089a00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560961.703812:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f184f022/0x4642c20bf2f35a71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.703821:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f184f022/0x4642c20bf2f35a71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.703845:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f184f022/0x4642c20bf2f35a71 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.703852:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f184f022/0x4642c20bf2f35a71 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560961.703866:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560961.703868:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560961.703870:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560961.704008:0:22765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48f9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22765:1874392862949760:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787560961.704025:0:22765:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:3.0:1787560961.704067:0:22765:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48f9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22765:1874392862951552:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787560961.704109:0:22765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560961.704143:0:22765:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffc8c5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787560961.704521:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862951552 00000100:00100000:0.0:1787560961.704528:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862951552 00000100:00100000:0.0:1787560961.704574:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787560961.704583:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22765:x1874392862951552:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787560961.704716:0:24249:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:3.0:1787560961.718659:0:24244:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:3.0:1787560961.718722:0:24244:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787560961.722192:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22765:x1874392862951552:12345-0@lo:5:osp-pre-0-0.0 Request processed in 17602us (18074us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1787560961.722207:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787560961.731660:0:22765:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1787560961.731687:0:22765:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48f9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22765:1874392862951552:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787560961.731705:0:22765:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000040:00080000:2.0:1787560962.420215:0:23495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787560962.547590:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787560962.744104:0:22737:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787560962.744112:0:22737:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cafffe2b000 from 14 10000000:01000000:0.0:1787560962.744117:0:22737:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787560962.744159:0:22737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3088600/0x4642c20bf2f35a78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560962.744170:0:22737:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caec3088600/0x4642c20bf2f35a78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560962.744192:0:22737:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caec3088600/0x4642c20bf2f35a78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560962.744218:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2005c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862951680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787560962.744281:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560962.744328:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc47a3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787560962.745252:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862951680 00000100:00100000:3.0:1787560962.745264:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862951680 00000100:00100000:3.0:1787560962.745313:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787560962.745322:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+22:22737:x1874392862951680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787560962.745336:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560962.745350:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafda2f6a00/0x4642c20bf2f35a7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f35a78 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560962.745372:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafda2f6a00/0x4642c20bf2f35a7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f35a78 expref: 23 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560962.745383:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafda2f6a00/0x4642c20bf2f35a7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35a78 expref: 23 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560962.745393:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafda2f6a00, rc 0) 00000100:00100000:3.0:1787560962.745475:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+23:22737:x1874392862951680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560962.745482:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787560962.745604:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2005c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862951680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560962.745631:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caec3088600/0x4642c20bf2f35a78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35a7f expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560962.745641:0:22737:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caec3088600/0x4642c20bf2f35a78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35a7f expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560962.745701:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862951808:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787560962.745733:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560962.745757:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc1370d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787560962.745771:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862951808 00000100:00100000:1.0:1787560962.745774:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862951808 00000100:00100000:1.0:1787560962.745798:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787560962.745805:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+23:22737:x1874392862951808:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787560962.745818:0:22733:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787560962.745835:0:22733:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787560962.745839:0:22733:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1787560962.745908:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+23:22737:x1874392862951808:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 103us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560962.745915:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787560962.745952:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862951808:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787560962.746032:0:22737:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787560962.746038:0:22737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3088600/0x4642c20bf2f35a78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35a7f expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560962.746046:0:22737:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caec3088600/0x4642c20bf2f35a78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35a7f expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787560962.746064:0:22737:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787560962.746066:0:22737:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9caffcb60800 from 14 10000000:01000000:1.0:1787560962.746069:0:22737:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787560962.746086:0:22737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff400/0x4642c20bf2f35a86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560962.746094:0:22737:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff400/0x4642c20bf2f35a86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560962.746102:0:22737:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff400/0x4642c20bf2f35a86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560962.746113:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862951936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787560962.746135:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560962.746147:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc1370d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787560962.746157:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862951936 00000100:00100000:1.0:1787560962.746160:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862951936 00000100:00100000:1.0:1787560962.746175:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787560962.746180:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+23:22737:x1874392862951936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560962.746186:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560962.746194:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cb0021fee00/0x4642c20bf2f35a8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f35a86 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560962.746207:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cb0021fee00/0x4642c20bf2f35a8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f35a86 expref: 24 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560962.746215:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cb0021fee00/0x4642c20bf2f35a8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35a86 expref: 24 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560962.746231:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb0021fee00, rc 0) 00000100:00100000:1.0:1787560962.746255:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+24:22737:x1874392862951936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560962.746261:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787560962.746286:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862951936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560962.746295:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff400/0x4642c20bf2f35a86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35a8d expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560962.746303:0:22737:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff400/0x4642c20bf2f35a86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35a8d expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560962.746334:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862952064:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787560962.746356:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560962.746366:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd3214000 going to sleep for 11 seconds 00000100:00100000:1.0:1787560962.746375:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862952064 00000100:00100000:1.0:1787560962.746378:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862952064 00000100:00100000:1.0:1787560962.746397:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787560962.746402:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+24:22737:x1874392862952064:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787560962.746410:0:22733:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787560962.746420:0:22733:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787560962.746423:0:22733:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1787560962.746500:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+24:22737:x1874392862952064:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 97us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560962.746507:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787560962.746530:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862952064:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787560962.746573:0:22737:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787560962.746578:0:22737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff400/0x4642c20bf2f35a86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35a8d expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560962.746585:0:22737:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cb0021ff400/0x4642c20bf2f35a86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35a8d expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:2.0:1787560962.822194:0:25130:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787560962.822401:0:25130:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787560963.571616:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560964.596694:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560965.621033:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560965.693400:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787560965.693424:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862952192:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787560965.693542:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560965.693597:0:24251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862952192 00000100:00100000:2.0:1787560965.693603:0:24251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862952192 00000100:00100000:2.0:1787560965.693668:0:24251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787560965.693678:0:24251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862952192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787560965.693708:0:24251:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787560965.693940:0:24251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862952192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 263us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560965.693949:0:24251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787560965.693970:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787560965.694008:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862952192:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787560966.644054:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560966.712587:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862952320:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560966.712666:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560966.712734:0:23481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862952320 00000100:00100000:3.0:1787560966.712741:0:23481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862952320 00000100:00100000:3.0:1787560966.712780:0:23481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787560966.712788:0:23481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862952320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787560966.712818:0:23481:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787560966.712856:0:23481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862952320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560966.712863:0:23481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787560966.712901:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862952320:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560966.713172:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862952448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787560966.713200:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560966.713271:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862952448 00000100:00100000:1.0:1787560966.713276:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862952448 00000100:00100000:1.0:1787560966.713310:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787560966.713316:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862952448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787560966.713336:0:22746:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787560966.713372:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862952448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560966.713377:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787560966.713458:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862952448:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1787560966.714729:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560966.714734:0:15403:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787560966.714737:0:15403:0:(import.c:65:import_set_state_nolock()) ffff9cafc58be000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787560966.714746:0:15403:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cafc58be000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560966.714766:0:15403:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caec3bad880 x1874392862952832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787560966.714799:0:15403:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787560966.714802:0:15403:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787560966.714804:0:15403:0:(import.c:65:import_set_state_nolock()) ffff9caec3383000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787560966.714807:0:15403:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9caec3383000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1787560966.714817:0:15403:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9caec3bad500 x1874392862953216/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787560966.714878:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c33dd467-64b2-4362-8604-d1a6489592bb:3623:1874392862952576:0@lo:400:kworker.0 00000100:00100000:2.0:1787560966.714932:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560966.714962:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862953344:0@lo:400:kworker.0 00000100:00100000:2.0:1787560966.714998:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560966.715014:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862953856:0@lo:400:kworker.0 00000100:00100000:2.0:1787560966.715038:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560966.715058:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787560966.715063:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862952704:0@lo:400:kworker.0 00000100:00100000:2.0:1787560966.715086:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560966.715100:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874392862953472:0@lo:400:kworker.0 00000100:00100000:2.0:1787560966.715119:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560966.715148:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862952832:0@lo:8:kworker.0 00000100:00100000:2.0:1787560966.715173:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560966.715198:0:3622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862953216:0@lo:8:kworker.0 00000100:00100000:2.0:1787560966.715216:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560966.715251:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862952576 00000100:00100000:2.0:1787560966.715257:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862952576 00000100:00100000:2.0:1787560966.715294:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787560966.715301:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+24:3623:x1874392862952576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560966.715336:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+24:3623:x1874392862952576:12345-0@lo:400:kworker.0 Request processed in 36us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560966.715342:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787560966.715367:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862953344 00000100:00100000:2.0:1787560966.715371:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862953344 00000100:00100000:2.0:1787560966.715386:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862953856 00000100:00100000:2.0:1787560966.715388:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862953856 00000100:00100000:2.0:1787560966.715408:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862953472 00000100:00100000:2.0:1787560966.715417:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862953472 00000100:00100000:2.0:1787560966.715460:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787560966.715466:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862953344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560966.715493:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1874392862953344:12345-0@lo:400:kworker.0 Request processed in 29us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560966.715499:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787560966.715508:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787560966.715513:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874392862953856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560966.715533:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1874392862953856:12345-0@lo:400:kworker.0 Request processed in 21us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560966.715538:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787560966.715546:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787560966.715550:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874392862953472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560966.715568:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1874392862953472:12345-0@lo:400:kworker.0 Request processed in 18us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560966.715573:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787560966.715594:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862952704 00000100:00100000:2.0:1787560966.715597:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862952704 00000100:00100000:2.0:1787560966.715620:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862952832 00000100:00100000:2.0:1787560966.715622:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862952832 00000100:00100000:2.0:1787560966.715630:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862953216 00000100:00100000:2.0:1787560966.715642:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862953216 00000100:00100000:2.0:1787560966.715651:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787560966.715657:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862952704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560966.715686:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862952704:12345-0@lo:400:kworker.0 Request processed in 30us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560966.715691:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787560966.715710:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787560966.715714:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1874392862952832:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787560966.715737:0:24250:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 686 last 0 00000020:00000080:2.0:1787560966.715762:0:24250:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4642c20bf2f35a94 00002000:00100000:2.0:1787560966.715776:0:24250:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9caec2338800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787560966.715780:0:24250:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787560966.715783:0:24250:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787560966.715943:0:24250:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787560966.715965:0:24250:0:(import.c:65:import_set_state_nolock()) ffff9caec233e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787560966.716001:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3622:x1874392862952832:12345-0@lo:8:kworker.0 Request processed in 285us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560966.716007:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787560966.716018:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787560966.716022:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1874392862953216:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787560966.716036:0:24250:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 686 last 0 00000020:00000080:2.0:1787560966.716051:0:24250:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4642c20bf2f35a9b 00002000:00100000:2.0:1787560966.716056:0:24250:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9caec233f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1787560966.716059:0:24250:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1787560966.716061:0:24250:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787560966.716082:0:24250:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1787560966.716094:0:24250:0:(import.c:65:import_set_state_nolock()) ffff9caec233a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787560966.716118:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3622:x1874392862953216:12345-0@lo:8:kworker.0 Request processed in 95us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560966.716123:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1787560966.716141:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787560966.716145:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787560966.716153:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787560966.716179:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3bad880 x1874392862952832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787560991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787560966.716192:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1787560966.716199:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787560966.716204:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787560966.716206:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9cafc58be000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787560966.716218:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787560966.716222:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1874392862952832:0@lo:8:kworker.0 00010000:00080000:2.0:1787560966.716232:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3bad500 x1874392862953216/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787560991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787560966.716239:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1787560966.716243:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787560966.716246:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787560966.716247:0:3622:0:(import.c:65:import_set_state_nolock()) ffff9caec3383000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787560966.716258:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787560966.716260:0:3622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1874392862953216:0@lo:8:kworker.0 00000004:00080000:2.0:1787560966.716302:0:22767:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1787560966.716317:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bad880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22767:1874392862954112:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787560966.716343:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560966.716358:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caff5227240 going to sleep for 11 seconds 00000004:00080000:2.0:1787560966.716370:0:22766:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787560966.716427:0:22766:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686055995069ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787560966.716453:0:22766:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1787560966.716567:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862953984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560966.716594:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560966.716627:0:24251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862953984 00000100:00100000:2.0:1787560966.716644:0:24251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862953984 00000100:00100000:2.0:1787560966.716674:0:24251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787560966.716681:0:24251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1874392862953984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787560966.716698:0:24251:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787560966.716733:0:24251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1874392862953984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560966.716738:0:24251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787560966.716753:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787560966.716768:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3bad500 x1874392862953984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560982 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560966.716780:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862953984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560966.716797:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862953088:0@lo:400:kworker.0 00000100:00100000:2.0:1787560966.716822:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560966.716840:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862953728:0@lo:400:kworker.0 00000100:00100000:2.0:1787560966.716867:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560966.717455:0:25074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862954112 00000100:00100000:1.0:1787560966.717459:0:25074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862954112 00000100:00100000:1.0:1787560966.717480:0:25074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862953088 00000100:00100000:1.0:1787560966.717484:0:25074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862953088 00000100:00100000:1.0:1787560966.717498:0:25074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787560966.717505:0:25074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862953088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560966.717545:0:25074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862953088:12345-0@lo:400:kworker.0 Request processed in 41us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560966.717550:0:25074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787560966.717575:0:25074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787560966.717581:0:25074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22767:x1874392862954112:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787560966.718250:0:23485:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787560966.718266:0:23485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23485:1874392862954496:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1787560966.718298:0:23485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560966.718330:0:23485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc447e540 going to sleep for 11 seconds 00000004:00080000:0.0:1787560966.718346:0:23484:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787560966.718414:0:23484:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 686057982997ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787560966.718420:0:23484:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1787560966.719183:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862954496 00000100:00100000:1.0:1787560966.719193:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862954496 00000100:00100000:1.0:1787560966.719242:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787560966.719250:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23485:x1874392862954496:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1787560966.722217:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862952960:0@lo:400:kworker.0 00000100:00100000:3.0:1787560966.722289:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560966.722329:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862953600:0@lo:400:kworker.0 00000100:00100000:3.0:1787560966.722351:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560966.722376:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862954240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787560966.722401:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560966.722426:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787560966.722452:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862954368:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787560966.722473:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560966.722525:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862952704:0@lo:400:kworker.0 00010000:00080000:3.0:1787560966.722542:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3baf100 x1874392862953472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560966.722580:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1874392862953472:0@lo:400:kworker.0 00000100:00100000:3.0:1787560966.722594:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c33dd467-64b2-4362-8604-d1a6489592bb:3623:1874392862952576:0@lo:400:kworker.0 00010000:00080000:3.0:1787560966.722606:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3baf800 x1874392862953344/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560966.722613:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1874392862953344:0@lo:400:kworker.0 00010000:00080000:3.0:1787560966.722627:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3baed80 x1874392862953856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560966.722647:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1874392862953856:0@lo:400:kworker.0 00000100:00100000:2.0:1787560966.723305:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862953728 00000100:00100000:2.0:1787560966.723315:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862953728 00000100:00100000:2.0:1787560966.723354:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862952960 00000100:00100000:2.0:1787560966.723357:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862952960 00000100:00100000:2.0:1787560966.723368:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862953600 00000100:00100000:2.0:1787560966.723370:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862953600 00000100:00100000:2.0:1787560966.723386:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787560966.723394:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862953728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560966.723481:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862953728:12345-0@lo:400:kworker.0 Request processed in 87us (6611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560966.723488:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787560966.723513:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787560966.723519:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862952960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560966.723550:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1874392862952960:12345-0@lo:400:kworker.0 Request processed in 31us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560966.723555:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787560966.723721:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787560966.723730:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862953600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560966.723769:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862953600:12345-0@lo:400:kworker.0 Request processed in 42us (1418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560966.723775:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000004:00080000:1.0:1787560966.724098:0:23473:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1787560966.725806:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862954240 00000100:00100000:2.0:1787560966.725821:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862954240 00000100:00100000:2.0:1787560966.725859:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862954368 00000100:00100000:2.0:1787560966.725862:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862954368 00000100:00100000:2.0:1787560966.725879:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787560966.725889:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862954240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787560966.725914:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00010000:00080000:3.0:1787560966.728095:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3bac700 x1874392862952960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560966.728114:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1874392862952960:0@lo:400:kworker.0 00010000:00080000:3.0:1787560966.728129:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3bac000 x1874392862953600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560966.728139:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862953600:0@lo:400:kworker.0 00000100:00100000:3.0:1787560966.728162:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862954240:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1787560966.729462:0:22720:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1787560966.730269:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862954240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4376us (7861us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560966.730280:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787560966.730309:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787560966.730321:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3625:x1874392862954368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787560966.730343:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787560966.730404:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3625:x1874392862954368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (7928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560966.730410:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787560966.730444:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787560966.730449:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787560966.730452:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787560966.730534:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec3baea00 x1874392862953728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560966.730549:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862953728:0@lo:400:kworker.0 00000100:00100000:2.0:1787560966.730600:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862953088:0@lo:400:kworker.0 00010000:00080000:3.0:1787560966.731314:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2005180 x1874392862954368/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787560982 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560966.731333:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862954368:0@lo:13:osp-pre-1-1.0 00002000:00080000:1.0:1787560966.731884:0:25074:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1787560966.731894:0:25074:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:1.0:1787560966.731899:0:25074:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:65) 00002000:00080000:2.0:1787560966.757626:0:24248:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1787560966.757646:0:24248:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1787560966.757748:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23485:x1874392862954496:12345-0@lo:7:osp-pre-1-1.0 Request processed in 38493us (39443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560966.757759:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1787560966.759766:0:23485:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2004a80 x1874392862954496/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787560982 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560966.759783:0:23485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23485:1874392862954496:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1787560966.759809:0:23485:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1787560966.759849:0:23485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23485:1874392862954624:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1787560966.759904:0:23485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560966.759992:0:23485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc447e540 going to sleep for 11 seconds 00002000:00010000:3.0:1787560966.768837:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787560966.768861:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000781facdb/0x4642c20bf2f35aa2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.768881:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1787560966.768886:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560966.768893:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000781facdb/0x4642c20bf2f35aa2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.768914:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000781facdb/0x4642c20bf2f35aa2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.768929:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000781facdb/0x4642c20bf2f35aa2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.768936:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000781facdb/0x4642c20bf2f35aa2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.768957:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787560966.769501:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787560966.769509:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aee1464/0x4642c20bf2f35aa9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.769519:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1787560966.769522:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560966.769527:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000aee1464/0x4642c20bf2f35aa9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.769537:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000aee1464/0x4642c20bf2f35aa9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.769552:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aee1464/0x4642c20bf2f35aa9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.769569:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000aee1464/0x4642c20bf2f35aa9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.769584:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787560966.769697:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787560966.769704:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000781facdb/0x4642c20bf2f35aa2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.769712:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6000 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560966.769717:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000781facdb/0x4642c20bf2f35aa2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.769726:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000781facdb/0x4642c20bf2f35aa2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.769742:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000781facdb/0x4642c20bf2f35aa2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.769748:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000781facdb/0x4642c20bf2f35aa2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.769768:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560966.769777:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000aee1464/0x4642c20bf2f35aa9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.769783:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6200 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560966.769786:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000aee1464/0x4642c20bf2f35aa9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.769793:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000aee1464/0x4642c20bf2f35aa9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.769802:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000aee1464/0x4642c20bf2f35aa9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.769808:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000aee1464/0x4642c20bf2f35aa9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.769818:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560966.769820:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560966.769821:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787560966.770123:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787560966.770131:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000783c6363/0x4642c20bf2f35ab0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.770140:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1787560966.770144:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560966.770148:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000783c6363/0x4642c20bf2f35ab0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.770172:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000783c6363/0x4642c20bf2f35ab0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.770180:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000783c6363/0x4642c20bf2f35ab0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.770187:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000783c6363/0x4642c20bf2f35ab0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.770200:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787560966.770686:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787560966.770693:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bf181f6/0x4642c20bf2f35ab7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.770703:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1787560966.770706:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560966.770710:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bf181f6/0x4642c20bf2f35ab7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.770719:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bf181f6/0x4642c20bf2f35ab7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.770727:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bf181f6/0x4642c20bf2f35ab7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.770745:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bf181f6/0x4642c20bf2f35ab7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.770760:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787560966.771093:0:25080:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787560966.771099:0:25080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000783c6363/0x4642c20bf2f35ab0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.771115:0:25080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7c00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560966.771118:0:25080:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000783c6363/0x4642c20bf2f35ab0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.771127:0:25080:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000783c6363/0x4642c20bf2f35ab0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.771144:0:25080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000783c6363/0x4642c20bf2f35ab0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.771150:0:25080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000783c6363/0x4642c20bf2f35ab0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.771170:0:25080:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560966.771174:0:25080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bf181f6/0x4642c20bf2f35ab7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.771180:0:25080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6600 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560966.771183:0:25080:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bf181f6/0x4642c20bf2f35ab7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.771189:0:25080:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bf181f6/0x4642c20bf2f35ab7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.771197:0:25080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bf181f6/0x4642c20bf2f35ab7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.771210:0:25080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bf181f6/0x4642c20bf2f35ab7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.771224:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560966.771226:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560966.771227:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560966.771235:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787560966.772185:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787560966.772195:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab9165b8/0x4642c20bf2f35abe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.772207:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1787560966.772211:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560966.772216:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab9165b8/0x4642c20bf2f35abe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.772227:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab9165b8/0x4642c20bf2f35abe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.772236:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab9165b8/0x4642c20bf2f35abe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.772244:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab9165b8/0x4642c20bf2f35abe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.772261:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787560966.772644:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862954624 00000100:00100000:2.0:1787560966.772655:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862954624 00002000:00010000:3.0:1787560966.773221:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787560966.773229:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025a16cb0/0x4642c20bf2f35ac5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.773248:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1787560966.773251:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560966.773256:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025a16cb0/0x4642c20bf2f35ac5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.773266:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025a16cb0/0x4642c20bf2f35ac5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.773274:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025a16cb0/0x4642c20bf2f35ac5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.773280:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025a16cb0/0x4642c20bf2f35ac5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.773302:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787560966.773601:0:25080:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787560966.773608:0:25080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab9165b8/0x4642c20bf2f35abe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.773617:0:25080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7600 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:2.0:1787560966.773622:0:25080:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab9165b8/0x4642c20bf2f35abe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.773639:0:25080:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab9165b8/0x4642c20bf2f35abe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.773659:0:25080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab9165b8/0x4642c20bf2f35abe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.773666:0:25080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab9165b8/0x4642c20bf2f35abe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.773684:0:25080:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560966.773687:0:25080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025a16cb0/0x4642c20bf2f35ac5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.773699:0:25080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6c00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:2.0:1787560966.773703:0:25080:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025a16cb0/0x4642c20bf2f35ac5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.773710:0:25080:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025a16cb0/0x4642c20bf2f35ac5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.773723:0:25080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025a16cb0/0x4642c20bf2f35ac5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.773729:0:25080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025a16cb0/0x4642c20bf2f35ac5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.773743:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560966.773744:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560966.773745:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560966.773751:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560966.775462:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787560966.776369:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787560966.776380:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f7c062b/0x4642c20bf2f35acc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.776397:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1787560966.776402:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560966.776409:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f7c062b/0x4642c20bf2f35acc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.776422:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f7c062b/0x4642c20bf2f35acc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.776469:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f7c062b/0x4642c20bf2f35acc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.776476:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f7c062b/0x4642c20bf2f35acc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.776500:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787560966.779221:0:25080:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560966.779235:0:25080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f7c062b/0x4642c20bf2f35acc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.779249:0:25080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6400 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560966.779254:0:25080:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f7c062b/0x4642c20bf2f35acc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.779264:0:25080:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f7c062b/0x4642c20bf2f35acc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.779283:0:25080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f7c062b/0x4642c20bf2f35acc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.779291:0:25080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f7c062b/0x4642c20bf2f35acc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.779319:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560966.779321:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560966.779333:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787560966.780219:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787560966.780228:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ced6c18a/0x4642c20bf2f35ad3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.780240:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1787560966.780245:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560966.780251:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ced6c18a/0x4642c20bf2f35ad3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.780261:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ced6c18a/0x4642c20bf2f35ad3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.780270:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ced6c18a/0x4642c20bf2f35ad3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.780276:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ced6c18a/0x4642c20bf2f35ad3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.780312:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787560966.780708:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560966.780715:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ced6c18a/0x4642c20bf2f35ad3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.780725:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7400 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560966.780729:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ced6c18a/0x4642c20bf2f35ad3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.780739:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ced6c18a/0x4642c20bf2f35ad3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.780754:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ced6c18a/0x4642c20bf2f35ad3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.780762:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ced6c18a/0x4642c20bf2f35ad3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.780781:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560966.780782:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560966.780784:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787560966.781663:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787560966.781671:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6ae3620/0x4642c20bf2f35ada lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.781683:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1787560966.781687:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560966.781691:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6ae3620/0x4642c20bf2f35ada lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.781702:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6ae3620/0x4642c20bf2f35ada lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.781711:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6ae3620/0x4642c20bf2f35ada lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.781719:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6ae3620/0x4642c20bf2f35ada lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.783644:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787560966.783916:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787560966.783926:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23485:x1874392862954624:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1787560966.783954:0:24250:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00002000:00010000:3.0:1787560966.784292:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787560966.784300:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b0254cb/0x4642c20bf2f35ae1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.784319:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1787560966.784324:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560966.784329:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b0254cb/0x4642c20bf2f35ae1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.784342:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b0254cb/0x4642c20bf2f35ae1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.784352:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b0254cb/0x4642c20bf2f35ae1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.784361:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b0254cb/0x4642c20bf2f35ae1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560966.785845:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23485:x1874392862954624:12345-0@lo:5:osp-pre-1-1.0 Request processed in 1913us (25933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560966.785857:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787560966.785962:0:23485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23485:1874392862954624:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1787560966.785988:0:23485:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1787560966.786032:0:23485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb09f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23485:1874392862954752:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1787560966.786069:0:23485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560966.786099:0:23485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caffbb62600 going to sleep for 11 seconds 00000100:00100000:2.0:1787560966.786294:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862954752 00000100:00100000:2.0:1787560966.786301:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862954752 00000100:00100000:2.0:1787560966.786345:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787560966.786353:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23485:x1874392862954752:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1787560966.786384:0:24248:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00010000:00010000:0.0:1787560966.794054:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787560966.794068:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6ae3620/0x4642c20bf2f35ada lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.794149:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f7200 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560966.794156:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6ae3620/0x4642c20bf2f35ada lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.794181:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6ae3620/0x4642c20bf2f35ada lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.794203:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6ae3620/0x4642c20bf2f35ada lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.794211:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6ae3620/0x4642c20bf2f35ada lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.794379:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560966.794384:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b0254cb/0x4642c20bf2f35ae1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.794392:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc0030600 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560966.794396:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b0254cb/0x4642c20bf2f35ae1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.794404:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b0254cb/0x4642c20bf2f35ae1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.794415:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b0254cb/0x4642c20bf2f35ae1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.794423:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560966.794425:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560966.794448:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560966.803063:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560966.803108:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787560966.803120:0:25074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b0254cb/0x4642c20bf2f35ae1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787560966.804452:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787560966.804463:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f39b93b9/0x4642c20bf2f35ae8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.804476:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1787560966.804480:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560966.804486:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f39b93b9/0x4642c20bf2f35ae8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.804511:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f39b93b9/0x4642c20bf2f35ae8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.804520:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f39b93b9/0x4642c20bf2f35ae8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.804528:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f39b93b9/0x4642c20bf2f35ae8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.804545:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787560966.807467:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560966.807480:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f39b93b9/0x4642c20bf2f35ae8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.807492:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc0031000 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560966.807498:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f39b93b9/0x4642c20bf2f35ae8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.807517:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f39b93b9/0x4642c20bf2f35ae8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.807541:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f39b93b9/0x4642c20bf2f35ae8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.807549:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f39b93b9/0x4642c20bf2f35ae8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.807571:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560966.807573:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560966.807575:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787560966.809427:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560966.809460:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb829444/0x4642c20bf2f35aef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.809474:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787560966.809479:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560966.809486:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb829444/0x4642c20bf2f35aef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.809500:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb829444/0x4642c20bf2f35aef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.809509:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb829444/0x4642c20bf2f35aef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.809523:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb829444/0x4642c20bf2f35aef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.809540:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787560966.810157:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560966.810163:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022e470e6/0x4642c20bf2f35af6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.810174:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787560966.810177:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560966.810182:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022e470e6/0x4642c20bf2f35af6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.810190:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022e470e6/0x4642c20bf2f35af6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.810197:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022e470e6/0x4642c20bf2f35af6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.810203:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022e470e6/0x4642c20bf2f35af6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.810218:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787560966.811708:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560966.811720:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e17b388a/0x4642c20bf2f35afd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.811742:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787560966.811746:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560966.811751:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e17b388a/0x4642c20bf2f35afd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.811763:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e17b388a/0x4642c20bf2f35afd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.811773:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e17b388a/0x4642c20bf2f35afd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.811781:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e17b388a/0x4642c20bf2f35afd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.811801:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787560966.812127:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787560966.812136:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb829444/0x4642c20bf2f35aef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.812145:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ff800 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560966.812164:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb829444/0x4642c20bf2f35aef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.812175:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb829444/0x4642c20bf2f35aef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.812194:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb829444/0x4642c20bf2f35aef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.812202:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb829444/0x4642c20bf2f35aef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.812232:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787560966.812237:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022e470e6/0x4642c20bf2f35af6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.812245:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021fec00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560966.812248:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022e470e6/0x4642c20bf2f35af6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.812258:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022e470e6/0x4642c20bf2f35af6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.812269:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022e470e6/0x4642c20bf2f35af6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.812276:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022e470e6/0x4642c20bf2f35af6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.812289:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560966.812293:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e17b388a/0x4642c20bf2f35afd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.812299:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ff000 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560966.812302:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e17b388a/0x4642c20bf2f35afd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.812321:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e17b388a/0x4642c20bf2f35afd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.812333:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e17b388a/0x4642c20bf2f35afd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.812341:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e17b388a/0x4642c20bf2f35afd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.812355:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560966.812356:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560966.812358:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787560966.813426:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787560966.813461:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edec9a00/0x4642c20bf2f35b04 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.813474:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1787560966.813478:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560966.813484:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edec9a00/0x4642c20bf2f35b04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.813496:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edec9a00/0x4642c20bf2f35b04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.813505:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edec9a00/0x4642c20bf2f35b04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.813522:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edec9a00/0x4642c20bf2f35b04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.813538:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787560966.813852:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560966.813858:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edec9a00/0x4642c20bf2f35b04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.813866:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc0031e00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560966.813870:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edec9a00/0x4642c20bf2f35b04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.813878:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edec9a00/0x4642c20bf2f35b04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.813906:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edec9a00/0x4642c20bf2f35b04 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.813912:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edec9a00/0x4642c20bf2f35b04 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.813931:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560966.813933:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560966.813934:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787560966.814764:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560966.814771:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f35b0b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.814783:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787560966.814787:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560966.814801:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f35b0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.814812:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f35b0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.814821:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f35b0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.814829:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f35b0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.814863:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560966.816453:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560966.816464:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f35b0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.816489:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021fe000 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560966.816494:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f35b0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.816506:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f35b0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.816527:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f35b0b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.816535:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f35b0b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.816568:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560966.816571:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560966.816572:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787560966.817709:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787560966.817729:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dac89b57/0x4642c20bf2f35b12 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.817745:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1787560966.817750:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560966.817757:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dac89b57/0x4642c20bf2f35b12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.817771:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dac89b57/0x4642c20bf2f35b12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.817782:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dac89b57/0x4642c20bf2f35b12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.817791:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dac89b57/0x4642c20bf2f35b12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.817821:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787560966.818207:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560966.818215:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dac89b57/0x4642c20bf2f35b12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.818223:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc0030e00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560966.818228:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dac89b57/0x4642c20bf2f35b12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.818238:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dac89b57/0x4642c20bf2f35b12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.818256:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dac89b57/0x4642c20bf2f35b12 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.818263:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dac89b57/0x4642c20bf2f35b12 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.818282:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560966.818284:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560966.818286:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787560966.818690:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560966.818697:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35b19 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.818705:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787560966.818715:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560966.818721:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35b19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.818732:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35b19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.818741:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35b19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.818748:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35b19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.818764:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560966.819072:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560966.819078:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35b19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.819086:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ffc00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560966.819089:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35b19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.819096:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35b19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.819117:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35b19 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.819123:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35b19 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.819139:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560966.819140:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560966.819142:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787560966.819330:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787560966.819337:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008941718a/0x4642c20bf2f35b20 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.819347:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=686s v=(0 0) 00010000:00010000:3.0:1787560966.819350:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560966.819355:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008941718a/0x4642c20bf2f35b20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.819365:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008941718a/0x4642c20bf2f35b20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.819373:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008941718a/0x4642c20bf2f35b20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.819381:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008941718a/0x4642c20bf2f35b20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.819415:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787560966.819822:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560966.819828:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008941718a/0x4642c20bf2f35b20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.819836:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc0031600 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560966.819840:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008941718a/0x4642c20bf2f35b20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.819849:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008941718a/0x4642c20bf2f35b20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.819861:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008941718a/0x4642c20bf2f35b20 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.819878:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008941718a/0x4642c20bf2f35b20 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.819895:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560966.819896:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560966.819898:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560966.831836:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560966.832009:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787560966.832565:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560966.832576:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aeb3be7a/0x4642c20bf2f35b27 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.832591:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787560966.832595:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560966.832601:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aeb3be7a/0x4642c20bf2f35b27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.832615:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aeb3be7a/0x4642c20bf2f35b27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.832625:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aeb3be7a/0x4642c20bf2f35b27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.832656:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aeb3be7a/0x4642c20bf2f35b27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.832674:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560966.835336:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560966.835349:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aeb3be7a/0x4642c20bf2f35b27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.835362:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ffa00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560966.835366:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aeb3be7a/0x4642c20bf2f35b27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.835376:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aeb3be7a/0x4642c20bf2f35b27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.835398:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aeb3be7a/0x4642c20bf2f35b27 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.835406:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aeb3be7a/0x4642c20bf2f35b27 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.835447:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560966.835449:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560966.835451:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787560966.836962:0:25063:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:3.0:1787560966.837220:0:25063:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1787560966.837227:0:25063:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787560966.837456:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23485:x1874392862954752:12345-0@lo:5:osp-pre-1-1.0 Request processed in 51072us (51355us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1787560966.837468:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787560966.837758:0:23485:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1787560966.837778:0:23485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb09f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23485:1874392862954752:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1787560966.837804:0:23485:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:3.0:1787560966.837860:0:23485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48fa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23485:1874392862954880:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1787560966.837902:0:23485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560966.837933:0:23485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec42ea900 going to sleep for 11 seconds 00000100:00100000:2.0:1787560966.837998:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862954880 00000100:00100000:2.0:1787560966.838005:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862954880 00000100:00100000:2.0:1787560966.838054:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787560966.838063:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec407d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23485:x1874392862954880:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1787560966.838115:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec407d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23485:x1874392862954880:12345-0@lo:900:osp-pre-1-1.0 Request processed in 53us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560966.838121:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787560966.838234:0:23485:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caff48fa300 x1874392862954880/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787560982 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560966.838245:0:23485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48fa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23485:1874392862954880:0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1787560966.841797:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560966.841817:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35b2e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.841835:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787560966.841839:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560966.841844:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35b2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.841858:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35b2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.841867:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35b2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.841875:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35b2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.841896:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787560966.841907:0:25080:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560966.841913:0:25080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35b2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.841921:0:25080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ffc00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560966.841925:0:25080:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35b2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.841934:0:25080:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35b2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.841957:0:25080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35b2e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.841964:0:25080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35b2e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.841994:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560966.841997:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560966.841998:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787560966.842494:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560966.842501:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f35b35 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.842511:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787560966.842515:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560966.842519:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f35b35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.842528:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f35b35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.842536:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f35b35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.842543:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f35b35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.842627:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787560966.843135:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787560966.843142:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f35b35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.843151:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021fe000 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560966.843155:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f35b35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.843164:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f35b35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.843177:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f35b35 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.843185:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005283323a/0x4642c20bf2f35b35 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.843202:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560966.843205:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560966.843206:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787560966.843717:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560966.843724:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e17b388a/0x4642c20bf2f35b3c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.843734:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787560966.843738:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560966.843742:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e17b388a/0x4642c20bf2f35b3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.843752:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e17b388a/0x4642c20bf2f35b3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.843761:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e17b388a/0x4642c20bf2f35b3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.843768:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e17b388a/0x4642c20bf2f35b3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.843785:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787560966.844112:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560966.844118:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e17b388a/0x4642c20bf2f35b3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.844126:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ff000 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560966.844130:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e17b388a/0x4642c20bf2f35b3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.844138:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e17b388a/0x4642c20bf2f35b3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.844151:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e17b388a/0x4642c20bf2f35b3c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.844158:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e17b388a/0x4642c20bf2f35b3c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.844184:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560966.844186:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560966.844187:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787560966.844261:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560966.844268:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022e470e6/0x4642c20bf2f35b43 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.844276:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787560966.844285:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560966.844290:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022e470e6/0x4642c20bf2f35b43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.844300:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022e470e6/0x4642c20bf2f35b43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.844307:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022e470e6/0x4642c20bf2f35b43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.844315:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022e470e6/0x4642c20bf2f35b43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.844339:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787560966.846781:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560966.846796:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb829444/0x4642c20bf2f35b4a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.846811:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787560966.846817:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560966.846824:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb829444/0x4642c20bf2f35b4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.846838:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb829444/0x4642c20bf2f35b4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.846848:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb829444/0x4642c20bf2f35b4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.846863:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb829444/0x4642c20bf2f35b4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.846878:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787560966.847091:0:25080:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787560966.847098:0:25080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022e470e6/0x4642c20bf2f35b43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.847106:0:25080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021fec00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560966.847110:0:25080:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022e470e6/0x4642c20bf2f35b43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.847119:0:25080:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022e470e6/0x4642c20bf2f35b43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.847137:0:25080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022e470e6/0x4642c20bf2f35b43 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.847143:0:25080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022e470e6/0x4642c20bf2f35b43 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.847162:0:25080:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560966.847165:0:25080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb829444/0x4642c20bf2f35b4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.847171:0:25080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ff800 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560966.847181:0:25080:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb829444/0x4642c20bf2f35b4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.847188:0:25080:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb829444/0x4642c20bf2f35b4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.847199:0:25080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb829444/0x4642c20bf2f35b4a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.847206:0:25080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb829444/0x4642c20bf2f35b4a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.847221:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560966.847222:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560966.847224:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560966.847294:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787560966.849168:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560966.849181:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000346beb99/0x4642c20bf2f35b51 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.849196:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787560966.849200:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560966.849206:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000346beb99/0x4642c20bf2f35b51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.849219:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000346beb99/0x4642c20bf2f35b51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.849229:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000346beb99/0x4642c20bf2f35b51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.849236:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000346beb99/0x4642c20bf2f35b51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.849300:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787560966.852244:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560966.852256:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002490e79c/0x4642c20bf2f35b58 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.852278:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787560966.852282:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560966.852288:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002490e79c/0x4642c20bf2f35b58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.852300:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002490e79c/0x4642c20bf2f35b58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.852309:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002490e79c/0x4642c20bf2f35b58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.852317:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002490e79c/0x4642c20bf2f35b58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.852378:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787560966.852386:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000346beb99/0x4642c20bf2f35b51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.852393:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021fe400 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560966.852398:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000346beb99/0x4642c20bf2f35b51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.852407:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000346beb99/0x4642c20bf2f35b51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.852423:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000346beb99/0x4642c20bf2f35b51 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.852457:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000346beb99/0x4642c20bf2f35b51 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.852477:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560966.852480:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002490e79c/0x4642c20bf2f35b58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.852486:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ff600 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:3.0:1787560966.852489:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002490e79c/0x4642c20bf2f35b58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.852496:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002490e79c/0x4642c20bf2f35b58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.852506:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002490e79c/0x4642c20bf2f35b58 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560966.852513:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560966.852515:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560966.852517:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560966.857262:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787560966.857276:0:25074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002490e79c/0x4642c20bf2f35b58 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787560966.857872:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560966.857880:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f4dd5ed/0x4642c20bf2f35b5f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.857892:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787560966.857898:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560966.857904:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f4dd5ed/0x4642c20bf2f35b5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.857929:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f4dd5ed/0x4642c20bf2f35b5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.857939:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f4dd5ed/0x4642c20bf2f35b5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.857946:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f4dd5ed/0x4642c20bf2f35b5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.858047:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787560966.860216:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560966.860230:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba72076c/0x4642c20bf2f35b66 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.860247:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787560966.860252:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560966.860258:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba72076c/0x4642c20bf2f35b66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.860271:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba72076c/0x4642c20bf2f35b66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.860280:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba72076c/0x4642c20bf2f35b66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.860300:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba72076c/0x4642c20bf2f35b66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.860881:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787560966.860890:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f4dd5ed/0x4642c20bf2f35b5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.860899:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ffe00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:2.0:1787560966.860903:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f4dd5ed/0x4642c20bf2f35b5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.860912:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f4dd5ed/0x4642c20bf2f35b5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.860930:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f4dd5ed/0x4642c20bf2f35b5f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.860937:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f4dd5ed/0x4642c20bf2f35b5f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.860972:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560966.860986:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba72076c/0x4642c20bf2f35b66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.860993:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021fe800 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:2.0:1787560966.860996:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba72076c/0x4642c20bf2f35b66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.861003:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba72076c/0x4642c20bf2f35b66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.861013:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba72076c/0x4642c20bf2f35b66 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.861021:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560966.861023:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560966.861025:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560966.863079:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560966.863964:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787560966.863987:0:25074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba72076c/0x4642c20bf2f35b66 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787560966.869822:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787560966.869839:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35b6d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.869856:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787560966.869861:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560966.869867:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35b6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.869881:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35b6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.869891:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35b6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560966.869899:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35b6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.870089:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560966.870097:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35b6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.870105:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ffc00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:2.0:1787560966.870109:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35b6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.870128:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35b6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.870145:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35b6d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.870154:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560966.870156:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560966.870158:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560966.870217:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787560966.870222:0:25074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000686f09a1/0x4642c20bf2f35b6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787560966.871113:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787560966.871123:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088199bba/0x4642c20bf2f35b74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.871140:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=686s v=(0 0) 00010000:00010000:0.0:1787560966.871143:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560966.871148:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088199bba/0x4642c20bf2f35b74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.871157:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088199bba/0x4642c20bf2f35b74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.871165:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088199bba/0x4642c20bf2f35b74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.871172:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088199bba/0x4642c20bf2f35b74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.875239:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560966.875253:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088199bba/0x4642c20bf2f35b74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.875266:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3088800 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:2.0:1787560966.875271:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088199bba/0x4642c20bf2f35b74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.875282:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088199bba/0x4642c20bf2f35b74 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.875301:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088199bba/0x4642c20bf2f35b74 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.875311:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560966.875313:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560966.875315:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787560966.875400:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787560966.875408:0:25074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088199bba/0x4642c20bf2f35b74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787560966.877486:0:25074:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787560966.877498:0:25074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5274811/0x4642c20bf2f35b7b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.877513:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=686s v=(0 0) 00010000:00010000:0.0:1787560966.877518:0:25074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560966.877525:0:25074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5274811/0x4642c20bf2f35b7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.877550:0:25074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5274811/0x4642c20bf2f35b7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.877574:0:25074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5274811/0x4642c20bf2f35b7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.877692:0:25074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5274811/0x4642c20bf2f35b7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560966.877710:0:25074:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1787560966.878122:0:25074:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:0.0:1787560966.878232:0:25074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22767:x1874392862954112:12345-0@lo:5:osp-pre-1-0.0 Request processed in 160646us (161882us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560966.878244:0:25074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787560966.878311:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bad880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22767:1874392862954112:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787560966.878329:0:22767:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1787560966.878381:0:22767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2007480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22767:1874392862955008:0@lo:5:osp-pre-1-0.0 00010000:00010000:2.0:1787560966.878493:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560966.878501:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5274811/0x4642c20bf2f35b7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.878513:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3088000 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:2.0:1787560966.878517:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5274811/0x4642c20bf2f35b7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.878530:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5274811/0x4642c20bf2f35b7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.878548:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5274811/0x4642c20bf2f35b7b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.878567:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5274811/0x4642c20bf2f35b7b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560966.878595:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560966.878597:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560966.878599:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560966.878895:0:22767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560966.878923:0:22767:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc447e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560966.878940:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862955008 00000100:00100000:0.0:1787560966.878947:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862955008 00000100:00100000:0.0:1787560966.879725:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787560966.879891:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2004e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22767:x1874392862955008:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787560966.880082:0:24250:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00010000:00010000:3.0:1787560966.880460:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560966.893561:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2004e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22767:x1874392862955008:12345-0@lo:5:osp-pre-1-0.0 Request processed in 13663us (14651us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1787560966.893576:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787560966.894739:0:22767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2007480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22767:1874392862955008:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787560966.894755:0:22767:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:2.0:1787560967.667711:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787560968.116990:0:22774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787560968.692582:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787560968.881224:0:25420:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787560969.715960:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787560970.172931:0:25472:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787560970.174032:0:25472:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787560970.747953:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560970.804672:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787560970.804711:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcb0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862955136:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787560970.804775:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560970.804906:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862955136 00000100:00100000:0.0:1787560970.804913:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862955136 00000100:00080000:2.0:1787560970.804961:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560970.805000:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787560970.805010:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862955136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787560970.805044:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787560970.805115:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862955136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560970.805122:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787560970.805155:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcb0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862955136:0@lo:13:osp-pre-0-1.0 00000020:00000004:3.0:1787560970.988718:0:25522:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787560970.989185:0:25522:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787560971.311310:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560971.311413:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853397504 00000100:00100000:0.0:1787560971.311424:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853397504 00000100:00100000:0.0:1787560971.311550:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 115 00000100:00100000:0.0:1787560971.311565:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2401:x1874392853397504:12345-192.168.203.29@tcp:250:mount.lustre.0 00010000:00080000:0.0:1787560971.311619:0:22735:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 2bb825e1-70be-45ed-969c-e040921081a0@192.168.203.29@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:0.0:1787560971.311687:0:22735:0:(genops.c:1385:class_connect()) connect: client 2bb825e1-70be-45ed-969c-e040921081a0, cookie 0x4642c20bf2f35b82 00000100:00080000:0.0:1787560971.311909:0:22735:0:(import.c:65:import_set_state_nolock()) ffff9cafc6f14000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787560971.311984:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bb825e1-70be-45ed-969c-e040921081a0+5:2401:x1874392853397504:12345-192.168.203.29@tcp:250:mount.lustre.0 Request processed in 421us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560971.311993:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 115 00000100:00100000:2.0:1787560971.316012:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560971.316079:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853397632 00000100:00100000:1.0:1787560971.316090:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853397632 00000100:00100000:1.0:1787560971.316156:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 116 00000100:00100000:1.0:1787560971.316168:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bb825e1-70be-45ed-969c-e040921081a0+5:18069:x1874392853397632:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787560971.316188:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560971.316207:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cb0021ff600/0x4642c20bf2f35b89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf460601ca expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560971.316233:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cb0021ff600/0x4642c20bf2f35b89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601ca expref: 6 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560971.316244:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cb0021ff600/0x4642c20bf2f35b89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601ca expref: 6 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560971.316264:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb0021ff600, rc 0) 00000100:00100000:1.0:1787560971.316332:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bb825e1-70be-45ed-969c-e040921081a0+6:18069:x1874392853397632:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 165us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560971.316340:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 116 00000100:00100000:1.0:1787560971.321993:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560971.322081:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853397760 00000100:00100000:2.0:1787560971.322096:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853397760 00000100:00100000:2.0:1787560971.322180:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 117 00000100:00100000:2.0:1787560971.322190:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdf2c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bb825e1-70be-45ed-969c-e040921081a0+6:18069:x1874392853397760:12345-192.168.203.29@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787560971.322323:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdf2c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bb825e1-70be-45ed-969c-e040921081a0+6:18069:x1874392853397760:12345-192.168.203.29@tcp:501:mount.lustre.0 Request processed in 134us (339us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787560971.322332:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 117 00000100:00100000:3.0:1787560971.326129:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560971.326339:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853397888 00000100:00100000:0.0:1787560971.326351:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853397888 00000100:00100000:0.0:1787560971.326409:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 118 00000100:00100000:0.0:1787560971.326419:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdf2c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bb825e1-70be-45ed-969c-e040921081a0+6:18069:x1874392853397888:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787560971.326460:0:22735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560971.326479:0:22735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caec3088a00/0x4642c20bf2f35b90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf460601d1 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560971.326511:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec3088a00/0x4642c20bf2f35b90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601d1 expref: 7 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560971.326535:0:22735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caec3088a00/0x4642c20bf2f35b90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460601d1 expref: 7 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560971.326546:0:22735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3088a00, rc 0) 00000100:00100000:0.0:1787560971.326626:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdf2c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bb825e1-70be-45ed-969c-e040921081a0+7:18069:x1874392853397888:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 207us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560971.326633:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 118 00000100:00100000:3.0:1787560971.331293:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560971.331941:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853398016 00000100:00100000:2.0:1787560971.331952:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853398016 00000100:00100000:2.0:1787560971.332017:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 119 00000100:00100000:2.0:1787560971.332027:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdf2c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bb825e1-70be-45ed-969c-e040921081a0+7:18069:x1874392853398016:12345-192.168.203.29@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787560971.332309:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdf2c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bb825e1-70be-45ed-969c-e040921081a0+8:18069:x1874392853398016:12345-192.168.203.29@tcp:501:mount.lustre.0 Request processed in 281us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560971.332318:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 119 00000100:00100000:1.0:1787560971.337150:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560971.337282:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853398144 00000100:00100000:0.0:1787560971.337293:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853398144 00000100:00100000:0.0:1787560971.337349:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 120 00000100:00100000:0.0:1787560971.337364:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdf2c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bb825e1-70be-45ed-969c-e040921081a0+8:18069:x1874392853398144:12345-192.168.203.29@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787560971.337896:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdf2c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bb825e1-70be-45ed-969c-e040921081a0+8:18069:x1874392853398144:12345-192.168.203.29@tcp:503:mount.lustre.0 Request processed in 536us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560971.337905:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 120 00000100:00100000:3.0:1787560971.346293:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560971.346549:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853398272 00000100:00100000:2.0:1787560971.346562:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853398272 00000100:00100000:2.0:1787560971.346642:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 121 00000100:00100000:2.0:1787560971.346657:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdf2c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bb825e1-70be-45ed-969c-e040921081a0+8:18087:x1874392853398272:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787560971.347350:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdf2c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bb825e1-70be-45ed-969c-e040921081a0+8:18087:x1874392853398272:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 694us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560971.347363:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 121 00000100:00100000:3.0:1787560971.382349:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560971.382464:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853398400 00000100:00100000:0.0:1787560971.382475:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853398400 00000100:00100000:0.0:1787560971.382641:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 122 00000100:00100000:0.0:1787560971.382653:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdf2c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bb825e1-70be-45ed-969c-e040921081a0+8:18087:x1874392853398400:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787560971.382823:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdf2c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bb825e1-70be-45ed-969c-e040921081a0+8:18087:x1874392853398400:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 172us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560971.382830:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 122 00000100:00100000:1.0:1787560971.391864:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560971.392640:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853398528 00000100:00100000:3.0:1787560971.392652:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853398528 00000100:00100000:3.0:1787560971.392713:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 123 00000100:00100000:3.0:1787560971.392724:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdf2c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bb825e1-70be-45ed-969c-e040921081a0+8:18087:x1874392853398528:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787560971.392894:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdf2c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bb825e1-70be-45ed-969c-e040921081a0+8:18087:x1874392853398528:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 171us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560971.392901:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 123 00000100:00100000:3.0:1787560971.401308:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560971.401427:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853398656 00000100:00100000:0.0:1787560971.401463:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853398656 00000100:00100000:0.0:1787560971.401592:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 124 00000100:00100000:0.0:1787560971.401613:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdf2c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bb825e1-70be-45ed-969c-e040921081a0+8:18069:x1874392853398656:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787560971.401651:0:22735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560971.401671:0:22735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caec3088200/0x4642c20bf2f35b97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060202 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560971.401704:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec3088200/0x4642c20bf2f35b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060202 expref: 9 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560971.401716:0:22735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caec3088200/0x4642c20bf2f35b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060202 expref: 9 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560971.401727:0:22735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3088200, rc 0) 00000100:00100000:0.0:1787560971.401862:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdf2c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bb825e1-70be-45ed-969c-e040921081a0+9:18069:x1874392853398656:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 259us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560971.401871:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 124 00000100:00100000:0.0:1787560971.406016:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560971.406131:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853398784 00000100:00100000:2.0:1787560971.406160:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853398784 00000100:00100000:2.0:1787560971.406250:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 125 00000100:00100000:2.0:1787560971.406262:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4788450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bb825e1-70be-45ed-969c-e040921081a0+9:18069:x1874392853398784:12345-192.168.203.29@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787560971.406290:0:22734:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787560971.406309:0:22734:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787560971.406313:0:22734:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787560971.406316:0:22734:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787560971.406318:0:22734:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787560971.406321:0:22734:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1787560971.408360:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4788450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bb825e1-70be-45ed-969c-e040921081a0+9:18069:x1874392853398784:12345-192.168.203.29@tcp:256:mount.lustre.0 Request processed in 2088us (2340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560971.408377:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 125 00000100:00100000:3.0:1787560971.412095:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560971.412191:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853398912 00000100:00100000:2.0:1787560971.412201:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853398912 00000100:00100000:2.0:1787560971.412266:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 126 00000100:00100000:2.0:1787560971.412278:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4788050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bb825e1-70be-45ed-969c-e040921081a0+9:18069:x1874392853398912:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787560971.412298:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560971.412321:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca48a00/0x4642c20bf2f35b9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060209 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560971.412358:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca48a00/0x4642c20bf2f35b9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060209 expref: 10 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560971.412370:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca48a00/0x4642c20bf2f35b9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060209 expref: 10 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560971.412380:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca48a00, rc 0) 00000100:00100000:2.0:1787560971.412484:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4788050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bb825e1-70be-45ed-969c-e040921081a0+10:18069:x1874392853398912:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 209us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560971.412507:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 126 00000100:00100000:3.0:1787560971.414666:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560971.415593:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853399040 00000100:00100000:2.0:1787560971.415905:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853399040 00000100:00100000:2.0:1787560971.415978:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 127 00000100:00100000:2.0:1787560971.415989:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc478b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bb825e1-70be-45ed-969c-e040921081a0+10:18069:x1874392853399040:12345-192.168.203.29@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787560971.416231:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc478b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bb825e1-70be-45ed-969c-e040921081a0+10:18069:x1874392853399040:12345-192.168.203.29@tcp:501:mount.lustre.0 Request processed in 242us (1571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560971.416240:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 127 00000100:00100000:1.0:1787560971.419713:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560971.420173:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853399168 00000100:00100000:0.0:1787560971.420182:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853399168 00000100:00100000:0.0:1787560971.420291:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 128 00000100:00100000:0.0:1787560971.420302:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4714c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bb825e1-70be-45ed-969c-e040921081a0+10:18069:x1874392853399168:12345-192.168.203.29@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787560971.420490:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4714c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bb825e1-70be-45ed-969c-e040921081a0+10:18069:x1874392853399168:12345-192.168.203.29@tcp:503:mount.lustre.0 Request processed in 190us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560971.420499:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 128 00000100:00100000:1.0:1787560971.423784:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560971.424040:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853399296 00000100:00100000:2.0:1787560971.424050:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853399296 00000100:00100000:2.0:1787560971.424112:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 129 00000100:00100000:2.0:1787560971.424123:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4715450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bb825e1-70be-45ed-969c-e040921081a0+10:18090:x1874392853399296:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787560971.424328:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4715450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bb825e1-70be-45ed-969c-e040921081a0+10:18090:x1874392853399296:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 206us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560971.424336:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 129 00000100:00100000:3.0:1787560971.427545:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560971.427668:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853399424 00000100:00100000:0.0:1787560971.427681:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853399424 00000100:00100000:0.0:1787560971.427748:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 130 00000100:00100000:0.0:1787560971.427759:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4717450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bb825e1-70be-45ed-969c-e040921081a0+10:18090:x1874392853399424:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787560971.428090:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4717450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bb825e1-70be-45ed-969c-e040921081a0+10:18090:x1874392853399424:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 331us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560971.428099:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 130 00000100:00100000:3.0:1787560971.432055:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560971.432157:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560971.432482:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853399552 00000100:00100000:2.0:1787560971.432494:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853399552 00000100:00100000:2.0:1787560971.432734:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853399808 00000100:00100000:2.0:1787560971.432738:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853399808 00000100:00100000:2.0:1787560971.432755:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:2.0:1787560971.432764:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874392853399552:12345-192.168.203.29@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787560971.432791:0:22742:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from ca781b59-3c9b-4203-8040-d3d106b1f7b5@192.168.203.29@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:2.0:1787560971.432838:0:22742:0:(genops.c:1385:class_connect()) connect: client ca781b59-3c9b-4203-8040-d3d106b1f7b5, cookie 0x4642c20bf2f35ba5 00000004:00100000:2.0:1787560971.432864:0:22742:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:2.0:1787560971.433216:0:22742:0:(import.c:65:import_set_state_nolock()) ffff9caec3211000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787560971.433565:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+6:2401:x1874392853399552:12345-192.168.203.29@tcp:38:mount.lustre.0 Request processed in 798us (1518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560971.433573:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:2.0:1787560971.433595:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:2.0:1787560971.433612:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874392853399808:12345-192.168.203.29@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787560971.433632:0:22742:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from ca781b59-3c9b-4203-8040-d3d106b1f7b5@192.168.203.29@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:2.0:1787560971.433664:0:22742:0:(genops.c:1385:class_connect()) connect: client ca781b59-3c9b-4203-8040-d3d106b1f7b5, cookie 0x4642c20bf2f35bac 00000004:00100000:2.0:1787560971.433678:0:22742:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:2.0:1787560971.433842:0:22742:0:(import.c:65:import_set_state_nolock()) ffff9cafc758b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787560971.433869:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+6:2401:x1874392853399808:12345-192.168.203.29@tcp:38:mount.lustre.0 Request processed in 268us (1713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560971.433888:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:1.0:1787560971.439907:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560971.440379:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560971.440612:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853400064 00000100:00100000:3.0:1787560971.440625:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853400064 00000100:00100000:3.0:1787560971.440712:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853399680 00000100:00100000:3.0:1787560971.440716:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853399680 00000100:00100000:3.0:1787560971.440734:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:3.0:1787560971.440744:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+7:18069:x1874392853400064:12345-192.168.203.29@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787560971.440781:0:22742:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787560971.440873:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+7:18069:x1874392853400064:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 130us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560971.440896:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:3.0:1787560971.440912:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:3.0:1787560971.440920:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+6:0:x1874392853399680:12345-192.168.203.29@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787560971.440931:0:22742:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787560971.440953:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+6:0:x1874392853399680:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 34us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560971.440960:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00080000:0.0:1787560971.441368:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560971.447783:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560971.448696:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560971.450079:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853399936 00000100:00100000:3.0:1787560971.450098:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853399936 00000100:00100000:2.0:1787560971.450198:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853400192 00000100:00100000:2.0:1787560971.450204:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853400192 00000100:00080000:0.0:1787560971.450268:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787560971.450360:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:0.0:1787560971.450374:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+6:18069:x1874392853400192:12345-192.168.203.29@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787560971.450493:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+6:18069:x1874392853400192:12345-192.168.203.29@tcp:40:mount.lustre.0 Request processed in 122us (1802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560971.450501:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:0.0:1787560971.450524:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:0.0:1787560971.450541:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+6:0:x1874392853399936:12345-192.168.203.29@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787560971.450562:0:22742:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787560971.450621:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+6:0:x1874392853399936:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 81us (2851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560971.450629:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:3.0:1787560971.453188:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560971.453228:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560971.453250:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853400576 00000100:00100000:2.0:1787560971.453261:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853400576 00000100:00100000:2.0:1787560971.453353:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:2.0:1787560971.453364:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+6:18069:x1874392853400576:12345-192.168.203.29@tcp:900:mount.lustre.0 00000100:00100000:2.0:1787560971.453464:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+6:18069:x1874392853400576:12345-192.168.203.29@tcp:900:mount.lustre.0 Request processed in 102us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560971.453471:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:3.0:1787560971.453733:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560971.453857:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853400320 00000100:00100000:1.0:1787560971.453863:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853400320 00000100:00100000:1.0:1787560971.453889:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853400448 00000100:00100000:1.0:1787560971.453892:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853400448 00000100:00100000:1.0:1787560971.453907:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:1.0:1787560971.453912:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1874392853400320:12345-192.168.203.29@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787560971.453940:0:24249:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ca781b59-3c9b-4203-8040-d3d106b1f7b5@192.168.203.29@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:1.0:1787560971.453966:0:24249:0:(genops.c:1385:class_connect()) connect: client ca781b59-3c9b-4203-8040-d3d106b1f7b5, cookie 0x4642c20bf2f35bb3 00002000:00100000:1.0:1787560971.453978:0:24249:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ca781b59-3c9b-4203-8040-d3d106b1f7b5/ffff9caec3015000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787560971.453989:0:24249:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:1.0:1787560971.454176:0:24249:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787560971.454204:0:24249:0:(import.c:65:import_set_state_nolock()) ffff9caec3017800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787560971.454257:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+6:2401:x1874392853400320:12345-192.168.203.29@tcp:8:mount.lustre.0 Request processed in 332us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560971.454265:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:1.0:1787560971.454281:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:1.0:1787560971.454285:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1874392853400448:12345-192.168.203.29@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787560971.454316:0:24249:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ca781b59-3c9b-4203-8040-d3d106b1f7b5@192.168.203.29@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:1.0:1787560971.454332:0:24249:0:(genops.c:1385:class_connect()) connect: client ca781b59-3c9b-4203-8040-d3d106b1f7b5, cookie 0x4642c20bf2f35bba 00002000:00100000:1.0:1787560971.454336:0:24249:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ca781b59-3c9b-4203-8040-d3d106b1f7b5/ffff9caec3012000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787560971.454347:0:24249:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1787560971.456323:0:24249:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787560971.456369:0:24249:0:(import.c:65:import_set_state_nolock()) ffff9caec3012800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787560971.456565:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+6:2401:x1874392853400448:12345-192.168.203.29@tcp:8:mount.lustre.0 Request processed in 2275us (2830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560971.456577:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:3.0:1787560971.462780:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560971.462890:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853400704 00000100:00100000:1.0:1787560971.462901:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853400704 00000100:00100000:1.0:1787560971.462966:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:1.0:1787560971.462977:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+6:18069:x1874392853400704:12345-192.168.203.29@tcp:33:mount.lustre.0 00000004:00080000:1.0:1787560971.466573:0:22743:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3501us 00000004:00200000:0.0:1787560971.473974:0:22743:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787560971.474118:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+6:18069:x1874392853400704:12345-192.168.203.29@tcp:33:mount.lustre.0 Request processed in 11134us (11339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560971.474135:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:3.0:1787560971.631394:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560971.631508:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853400832 00000100:00100000:2.0:1787560971.631519:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853400832 00000100:00100000:2.0:1787560971.632166:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:2.0:1787560971.632183:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+6:18113:x1874392853400832:12345-192.168.203.29@tcp:101:mkdir.0 00010000:00010000:2.0:1787560971.632205:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560971.632321:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49e00/0x4642c20bf2f35bc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4606023a expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560971.632395:0:22740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49c00/0x4642c20bf2f35bc8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560971.632410:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49c00/0x4642c20bf2f35bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560971.632427:0:22740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49c00/0x4642c20bf2f35bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560971.632952:0:22740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787560971.632957:0:22740:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787560971.633015:0:22740:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49c00/0x4642c20bf2f35bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560971.633051:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49e00/0x4642c20bf2f35bc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606023a expref: 8 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560971.633082:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49c00/0x4642c20bf2f35bc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606023a expref: 7 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560971.633091:0:22740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafd33ffe00) 00010000:00010000:0.0:1787560971.633094:0:22740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787560971.633098:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca49c00, rc 0) 00000100:00100000:0.0:1787560971.633228:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+7:18113:x1874392853400832:12345-192.168.203.29@tcp:101:mkdir.0 Request processed in 1050us (1845us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560971.633238:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 13 00010000:00010000:2.0:1787560971.763621:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560971.827720:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787560971.827751:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3af3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862955264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787560971.827840:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560971.827894:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862955264 00000100:00100000:0.0:1787560971.827902:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862955264 00000100:00100000:1.0:1787560971.827921:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862955648:0@lo:400:kworker.0 00000100:00100000:1.0:1787560971.827958:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560971.827958:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787560971.827968:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1874392862955264:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787560971.827973:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862956160:0@lo:400:kworker.0 00002000:00000024:0.0:1787560971.827991:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787560971.828002:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560971.828020:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862956672:0@lo:400:kworker.0 00000100:00100000:2.0:1787560971.828077:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2007800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862955520:0@lo:400:kworker.0 00000100:00100000:3.0:1787560971.828180:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862955776:0@lo:400:kworker.0 00000100:00100000:0.0:1787560971.828381:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1874392862955264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 412us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560971.828389:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787560971.828414:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862955648 00000100:00100000:0.0:1787560971.828418:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862955648 00000100:00100000:0.0:1787560971.828470:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862956160 00000100:00100000:0.0:1787560971.828473:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862956160 00000100:00100000:0.0:1787560971.828496:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787560971.828504:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862955648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560971.832517:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560971.832665:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3af3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862955264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787560971.832728:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787560971.832742:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862956160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560971.832805:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862956160:12345-0@lo:400:kworker.0 Request processed in 69us (4801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560971.832813:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787560971.832864:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862956160:0@lo:400:kworker.0 00000100:00100000:2.0:1787560971.834215:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560971.834300:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2007b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862956032:0@lo:400:kworker.0 00000100:00100000:2.0:1787560971.834337:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560971.834368:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862956544:0@lo:400:kworker.0 00000100:00100000:2.0:1787560971.834394:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560971.834427:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1787560971.834449:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c33dd467-64b2-4362-8604-d1a6489592bb:3626:1874392862955392:0@lo:400:kworker.0 00000100:00100000:2.0:1787560971.834484:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560971.834510:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862955904:0@lo:400:kworker.0 00000100:00100000:2.0:1787560971.834532:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560971.834551:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862956416:0@lo:400:kworker.0 00000100:00100000:2.0:1787560971.834573:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560971.834584:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862956928:0@lo:400:kworker.0 00000100:00100000:2.0:1787560971.834635:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560971.834678:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862955520 00000100:00100000:2.0:1787560971.834698:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862955520 00000100:00100000:2.0:1787560971.834745:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862956032 00000100:00100000:2.0:1787560971.834749:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862956032 00000100:00100000:2.0:1787560971.834768:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787560971.834777:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862955520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560971.834836:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862955520:12345-0@lo:400:kworker.0 Request processed in 60us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560971.834843:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787560971.834858:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787560971.834864:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862956032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560971.834888:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862956032:12345-0@lo:400:kworker.0 Request processed in 25us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560971.834894:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787560971.835076:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2007800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862955520:0@lo:400:kworker.0 00000100:00100000:2.0:1787560971.835088:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2007b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862956032:0@lo:400:kworker.0 00000100:00100000:2.0:1787560971.835129:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862956672 00000100:00100000:2.0:1787560971.835133:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862956672 00000100:00100000:2.0:1787560971.835155:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862956544 00000100:00100000:2.0:1787560971.835158:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862956544 00000100:00100000:2.0:1787560971.835168:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862955904 00000100:00100000:2.0:1787560971.835170:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862955904 00000100:00100000:2.0:1787560971.835179:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862956416 00000100:00100000:2.0:1787560971.835181:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862956416 00000100:00100000:2.0:1787560971.835188:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862956928 00000100:00100000:2.0:1787560971.835190:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862956928 00000100:00100000:2.0:1787560971.835203:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787560971.835216:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffba2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862956672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560971.835253:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffba2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1874392862956672:12345-0@lo:400:kworker.0 Request processed in 39us (2749us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560971.835260:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787560971.835271:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787560971.835323:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862956544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560971.835356:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1874392862956544:12345-0@lo:400:kworker.0 Request processed in 79us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560971.835363:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787560971.835374:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787560971.835379:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862955904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560971.835406:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1874392862955904:12345-0@lo:400:kworker.0 Request processed in 27us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560971.835411:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787560971.835422:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787560971.835427:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874392862956416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560971.835490:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874392862956416:12345-0@lo:400:kworker.0 Request processed in 63us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560971.835497:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787560971.835509:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787560971.835515:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862956928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560971.835540:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862956928:12345-0@lo:400:kworker.0 Request processed in 26us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560971.835545:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787560971.835611:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1874392862955904:0@lo:400:kworker.0 00000100:00100000:2.0:1787560971.835634:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862956416:0@lo:400:kworker.0 00010000:00080000:2.0:1787560971.835647:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caffbaf5500 x1874392862956928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560971.835657:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862956928:0@lo:400:kworker.0 00000100:00100000:2.0:1787560971.835668:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1874392862956544:0@lo:400:kworker.0 00010000:00080000:2.0:1787560971.835718:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2005180 x1874392862956672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787560971.835727:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1874392862956672:0@lo:400:kworker.0 00000100:00100000:2.0:1787560971.835749:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862955392 00000100:00100000:2.0:1787560971.835753:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862955392 00000100:00100000:2.0:1787560971.835785:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787560971.835792:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4714850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+24:3626:x1874392862955392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560971.835830:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4714850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+24:3626:x1874392862955392:12345-0@lo:400:kworker.0 Request processed in 39us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560971.835836:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787560971.835874:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c33dd467-64b2-4362-8604-d1a6489592bb:3626:1874392862955392:0@lo:400:kworker.0 00000100:00080000:1.0:1787560971.835904:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787560971.835911:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787560971.835914:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787560971.835918:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787560971.835960:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3af1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862957056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560971.835997:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560971.836042:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862957184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787560971.836063:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560971.836089:0:24251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862957056 00000100:00100000:2.0:1787560971.836092:0:24251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862957056 00000100:00100000:2.0:1787560971.836110:0:24251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862957184 00000100:00100000:2.0:1787560971.836121:0:24251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862957184 00000100:00100000:2.0:1787560971.836146:0:24251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787560971.836151:0:24251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1874392862957056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787560971.836166:0:24251:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787560971.836200:0:24251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1874392862957056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560971.836207:0:24251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787560971.836219:0:24251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787560971.836225:0:24251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862957184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787560971.836235:0:24251:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787560971.836264:0:24251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862957184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560971.836270:0:24251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787560971.836282:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787560971.836306:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3af1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862957056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560971.836329:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862957184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787560971.836392:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787560971.836399:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3af1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862957312:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787560971.836425:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560971.836471:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862957312 00000100:00100000:2.0:1787560971.836475:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862957312 00000100:00100000:2.0:1787560971.836497:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787560971.836502:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862957312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787560971.836532:0:22746:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787560971.836564:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862957312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560971.836579:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787560971.836620:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3af1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862957312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787560971.836983:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862957440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787560971.837021:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560971.837805:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560971.837993:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862956288:0@lo:400:kworker.0 00000100:00100000:3.0:1787560971.838021:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560971.838228:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862955776 00000100:00100000:1.0:1787560971.838238:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862955776 00000100:00100000:1.0:1787560971.838287:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862956288 00000100:00100000:1.0:1787560971.838290:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862956288 00000100:00100000:1.0:1787560971.838309:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787560971.838318:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1874392862955776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560971.838372:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1874392862955776:12345-0@lo:400:kworker.0 Request processed in 55us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560971.838380:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787560971.838505:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787560971.838513:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862956288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560971.838544:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862956288:12345-0@lo:400:kworker.0 Request processed in 33us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560971.838569:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787560971.838678:0:23481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862957440 00000100:00100000:2.0:1787560971.839457:0:23481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862957440 00000100:00100000:3.0:1787560971.839537:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862956288:0@lo:400:kworker.0 00000100:00100000:3.0:1787560971.839551:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2005c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874392862956800:0@lo:400:kworker.0 00000100:00100000:2.0:1787560971.839591:0:23481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787560971.839611:0:23481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffba2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862957440:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560971.839643:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:2.0:1787560971.839653:0:23481:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787560971.839685:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862956800 00000100:00100000:3.0:1787560971.839691:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862956800 00000100:00100000:3.0:1787560971.839743:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787560971.839752:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874392862956800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560971.839777:0:23481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffba2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862957440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 166us (2753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560971.839785:0:23481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787560971.839810:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1874392862956800:12345-0@lo:400:kworker.0 Request processed in 59us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560971.839817:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1787560971.839838:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560971.839866:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2005c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1874392862956800:0@lo:400:kworker.0 00000100:00100000:0.0:1787560971.839893:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862955648:12345-0@lo:400:kworker.0 Request processed in 11387us (11932us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560971.839902:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787560971.839915:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862955776:0@lo:400:kworker.0 00000100:00100000:0.0:1787560971.839955:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2006d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862955648:0@lo:400:kworker.0 00000100:00100000:0.0:1787560971.840028:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862957440:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1787560972.661408:0:23495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787560972.788168:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787560972.865251:0:25063:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ca781b59-3c9b-4203-8040-d3d106b1f7b5 00000001:00080000:0.0:1787560972.865273:0:25063:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:2.0:1787560973.811978:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560973.876989:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560973.877649:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853400960 00000100:00100000:1.0:1787560973.877667:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853400960 00000100:00080000:3.0:1787560973.877777:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787560973.877778:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:1.0:1787560973.877801:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+7:18165:x1874392853400960:12345-192.168.203.29@tcp:41:lfs.0 00000004:00000024:1.0:1787560973.877853:0:22742:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787560973.877986:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+7:18165:x1874392853400960:12345-192.168.203.29@tcp:41:lfs.0 Request processed in 194us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560973.877994:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:3.0:1787560973.881415:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560973.883021:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853401088 00000100:00100000:1.0:1787560973.883049:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853401088 00000100:00100000:1.0:1787560973.883186:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:1.0:1787560973.883205:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+6:18165:x1874392853401088:12345-192.168.203.29@tcp:41:lfs.0 00000004:00000024:1.0:1787560973.883282:0:22741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787560973.883654:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+6:18165:x1874392853401088:12345-192.168.203.29@tcp:41:lfs.0 Request processed in 334us (2137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560973.883666:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00080000:3.0:1787560973.884151:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787560973.889313:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560973.889488:0:24251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853401216 00000100:00100000:2.0:1787560973.889516:0:24251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853401216 00000100:00100000:2.0:1787560973.889796:0:24251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:2.0:1787560973.889812:0:24251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ca781b59-3c9b-4203-8040-d3d106b1f7b5+6:18165:x1874392853401216:12345-192.168.203.29@tcp:13:lfs.0 00002000:00000024:2.0:1787560973.890072:0:24251:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787560973.890248:0:24251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ca781b59-3c9b-4203-8040-d3d106b1f7b5+6:18165:x1874392853401216:12345-192.168.203.29@tcp:13:lfs.0 Request processed in 440us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560973.890257:0:24251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00080000:3.0:1787560973.890337:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787560973.895107:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560973.895245:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853401344 00000100:00100000:0.0:1787560973.895260:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853401344 00000100:00100000:0.0:1787560973.895466:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:0.0:1787560973.895480:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ca781b59-3c9b-4203-8040-d3d106b1f7b5+5:18165:x1874392853401344:12345-192.168.203.29@tcp:13:lfs.0 00002000:00000024:0.0:1787560973.895539:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787560973.895660:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ca781b59-3c9b-4203-8040-d3d106b1f7b5+5:18165:x1874392853401344:12345-192.168.203.29@tcp:13:lfs.0 Request processed in 182us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560973.895677:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00080000:3.0:1787560973.895782:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787560974.148063:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560974.148427:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853401472 00000100:00100000:2.0:1787560974.148478:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853401472 00000100:00100000:2.0:1787560974.148596:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 132 00000100:00100000:2.0:1787560974.148609:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4716450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bb825e1-70be-45ed-969c-e040921081a0+10:18198:x1874392853401472:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787560974.148632:0:22735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560974.148678:0:22735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca48800/0x4642c20bf2f35bcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060241 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560974.148720:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca48800/0x4642c20bf2f35bcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060241 expref: 11 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560974.148733:0:22735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca48800/0x4642c20bf2f35bcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060241 expref: 11 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560974.148746:0:22735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca48800, rc 0) 00000100:00100000:2.0:1787560974.148826:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4716450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bb825e1-70be-45ed-969c-e040921081a0+11:18198:x1874392853401472:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 219us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560974.148832:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 132 00000100:00100000:1.0:1787560974.157618:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560974.157793:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853401600 00000100:00100000:2.0:1787560974.157807:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853401600 00000100:00100000:2.0:1787560974.157904:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 133 00000100:00100000:2.0:1787560974.157918:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4714050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bb825e1-70be-45ed-969c-e040921081a0+11:18198:x1874392853401600:12345-192.168.203.29@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787560974.158311:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4714050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bb825e1-70be-45ed-969c-e040921081a0+11:18198:x1874392853401600:12345-192.168.203.29@tcp:501:mount.lustre.0 Request processed in 394us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560974.158320:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 133 00000100:00100000:3.0:1787560974.175293:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560974.175478:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853401728 00000100:00100000:1.0:1787560974.175495:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853401728 00000100:00100000:1.0:1787560974.175647:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 134 00000100:00100000:1.0:1787560974.175661:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bb825e1-70be-45ed-969c-e040921081a0+11:18198:x1874392853401728:12345-192.168.203.29@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787560974.185242:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bb825e1-70be-45ed-969c-e040921081a0+11:18198:x1874392853401728:12345-192.168.203.29@tcp:503:mount.lustre.0 Request processed in 9564us (9947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560974.185264:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 134 00000100:00100000:0.0:1787560974.192892:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560974.193246:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853401856 00000100:00100000:2.0:1787560974.193261:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853401856 00000100:00100000:2.0:1787560974.193345:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 135 00000100:00100000:2.0:1787560974.193359:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bb825e1-70be-45ed-969c-e040921081a0+11:18204:x1874392853401856:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787560974.193664:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bb825e1-70be-45ed-969c-e040921081a0+11:18204:x1874392853401856:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 307us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560974.193674:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 135 00000100:00100000:3.0:1787560974.226885:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560974.227160:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853401984 00000100:00100000:1.0:1787560974.227174:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853401984 00000100:00100000:1.0:1787560974.227250:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 136 00000100:00100000:1.0:1787560974.227265:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bb825e1-70be-45ed-969c-e040921081a0+11:18204:x1874392853401984:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787560974.227680:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bb825e1-70be-45ed-969c-e040921081a0+11:18204:x1874392853401984:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 417us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560974.227691:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 136 00000100:00100000:3.0:1787560974.229947:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560974.230226:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853402112 00000100:00100000:0.0:1787560974.230239:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853402112 00000100:00100000:0.0:1787560974.230310:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 137 00000100:00100000:0.0:1787560974.230324:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bb825e1-70be-45ed-969c-e040921081a0+11:18204:x1874392853402112:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787560974.231420:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bb825e1-70be-45ed-969c-e040921081a0+11:18204:x1874392853402112:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 1089us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560974.231461:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 137 00000100:00100000:0.0:1787560974.239958:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560974.240205:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853402240 00000100:00100000:2.0:1787560974.240221:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853402240 00000100:00100000:2.0:1787560974.240343:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 138 00000100:00100000:2.0:1787560974.240355:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bb825e1-70be-45ed-969c-e040921081a0+11:18198:x1874392853402240:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787560974.240378:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560974.240401:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca49800/0x4642c20bf2f35bd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060272 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560974.240463:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca49800/0x4642c20bf2f35bd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060272 expref: 12 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560974.240476:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca49800/0x4642c20bf2f35bd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060272 expref: 12 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560974.240488:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca49800, rc 0) 00000100:00100000:2.0:1787560974.240593:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bb825e1-70be-45ed-969c-e040921081a0+12:18198:x1874392853402240:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 240us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560974.240603:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 138 00000100:00100000:3.0:1787560974.252270:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560974.252476:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853402368 00000100:00100000:0.0:1787560974.252492:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853402368 00000100:00100000:0.0:1787560974.252652:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 139 00000100:00100000:0.0:1787560974.252665:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bb825e1-70be-45ed-969c-e040921081a0+12:18198:x1874392853402368:12345-192.168.203.29@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787560974.252719:0:22735:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787560974.252742:0:22735:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787560974.252747:0:22735:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787560974.252751:0:22735:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787560974.252754:0:22735:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787560974.252756:0:22735:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1787560974.260527:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bb825e1-70be-45ed-969c-e040921081a0+12:18198:x1874392853402368:12345-192.168.203.29@tcp:256:mount.lustre.0 Request processed in 7831us (8243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560974.260557:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 139 00000100:00100000:3.0:1787560974.266730:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560974.267848:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853402496 00000100:00100000:2.0:1787560974.267867:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853402496 00000100:00100000:2.0:1787560974.268021:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 140 00000100:00100000:2.0:1787560974.268034:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bb825e1-70be-45ed-969c-e040921081a0+12:18198:x1874392853402496:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787560974.268057:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560974.268082:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f35bdd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060279 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560974.268118:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f35bdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060279 expref: 13 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560974.268157:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f35bdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060279 expref: 13 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560974.268169:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca49e00, rc 0) 00000100:00100000:2.0:1787560974.268252:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bb825e1-70be-45ed-969c-e040921081a0+13:18198:x1874392853402496:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 221us (1540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560974.268260:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 140 00000100:00100000:3.0:1787560974.274062:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560974.274991:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853402624 00000100:00100000:0.0:1787560974.275019:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853402624 00000100:00100000:0.0:1787560974.275107:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 141 00000100:00100000:0.0:1787560974.275122:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bb825e1-70be-45ed-969c-e040921081a0+13:18198:x1874392853402624:12345-192.168.203.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787560974.275368:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bb825e1-70be-45ed-969c-e040921081a0+13:18198:x1874392853402624:12345-192.168.203.29@tcp:501:mount.lustre.0 Request processed in 249us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560974.275378:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 141 00000100:00100000:3.0:1787560974.281765:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560974.283564:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853402752 00000100:00100000:2.0:1787560974.283599:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853402752 00000100:00100000:2.0:1787560974.283929:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 142 00000100:00100000:2.0:1787560974.283947:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bb825e1-70be-45ed-969c-e040921081a0+13:18198:x1874392853402752:12345-192.168.203.29@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787560974.284242:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bb825e1-70be-45ed-969c-e040921081a0+13:18198:x1874392853402752:12345-192.168.203.29@tcp:503:mount.lustre.0 Request processed in 300us (2496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560974.284252:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 142 00000100:00100000:3.0:1787560974.288391:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560974.288741:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853402880 00000100:00100000:1.0:1787560974.288755:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853402880 00000100:00100000:1.0:1787560974.288835:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 143 00000100:00100000:1.0:1787560974.288848:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bb825e1-70be-45ed-969c-e040921081a0+13:18209:x1874392853402880:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787560974.289299:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bb825e1-70be-45ed-969c-e040921081a0+13:18209:x1874392853402880:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 451us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560974.289308:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 143 00000100:00100000:3.0:1787560974.313201:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560974.317222:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853403008 00000100:00100000:0.0:1787560974.317246:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853403008 00000100:00100000:0.0:1787560974.317359:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 144 00000100:00100000:0.0:1787560974.317373:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bb825e1-70be-45ed-969c-e040921081a0+13:18209:x1874392853403008:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787560974.317669:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bb825e1-70be-45ed-969c-e040921081a0+13:18209:x1874392853403008:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 298us (4483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560974.317679:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 144 00000100:00100000:2.0:1787560974.335843:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560974.336747:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853403136 00000100:00100000:3.0:1787560974.336763:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853403136 00000100:00100000:3.0:1787560974.336839:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:3.0:1787560974.336860:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874392853403136:12345-192.168.203.29@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787560974.336918:0:22740:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from d8c1ddb2-5530-4170-b71a-50058cae7059@192.168.203.29@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:3.0:1787560974.336968:0:22740:0:(genops.c:1385:class_connect()) connect: client d8c1ddb2-5530-4170-b71a-50058cae7059, cookie 0x4642c20bf2f35be4 00000004:00100000:3.0:1787560974.337012:0:22740:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:3.0:1787560974.337134:0:22740:0:(import.c:65:import_set_state_nolock()) ffff9cafeabc9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787560974.337241:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8c1ddb2-5530-4170-b71a-50058cae7059+6:2401:x1874392853403136:12345-192.168.203.29@tcp:38:mount.lustre.0 Request processed in 390us (1413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560974.337250:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:3.0:1787560974.343266:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560974.343320:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560974.343360:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560974.354318:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853403648 00000100:00100000:1.0:1787560974.354343:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853403648 00000100:00100000:1.0:1787560974.354461:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853403392 00000100:00100000:1.0:1787560974.354465:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853403392 00000100:00100000:1.0:1787560974.354478:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853403264 00000100:00100000:1.0:1787560974.354480:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853403264 00000100:00100000:1.0:1787560974.354513:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:1.0:1787560974.354526:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8c1ddb2-5530-4170-b71a-50058cae7059+7:18198:x1874392853403648:12345-192.168.203.29@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787560974.354760:0:22741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787560974.354896:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8c1ddb2-5530-4170-b71a-50058cae7059+7:18198:x1874392853403648:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 371us (11650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560974.354905:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:1.0:1787560974.354951:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:1.0:1787560974.354956:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1874392853403392:12345-192.168.203.29@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787560974.354987:0:22741:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from d8c1ddb2-5530-4170-b71a-50058cae7059@192.168.203.29@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:1.0:1787560974.355092:0:22741:0:(genops.c:1385:class_connect()) connect: client d8c1ddb2-5530-4170-b71a-50058cae7059, cookie 0x4642c20bf2f35beb 00000004:00100000:1.0:1787560974.355125:0:22741:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:1.0:1787560974.355241:0:22741:0:(import.c:65:import_set_state_nolock()) ffff9caec1c49800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787560974.355274:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8c1ddb2-5530-4170-b71a-50058cae7059+6:2401:x1874392853403392:12345-192.168.203.29@tcp:38:mount.lustre.0 Request processed in 316us (11953us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560974.355281:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:1.0:1787560974.355293:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:1.0:1787560974.355300:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8c1ddb2-5530-4170-b71a-50058cae7059+6:2405:x1874392853403264:12345-192.168.203.29@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787560974.355310:0:22741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787560974.355329:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8c1ddb2-5530-4170-b71a-50058cae7059+6:2405:x1874392853403264:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 31us (11971us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560974.355335:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00080000:3.0:1787560974.355678:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560974.361069:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560974.361641:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560974.365847:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853403776 00000100:00100000:1.0:1787560974.365870:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853403776 00000100:00100000:1.0:1787560974.365964:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853403520 00000100:00100000:1.0:1787560974.365968:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853403520 00000100:00100000:1.0:1787560974.366033:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:1.0:1787560974.366044:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffbaf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8c1ddb2-5530-4170-b71a-50058cae7059+6:18198:x1874392853403776:12345-192.168.203.29@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787560974.366172:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffbaf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8c1ddb2-5530-4170-b71a-50058cae7059+6:18198:x1874392853403776:12345-192.168.203.29@tcp:40:mount.lustre.0 Request processed in 128us (5120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560974.366180:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:1.0:1787560974.366200:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:1.0:1787560974.366229:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8c1ddb2-5530-4170-b71a-50058cae7059+6:0:x1874392853403520:12345-192.168.203.29@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787560974.366247:0:22741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787560974.366288:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8c1ddb2-5530-4170-b71a-50058cae7059+6:0:x1874392853403520:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 61us (4665us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560974.366294:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00080000:3.0:1787560974.369748:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787560974.373872:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560974.373952:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560974.373991:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853403904 00000100:00100000:3.0:1787560974.374132:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853403904 00000100:00100000:3.0:1787560974.374189:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:3.0:1787560974.374200:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1874392853403904:12345-192.168.203.29@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787560974.374252:0:24249:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from d8c1ddb2-5530-4170-b71a-50058cae7059@192.168.203.29@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:3.0:1787560974.374299:0:24249:0:(genops.c:1385:class_connect()) connect: client d8c1ddb2-5530-4170-b71a-50058cae7059, cookie 0x4642c20bf2f35bf2 00002000:00100000:3.0:1787560974.374315:0:24249:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d8c1ddb2-5530-4170-b71a-50058cae7059/ffff9cafeabc9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787560974.374331:0:24249:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:3.0:1787560974.374426:0:24249:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787560974.374514:0:24249:0:(import.c:65:import_set_state_nolock()) ffff9cafc74c7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787560974.374847:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853404160 00000100:00100000:1.0:1787560974.374855:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853404160 00000100:00100000:1.0:1787560974.374909:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:1.0:1787560974.374919:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d8c1ddb2-5530-4170-b71a-50058cae7059+6:18198:x1874392853404160:12345-192.168.203.29@tcp:900:mount.lustre.0 00000100:00100000:1.0:1787560974.375027:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d8c1ddb2-5530-4170-b71a-50058cae7059+6:18198:x1874392853404160:12345-192.168.203.29@tcp:900:mount.lustre.0 Request processed in 109us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560974.375037:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:3.0:1787560974.375214:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8c1ddb2-5530-4170-b71a-50058cae7059+6:2401:x1874392853403904:12345-192.168.203.29@tcp:8:mount.lustre.0 Request processed in 1014us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560974.375224:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:3.0:1787560974.375299:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560974.375877:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853404032 00000100:00100000:1.0:1787560974.375887:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853404032 00000100:00100000:1.0:1787560974.375937:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:1.0:1787560974.375945:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2401:x1874392853404032:12345-192.168.203.29@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787560974.375982:0:24250:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from d8c1ddb2-5530-4170-b71a-50058cae7059@192.168.203.29@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:1.0:1787560974.376258:0:24250:0:(genops.c:1385:class_connect()) connect: client d8c1ddb2-5530-4170-b71a-50058cae7059, cookie 0x4642c20bf2f35bf9 00002000:00100000:1.0:1787560974.376274:0:24250:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d8c1ddb2-5530-4170-b71a-50058cae7059/ffff9caec1c49000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787560974.376288:0:24250:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1787560974.376409:0:24250:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787560974.376478:0:24250:0:(import.c:65:import_set_state_nolock()) ffff9caec1c4d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787560974.377826:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8c1ddb2-5530-4170-b71a-50058cae7059+6:2401:x1874392853404032:12345-192.168.203.29@tcp:8:mount.lustre.0 Request processed in 1870us (2517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560974.377840:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:3.0:1787560974.381920:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560974.382113:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853404288 00000100:00100000:2.0:1787560974.382127:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853404288 00000100:00100000:2.0:1787560974.382292:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:2.0:1787560974.382305:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8c1ddb2-5530-4170-b71a-50058cae7059+6:18198:x1874392853404288:12345-192.168.203.29@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787560974.382428:0:22744:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787560974.382602:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8c1ddb2-5530-4170-b71a-50058cae7059+6:18198:x1874392853404288:12345-192.168.203.29@tcp:33:mount.lustre.0 Request processed in 299us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560974.382611:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:3.0:1787560974.603225:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560974.604251:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853404416 00000100:00100000:1.0:1787560974.604272:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853404416 00000100:00100000:1.0:1787560974.604363:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:1.0:1787560974.604376:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8c1ddb2-5530-4170-b71a-50058cae7059+6:18232:x1874392853404416:12345-192.168.203.29@tcp:101:mkdir.0 00010000:00010000:1.0:1787560974.604506:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560974.604542:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f35c00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf460602aa expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560974.604644:0:22741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe000/0x4642c20bf2f35c07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560974.604666:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe000/0x4642c20bf2f35c07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560974.604682:0:22741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe000/0x4642c20bf2f35c07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787560974.604746:0:22741:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787560974.604752:0:22741:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787560974.604783:0:22741:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe000/0x4642c20bf2f35c07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560974.604818:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffa00/0x4642c20bf2f35c00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602aa expref: 8 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560974.604841:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe000/0x4642c20bf2f35c07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602aa expref: 7 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560974.604850:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafd33ffe00) 00010000:00010000:1.0:1787560974.604853:0:22741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787560974.604877:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb0021fe000, rc 0) 00000100:00100000:1.0:1787560974.604961:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8c1ddb2-5530-4170-b71a-50058cae7059+7:18232:x1874392853404416:12345-192.168.203.29@tcp:101:mkdir.0 Request processed in 589us (1750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560974.604968:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 22 00010000:00010000:2.0:1787560974.835663:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560975.861442:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560975.924907:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787560975.924947:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862957568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787560975.925069:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560975.927337:0:24251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862957568 00000100:00100000:3.0:1787560975.927357:0:24251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862957568 00000100:00100000:3.0:1787560975.927510:0:24251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787560975.927527:0:24251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff7695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862957568:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787560975.927855:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1787560975.928063:0:24251:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787560975.928198:0:24251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff7695500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862957568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 674us (3127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560975.928207:0:24251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787560975.928483:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862957568:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787560976.883607:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560976.948994:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862957696:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787560976.949018:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3af1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862957824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787560976.949119:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560976.949131:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560976.949269:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862957696 00000100:00100000:3.0:1787560976.949280:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862957696 00000100:00100000:3.0:1787560976.949360:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787560976.949374:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862957696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787560976.949423:0:22745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787560976.949535:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff7697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862958080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787560976.949553:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862957696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 180us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560976.949575:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787560976.949599:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560976.949635:0:24251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862957824 00000100:00100000:3.0:1787560976.949642:0:24251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862957824 00000100:00100000:0.0:1787560976.949669:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff7694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862958592:0@lo:400:kworker.0 00000100:00100000:0.0:1787560976.949714:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560976.949727:0:24251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862958080 00000100:00100000:3.0:1787560976.949732:0:24251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862958080 00000100:00100000:3.0:1787560976.949771:0:24251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787560976.949777:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff7694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862959104:0@lo:400:kworker.0 00000100:00100000:3.0:1787560976.949787:0:24251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862957824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787560976.949813:0:24251:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787560976.949824:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560976.949858:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff7697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862959616:0@lo:400:kworker.0 00000100:00100000:3.0:1787560976.949872:0:24251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862957824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560976.949880:0:24251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787560976.949898:0:24251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787560976.949906:0:24251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff7696300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862958080:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560976.949916:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1787560976.949929:0:24251:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787560976.949953:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1787560976.949965:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3af3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862957952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560976.949976:0:24251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff7696300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862958080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560976.949984:0:24251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1787560976.950012:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787560976.950020:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787560976.950021:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787560976.950046:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff7695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c33dd467-64b2-4362-8604-d1a6489592bb:3624:1874392862958336:0@lo:400:kworker.0 00000100:00100000:0.0:1787560976.950060:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff7697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862958464:0@lo:400:kworker.0 00000100:00100000:3.0:1787560976.950106:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560976.950116:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560976.950163:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff7696680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862958848:0@lo:400:kworker.0 00000100:00100000:0.0:1787560976.950164:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff7696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862958976:0@lo:400:kworker.0 00000100:00100000:0.0:1787560976.950217:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560976.950234:0:24251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862957952 00000100:00100000:3.0:1787560976.950240:0:24251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862957952 00000100:00100000:0.0:1787560976.950257:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff7695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862959488:0@lo:400:kworker.0 00000100:00100000:3.0:1787560976.950282:0:24251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787560976.950291:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560976.950295:0:24251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862957952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787560976.950312:0:24251:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787560976.950369:0:24251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862957952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560976.950369:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff7697b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862958080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787560976.950400:0:24251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787560976.950470:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1787560976.950472:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862958592 00000100:00100000:3.0:1787560976.950479:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862958592 00000100:00100000:0.0:1787560976.950497:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3af3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862957952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560976.950517:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862958976 00000100:00100000:3.0:1787560976.950522:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862958976 00000100:00100000:3.0:1787560976.950550:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787560976.950578:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff7695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862958592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560976.950581:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862959104 00000100:00100000:0.0:1787560976.950591:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862959104 00000100:00100000:3.0:1787560976.950633:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff7695f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862958592:12345-0@lo:400:kworker.0 Request processed in 74us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560976.950644:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787560976.950646:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862959616 00000100:00100000:0.0:1787560976.950652:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862959616 00000100:00100000:3.0:1787560976.950666:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787560976.950676:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862958976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560976.950678:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862959488 00000100:00100000:0.0:1787560976.950685:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862959488 00000100:00100000:0.0:1787560976.950720:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787560976.950727:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862958976:12345-0@lo:400:kworker.0 Request processed in 49us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560976.950738:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787560976.950744:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff7694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874392862959104:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787560976.950771:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787560976.950778:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787560976.950782:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787560976.950797:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560976.950827:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff7697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862959360:0@lo:400:kworker.0 00000100:00100000:0.0:1787560976.950836:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff7694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1874392862959104:12345-0@lo:400:kworker.0 Request processed in 95us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560976.950847:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787560976.950873:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560976.950884:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787560976.950897:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff7694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862959616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560976.950924:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3850380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862957696:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787560976.950955:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff7694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1874392862959616:12345-0@lo:400:kworker.0 Request processed in 62us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560976.950957:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787560976.950974:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff7695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862958208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787560976.950976:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787560976.951001:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862959360 00000100:00100000:0.0:1787560976.951008:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862959360 00000100:00100000:3.0:1787560976.951022:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560976.951054:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff7694a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862958720:0@lo:400:kworker.0 00000100:00100000:0.0:1787560976.951057:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787560976.951071:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862959488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560976.951110:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560976.951141:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff7696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862959232:0@lo:400:kworker.0 00000100:00100000:0.0:1787560976.951145:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862959488:12345-0@lo:400:kworker.0 Request processed in 74us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560976.951156:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787560976.951172:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862958720 00000100:00100000:0.0:1787560976.951176:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862958720 00000100:00100000:3.0:1787560976.951183:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560976.951204:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862959232 00000100:00100000:0.0:1787560976.951209:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862959232 00000100:00080000:3.0:1787560976.951217:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787560976.951226:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560976.951247:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787560976.951248:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862958848 00000100:00100000:3.0:1787560976.951254:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862958848 00000100:00100000:0.0:1787560976.951276:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862959360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560976.951295:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787560976.951306:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862958848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560976.951341:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1874392862959360:12345-0@lo:400:kworker.0 Request processed in 71us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560976.951354:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787560976.951365:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862958848:12345-0@lo:400:kworker.0 Request processed in 60us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560976.951381:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787560976.951382:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787560976.951398:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862958720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560976.951416:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862958464 00000100:00100000:3.0:1787560976.951422:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862958464 00000100:00100000:3.0:1787560976.951497:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862958208 00000100:00100000:0.0:1787560976.951499:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862958720:12345-0@lo:400:kworker.0 Request processed in 99us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560976.951504:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862958208 00000100:00100000:0.0:1787560976.951516:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787560976.951532:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787560976.951543:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3626:x1874392862958464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560976.951550:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787560976.951577:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862959232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560976.951609:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3626:x1874392862958464:12345-0@lo:400:kworker.0 Request processed in 67us (1496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560976.951619:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787560976.951644:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787560976.951659:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862958208:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787560976.951662:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862959232:12345-0@lo:400:kworker.0 Request processed in 95us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560976.951678:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00000024:3.0:1787560976.951700:0:22745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787560976.951752:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862958208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560976.951762:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787560976.951769:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862958336 00000100:00100000:0.0:1787560976.951781:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862958336 00000100:00100000:0.0:1787560976.951834:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787560976.951844:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff7695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862958208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787560976.951846:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+24:3624:x1874392862958336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560976.951870:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff7694a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862958720:0@lo:400:kworker.0 00000100:00100000:3.0:1787560976.951891:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff7696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862959232:0@lo:400:kworker.0 00000100:00100000:0.0:1787560976.951915:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+24:3624:x1874392862958336:12345-0@lo:400:kworker.0 Request processed in 70us (1810us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560976.951917:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff7695180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c33dd467-64b2-4362-8604-d1a6489592bb:3624:1874392862958336:0@lo:400:kworker.0 00000100:00100000:0.0:1787560976.951936:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787560976.951943:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff7696680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862958848:0@lo:400:kworker.0 00010000:00080000:3.0:1787560976.951964:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caff7697480 x1874392862959360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560976.951976:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff7697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1874392862959360:0@lo:400:kworker.0 00000100:00100000:0.0:1787560976.952062:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff7697100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862958464:0@lo:400:kworker.0 00000100:00100000:0.0:1787560976.952082:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff7696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862958976:0@lo:400:kworker.0 00000100:00100000:0.0:1787560976.952099:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff7695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862959488:0@lo:400:kworker.0 00000100:00100000:0.0:1787560976.952127:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff7694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862958592:0@lo:400:kworker.0 00000100:00100000:0.0:1787560976.952139:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff7694380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1874392862959104:0@lo:400:kworker.0 00010000:00080000:0.0:1787560976.952151:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caff7697800 x1874392862959616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560976.952161:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff7697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1874392862959616:0@lo:400:kworker.0 00000100:00100000:3.0:1787560976.961948:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3af1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862957824:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1787560977.473906:0:22720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d8c1ddb2-5530-4170-b71a-50058cae7059 00000001:00100000:3.0:1787560977.473922:0:22720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ca781b59-3c9b-4203-8040-d3d106b1f7b5 00000001:00100000:1.0:1787560977.476895:0:23473:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d8c1ddb2-5530-4170-b71a-50058cae7059 00000001:00100000:1.0:1787560977.476911:0:23473:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ca781b59-3c9b-4203-8040-d3d106b1f7b5 00000001:00100000:0.0:1787560977.480547:0:24244:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d8c1ddb2-5530-4170-b71a-50058cae7059 00000001:00100000:0.0:1787560977.480572:0:24244:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ca781b59-3c9b-4203-8040-d3d106b1f7b5 00000001:02000400:0.0:1787560977.590306:0:25620:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787560977.912888:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787560978.357005:0:22774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787560978.932006:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560979.454950:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560979.455005:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560979.455110:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560979.455149:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853404672 00000100:00100000:3.0:1787560979.455168:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853404672 00000100:00100000:3.0:1787560979.455300:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853404800 00000100:00100000:3.0:1787560979.455305:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853404800 00000100:00100000:3.0:1787560979.455333:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00100000:3.0:1787560979.455346:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+6:2402:x1874392853404672:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560979.455482:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+6:2402:x1874392853404672:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 139us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560979.455511:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00100000:3.0:1787560979.455534:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 45 00000100:00100000:3.0:1787560979.455541:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+5:2403:x1874392853404800:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560979.455877:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853404544 00000100:00100000:2.0:1787560979.455884:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853404544 00000100:00100000:2.0:1787560979.455946:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 146 00000100:00100000:2.0:1787560979.455955:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bb825e1-70be-45ed-969c-e040921081a0+13:2403:x1874392853404544:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1787560979.455998:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bb825e1-70be-45ed-969c-e040921081a0+13:2403:x1874392853404544:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 44us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560979.456006:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 146 00000100:00100000:3.0:1787560979.460179:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+5:2403:x1874392853404800:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 4629us (5060us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560979.460198:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 45 00000100:00080000:3.0:1787560979.460264:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787560979.460273:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560979.460419:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560979.460519:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560979.460569:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560979.460724:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853404928 00000100:00100000:1.0:1787560979.460738:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853404928 00000100:00100000:1.0:1787560979.460805:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853405056 00000100:00100000:1.0:1787560979.460809:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853405056 00000100:00100000:1.0:1787560979.460847:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:1.0:1787560979.460858:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+5:2402:x1874392853404928:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560979.460899:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+5:2402:x1874392853404928:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 44us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560979.460906:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:1.0:1787560979.460919:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:1.0:1787560979.460926:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+5:2403:x1874392853405056:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560979.460950:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+5:2403:x1874392853405056:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 25us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560979.460957:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:2.0:1787560979.461084:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560979.461119:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560979.461141:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560979.461343:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853405184 00000100:00100000:1.0:1787560979.461348:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853405184 00000100:00100000:1.0:1787560979.461387:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853405312 00000100:00100000:1.0:1787560979.461390:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853405312 00000100:00100000:1.0:1787560979.461404:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 46 00000100:00100000:1.0:1787560979.461411:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8c1ddb2-5530-4170-b71a-50058cae7059+6:2402:x1874392853405184:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560979.461498:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8c1ddb2-5530-4170-b71a-50058cae7059+6:2402:x1874392853405184:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 87us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560979.461506:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 46 00000100:00100000:1.0:1787560979.461519:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 47 00000100:00100000:1.0:1787560979.461526:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8c1ddb2-5530-4170-b71a-50058cae7059+5:2403:x1874392853405312:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560979.461556:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8c1ddb2-5530-4170-b71a-50058cae7059+5:2403:x1874392853405312:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 31us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560979.461563:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 47 00000100:00100000:1.0:1787560979.461588:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853405440 00000100:00100000:1.0:1787560979.461591:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853405440 00000100:00100000:1.0:1787560979.461608:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853405568 00000100:00100000:1.0:1787560979.461610:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853405568 00000100:00100000:1.0:1787560979.461624:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:1.0:1787560979.461630:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3baea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8c1ddb2-5530-4170-b71a-50058cae7059+5:2402:x1874392853405440:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560979.461653:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3baea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8c1ddb2-5530-4170-b71a-50058cae7059+5:2402:x1874392853405440:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 24us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560979.461659:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:1.0:1787560979.461669:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:1.0:1787560979.461674:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8c1ddb2-5530-4170-b71a-50058cae7059+6:2403:x1874392853405568:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560979.461695:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8c1ddb2-5530-4170-b71a-50058cae7059+6:2403:x1874392853405568:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 21us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560979.461701:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00080000:3.0:1787560979.466721:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787560979.466735:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787560979.466741:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787560979.466744:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787560979.955604:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787560980.538531:0:25063:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d8c1ddb2-5530-4170-b71a-50058cae7059 00010000:00010000:2.0:1787560980.979768:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560981.047314:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862959744:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787560981.047474:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560981.047555:0:24251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862959744 00000100:00100000:3.0:1787560981.047567:0:24251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862959744 00000100:00080000:1.0:1787560981.047769:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787560981.048410:0:24251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787560981.048427:0:24251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862959744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787560981.049996:0:24251:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787560981.050120:0:24251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862959744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1695us (2644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560981.050132:0:24251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787560981.050417:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862959744:0@lo:13:osp-pre-0-1.0 00000020:00000080:3.0:1787560981.921454:0:25768:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff952f87a0 20000000:00000080:3.0:1787560981.921477:0:25768:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cafc4acc000 uarg=0000000000000000 20000000:01000000:3.0:1787560981.921545:0:25768:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787560981.921551:0:25768:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787560981.921556:0:25768:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787560981.922744:0:25769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1787560981.923055:0:25768:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787560981.936245:0:25768:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787560981.936384:0:25768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f35c0e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560981.936410:0:25768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffca48000/0x4642c20bf2f3586b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35864 expref: 23 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560981.936468:0:25768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffca49600/0x4642c20bf2f35879 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35872 expref: 23 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560981.936475:0:25768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cafda2f7e00/0x4642c20bf2f358b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f358b1 expref: 23 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560981.936482:0:25768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffcbffc00/0x4642c20bf2f35952 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f3594b expref: 23 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560981.936493:0:25768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffca48a00/0x4642c20bf2f35b9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060209 expref: 12 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560981.936501:0:25768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f35bdd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060279 expref: 12 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560981.936509:0:25768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f35c0e lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560981.936572:0:25768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f35bdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060279 expref: 12 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560981.936590:0:25768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f35bdd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060279 expref: 12 pid: 22733 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560981.936606:0:25768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25768:1874392862959872:192.168.203.29@tcp:104: 00010000:00010000:3.0:1787560981.936730:0:25768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffca48a00/0x4642c20bf2f35b9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060209 expref: 12 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560981.936750:0:25768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9caffca48a00/0x4642c20bf2f35b9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060209 expref: 12 pid: 22733 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560981.936771:0:25768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25768:1874392862960000:192.168.203.29@tcp:104: 00010000:00010000:3.0:1787560981.936806:0:25768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffcbffc00/0x4642c20bf2f35952 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f3594b expref: 23 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560981.936813:0:25768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9caffcbffc00/0x4642c20bf2f35952 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f3594b expref: 23 pid: 22734 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560981.936823:0:25768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25768:1874392862960128:0@lo:104: 00000100:00100000:3.0:1787560981.936862:0:25768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787560981.936894:0:25768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cafda2f7e00/0x4642c20bf2f358b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f358b1 expref: 23 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560981.936901:0:25768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cafda2f7e00/0x4642c20bf2f358b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f358b1 expref: 23 pid: 22733 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560981.936908:0:25768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25768:1874392862960256:0@lo:104: 00000100:00100000:3.0:1787560981.936926:0:25768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787560981.936958:0:25768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffca49600/0x4642c20bf2f35879 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f35872 expref: 23 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560981.936965:0:25768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9caffca49600/0x4642c20bf2f35879 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f35872 expref: 23 pid: 22733 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560981.936974:0:25768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25768:1874392862960384:0@lo:104: 00000100:00100000:3.0:1787560981.936991:0:25768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787560981.937004:0:25768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9caffca48000/0x4642c20bf2f3586b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4642c20bf2f35864 expref: 23 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560981.937023:0:25768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9caffca48000/0x4642c20bf2f3586b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4642c20bf2f35864 expref: 23 pid: 22733 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560981.937031:0:25768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25768:1874392862960512:0@lo:104: 00000100:00100000:3.0:1787560981.937051:0:25768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560981.937061:0:25768:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec42eac00 going to sleep for 11 seconds 00000100:00100000:2.0:1787560981.937152:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862960128 00000100:00100000:2.0:1787560981.937161:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862960128 00000100:00100000:1.0:1787560981.937164:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862960256 00000100:00100000:1.0:1787560981.937173:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862960256 00000100:00100000:2.0:1787560981.937204:0:22724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862960384 00000100:00100000:1.0:1787560981.937204:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862960512 00000100:00100000:2.0:1787560981.937206:0:22724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862960384 00000100:00100000:1.0:1787560981.937206:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862960512 00000100:00100000:2.0:1787560981.937219:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787560981.937227:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c33dd467-64b2-4362-8604-d1a6489592bb+6:25768:x1874392862960256:12345-0@lo:104: 00010000:00010000:2.0:1787560981.937241:0:22724:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9caffcbfee00/0x4642c20bf2f358b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f358b8 expref: -99 pid: 24243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560981.937309:0:22724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787560981.937316:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c33dd467-64b2-4362-8604-d1a6489592bb+6:25768:x1874392862960256:12345-0@lo:104: Request processed in 89us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560981.937464:0:25768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25768:1874392862960256:0@lo:104: 00010000:00010000:3.0:1787560981.946829:0:25080:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787560981.946843:0:25080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caffcbfee00/0x4642c20bf2f358b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f358b8 expref: -99 pid: 24243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560981.946854:0:25080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbfee00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:3.0:1787560981.946859:0:25080:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caffcbfee00/0x4642c20bf2f358b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f358b8 expref: -99 pid: 24243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560981.946868:0:25080:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caffcbfee00/0x4642c20bf2f358b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f358b8 expref: -99 pid: 24243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787560981.946874:0:25080:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caffcbfee00/0x4642c20bf2f358b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f358b8 expref: -99 pid: 24243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560981.946879:0:25080:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787560981.946936:0:25080:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caffcbfee00/0x4642c20bf2f358b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f358b8 expref: -99 pid: 24243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560981.946944:0:25080:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787560981.946968:0:25080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caffcbfee00/0x4642c20bf2f358b1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f358b8 expref: -99 pid: 24243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560981.946995:0:25080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caffcbfee00/0x4642c20bf2f358b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f358b8 expref: -99 pid: 24243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560981.947007:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560981.947009:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560981.947010:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560981.947019:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787560981.947040:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec33c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c33dd467-64b2-4362-8604-d1a6489592bb:3623:1874392862960640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787560981.947115:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560981.947182:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862960640 00000100:00100000:3.0:1787560981.947190:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862960640 00010000:00010000:3.0:1787560981.947217:0:22726:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cafda2f7e00/0x4642c20bf2f358b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f358b1 expref: 24 pid: 22733 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560981.947241:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787560981.947249:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c33dd467-64b2-4362-8604-d1a6489592bb+24:3623:x1874392862960640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787560981.947260:0:22726:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560981.947265:0:22726:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cafda2f7e00/0x4642c20bf2f358b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f358b1 expref: 24 pid: 22733 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560981.947275:0:22726:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cafda2f7e00/0x4642c20bf2f358b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f358b1 expref: 24 pid: 22733 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560981.947290:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafda2f7e00/0x4642c20bf2f358b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f358b1 expref: 24 pid: 22733 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560981.947303:0:22726:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560981.947334:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c33dd467-64b2-4362-8604-d1a6489592bb+23:3623:x1874392862960640:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560981.947347:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787560981.947379:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c33dd467-64b2-4362-8604-d1a6489592bb:3623:1874392862960640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787560981.949855:0:25768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25768:1874392862959872:192.168.203.29@tcp:104: 00000100:00100000:3.0:1787560981.949940:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560981.950011:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560981.950058:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787560981.950096:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787560981.950109:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c33dd467-64b2-4362-8604-d1a6489592bb+5:25768:x1874392862960128:12345-0@lo:104: 00010000:00010000:2.0:1787560981.950128:0:22724:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f3594b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f35952 expref: -99 pid: 25062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560981.950206:0:22724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787560981.950213:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c33dd467-64b2-4362-8604-d1a6489592bb+5:25768:x1874392862960128:12345-0@lo:104: Request processed in 109us (13350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560981.950219:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1787560981.950237:0:22729:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560981.950243:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f3594b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f35952 expref: -99 pid: 25062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560981.950251:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafda2f6e00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:2.0:1787560981.950255:0:22729:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f3594b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f35952 expref: -99 pid: 25062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560981.950263:0:22729:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f3594b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f35952 expref: -99 pid: 25062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560981.950270:0:22729:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f3594b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f35952 expref: -99 pid: 25062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560981.950276:0:22729:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787560981.950310:0:22729:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f3594b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35952 expref: -99 pid: 25062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560981.950317:0:22729:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560981.950349:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f3594b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35952 expref: -99 pid: 25062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560981.950356:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9cafda2f6e00/0x4642c20bf2f3594b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35952 expref: -99 pid: 25062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560981.950369:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560981.950371:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560981.950372:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560981.950386:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c33dd467-64b2-4362-8604-d1a6489592bb:3625:1874392862960768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787560981.950458:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787560981.950466:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c33dd467-64b2-4362-8604-d1a6489592bb+4:25768:x1874392862960512:12345-0@lo:104: 00010000:00010000:2.0:1787560981.950474:0:22724:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35864 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f3586b expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560981.950507:0:22724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787560981.950512:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c33dd467-64b2-4362-8604-d1a6489592bb+4:25768:x1874392862960512:12345-0@lo:104: Request processed in 48us (13460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560981.950517:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787560981.950543:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560981.950549:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35864 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f3586b expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560981.950555:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbffa00 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:2.0:1787560981.950558:0:22728:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35864 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f3586b expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560981.950565:0:22728:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35864 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f3586b expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560981.950583:0:22728:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35864 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f3586b expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560981.950588:0:22728:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787560981.950603:0:22728:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35864 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f3586b expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560981.950608:0:22728:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560981.950619:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35864 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f3586b expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560981.950625:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caffcbffa00/0x4642c20bf2f35864 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f3586b expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560981.950634:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560981.950636:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560981.950637:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560981.950648:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c33dd467-64b2-4362-8604-d1a6489592bb:3626:1874392862960896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787560981.950695:0:22724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787560981.950703:0:22724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c33dd467-64b2-4362-8604-d1a6489592bb+3:25768:x1874392862960384:12345-0@lo:104: 00010000:00010000:2.0:1787560981.950710:0:22724:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f35872 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f35879 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560981.950757:0:22724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787560981.950762:0:22724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c33dd467-64b2-4362-8604-d1a6489592bb+3:25768:x1874392862960384:12345-0@lo:104: Request processed in 61us (13770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560981.950767:0:22724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1787560981.950788:0:25080:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787560981.950793:0:25080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f35872 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4642c20bf2f35879 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560981.950799:0:25080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49400 already unused, calling callback (ffffffffc1413c20) 10000000:00010000:2.0:1787560981.950802:0:25080:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f35872 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4642c20bf2f35879 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560981.950808:0:25080:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f35872 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4642c20bf2f35879 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787560981.950815:0:25080:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f35872 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4642c20bf2f35879 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560981.950820:0:25080:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787560981.950834:0:25080:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f35872 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35879 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560981.950839:0:25080:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787560981.950852:0:25080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f35872 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35879 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560981.950858:0:25080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff9caffca49400/0x4642c20bf2f35872 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4642c20bf2f35879 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560981.950872:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560981.950873:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787560981.950875:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560981.950882:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787560981.950892:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c33dd467-64b2-4362-8604-d1a6489592bb:3624:1874392862961024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787560981.950930:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560981.951002:0:25768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25768:1874392862960000:192.168.203.29@tcp:104: 00000100:00100000:0.0:1787560981.951014:0:25768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25768:1874392862960128:0@lo:104: 00000100:00100000:0.0:1787560981.951021:0:25768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25768:1874392862960384:0@lo:104: 00000100:00100000:0.0:1787560981.951028:0:25768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec33c3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25768:1874392862960512:0@lo:104: 00010000:00010000:0.0:1787560981.951064:0:25768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f35c0e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560981.953062:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560981.956944:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853405696 00000100:00100000:1.0:1787560981.956964:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853405696 00010000:00010000:1.0:1787560981.957023:0:22727:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f35bdd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060279 expref: 13 pid: 22733 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560981.957056:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853405824 00000100:00100000:1.0:1787560981.957060:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853405824 00010000:00010000:1.0:1787560981.957072:0:22727:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffca48a00/0x4642c20bf2f35b9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060209 expref: 14 pid: 22733 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560981.957084:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862961024 00000100:00100000:1.0:1787560981.957087:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862961024 00010000:00010000:1.0:1787560981.957100:0:22727:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffca49600/0x4642c20bf2f35879 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f35872 expref: 23 pid: 22733 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560981.957114:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:1.0:1787560981.957124:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2bb825e1-70be-45ed-969c-e040921081a0+14:2405:x1874392853405696:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560981.957140:0:22727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560981.957146:0:22727:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f35bdd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060279 expref: 14 pid: 22733 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560981.957159:0:22727:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f35bdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060279 expref: 14 pid: 22733 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560981.957177:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca49e00/0x4642c20bf2f35bdd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060279 expref: 14 pid: 22733 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560981.957195:0:22727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560981.957279:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2bb825e1-70be-45ed-969c-e040921081a0+13:2405:x1874392853405696:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 155us (7339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560981.957287:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:1.0:1787560981.957306:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:1.0:1787560981.957313:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2bb825e1-70be-45ed-969c-e040921081a0+12:2405:x1874392853405824:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560981.957321:0:22727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560981.957325:0:22727:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffca48a00/0x4642c20bf2f35b9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060209 expref: 12 pid: 22733 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560981.957334:0:22727:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffca48a00/0x4642c20bf2f35b9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060209 expref: 12 pid: 22733 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560981.957344:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca48a00/0x4642c20bf2f35b9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060209 expref: 12 pid: 22733 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560981.957353:0:22727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560981.957372:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2bb825e1-70be-45ed-969c-e040921081a0+11:2405:x1874392853405824:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 59us (7361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560981.957377:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:1.0:1787560981.957388:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787560981.957394:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c33dd467-64b2-4362-8604-d1a6489592bb+23:3624:x1874392862961024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560981.957403:0:22727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560981.957408:0:22727:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffca49600/0x4642c20bf2f35879 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f35872 expref: 23 pid: 22733 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560981.957415:0:22727:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffca49600/0x4642c20bf2f35879 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f35872 expref: 23 pid: 22733 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560981.957463:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca49600/0x4642c20bf2f35879 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f35872 expref: 23 pid: 22733 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560981.957472:0:22727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560981.957535:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c33dd467-64b2-4362-8604-d1a6489592bb+22:3624:x1874392862961024:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (6596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560981.957542:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787560981.958197:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862960768 00000100:00100000:1.0:1787560981.958205:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862960768 00010000:00010000:1.0:1787560981.958226:0:22725:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffcbffc00/0x4642c20bf2f35952 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f3594b expref: 22 pid: 22734 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560981.958245:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787560981.958252:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c33dd467-64b2-4362-8604-d1a6489592bb+22:3625:x1874392862960768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560981.958279:0:22725:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560981.958284:0:22725:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffcbffc00/0x4642c20bf2f35952 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f3594b expref: 22 pid: 22734 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560981.958293:0:22725:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffcbffc00/0x4642c20bf2f35952 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f3594b expref: 22 pid: 22734 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560981.958305:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffcbffc00/0x4642c20bf2f35952 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f3594b expref: 22 pid: 22734 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560981.958316:0:22725:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560981.958360:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c33dd467-64b2-4362-8604-d1a6489592bb+21:3625:x1874392862960768:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (5306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560981.958367:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787560981.958415:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c33dd467-64b2-4362-8604-d1a6489592bb:3624:1874392862961024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787560981.961849:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560981.962013:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862960896 00000100:00100000:1.0:1787560981.962024:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862960896 00010000:00010000:1.0:1787560981.962067:0:22725:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9caffca48000/0x4642c20bf2f3586b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f35864 expref: 21 pid: 22733 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560981.962104:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787560981.962112:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdf2c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c33dd467-64b2-4362-8604-d1a6489592bb+21:3626:x1874392862960896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560981.962126:0:22725:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560981.962132:0:22725:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9caffca48000/0x4642c20bf2f3586b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4642c20bf2f35864 expref: 21 pid: 22733 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560981.962143:0:22725:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9caffca48000/0x4642c20bf2f3586b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4642c20bf2f35864 expref: 21 pid: 22733 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560981.962160:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9caffca48000/0x4642c20bf2f3586b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4642c20bf2f35864 expref: 21 pid: 22733 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560981.962178:0:22725:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f35c0e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560981.962186:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f35c0e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560981.962203:0:22725:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f35c0e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560981.962210:0:22725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f35c0e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560981.962218:0:22725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f35c0e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560981.962237:0:22725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f35c0e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560981.962243:0:22725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc0030600 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560981.962248:0:22725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f35c0e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560981.962256:0:22725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f35c0e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560981.962275:0:22725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f35c0e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560981.962286:0:22725:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560981.962342:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdf2c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c33dd467-64b2-4362-8604-d1a6489592bb+20:3626:x1874392862960896:12345-0@lo:103:ldlm_bl.0 Request processed in 231us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560981.962350:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787560981.962408:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c33dd467-64b2-4362-8604-d1a6489592bb:3626:1874392862960896:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787560981.962483:0:25768:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f35c0e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560981.962492:0:25768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f35c0e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560981.962498:0:25768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cafc0030600/0x4642c20bf2f35c0e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560981.963806:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c33dd467-64b2-4362-8604-d1a6489592bb:3625:1874392862960768:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787560982.014039:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560982.067646:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862961152:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787560982.067713:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560982.067783:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862961152 00000100:00100000:0.0:1787560982.067792:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862961152 00000100:00100000:0.0:1787560982.067842:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787560982.067851:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862961152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787560982.067879:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787560982.067920:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1874392862961152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560982.067928:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1787560982.067948:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787560982.067987:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1874392862961152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787560982.068288:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862961280:0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.068322:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560982.068342:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862961792:0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.068361:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560982.068376:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862962304:0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.068409:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560982.068427:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862962816:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787560982.068465:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560982.068483:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787560982.068488:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862961408:0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.068511:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560982.068539:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862961920:0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.068561:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560982.068577:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862962432:0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.068595:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560982.068624:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862961280 00000100:00100000:3.0:1787560982.068629:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862961280 00000100:00100000:3.0:1787560982.068654:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862961792 00000100:00100000:3.0:1787560982.068669:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862961792 00000100:00100000:3.0:1787560982.068685:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862962816 00000100:00100000:3.0:1787560982.068688:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862962816 00000100:00100000:3.0:1787560982.068700:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787560982.068707:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2cce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862961280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.068752:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2cce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862961280:12345-0@lo:400:kworker.0 Request processed in 45us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560982.068759:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787560982.068787:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787560982.068796:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3625:x1874392862961792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.068822:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3625:x1874392862961792:12345-0@lo:400:kworker.0 Request processed in 29us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560982.068828:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787560982.068839:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787560982.068844:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862962816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787560982.068867:0:22745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787560982.068896:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862962816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560982.068902:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787560982.068924:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862962304 00000100:00100000:3.0:1787560982.068927:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862962304 00000100:00100000:3.0:1787560982.068956:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862962432 00000100:00100000:3.0:1787560982.068959:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862962432 00000100:00100000:3.0:1787560982.068973:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787560982.068979:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862962304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.069007:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862962304:12345-0@lo:400:kworker.0 Request processed in 28us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560982.069023:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787560982.069035:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787560982.069040:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862962432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.069066:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1874392862962432:12345-0@lo:400:kworker.0 Request processed in 26us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560982.069072:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787560982.069093:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862961408 00000100:00100000:3.0:1787560982.069097:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862961408 00000100:00100000:3.0:1787560982.069120:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862961920 00000100:00100000:3.0:1787560982.069123:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862961920 00000100:00100000:3.0:1787560982.069138:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787560982.069144:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862961408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.069175:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1874392862961408:12345-0@lo:400:kworker.0 Request processed in 31us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560982.069182:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787560982.069194:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787560982.069199:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862961920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.069224:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862961920:12345-0@lo:400:kworker.0 Request processed in 25us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560982.069230:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1787560982.069252:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787560982.069257:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787560982.069260:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787560982.069271:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862961664:0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.069297:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560982.069314:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862962176:0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.069344:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560982.069355:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862962688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787560982.069375:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560982.069394:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787560982.069400:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862961536:0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.069421:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560982.069476:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862962048:0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.069495:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560982.069505:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec2ccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874392862962560:0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.069535:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560982.069554:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862961536 00000100:00100000:3.0:1787560982.069558:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862961536 00000100:00100000:3.0:1787560982.069583:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787560982.069589:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862961536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.069620:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862961536:12345-0@lo:400:kworker.0 Request processed in 31us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560982.069625:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1787560982.069639:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787560982.069646:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862961664 00000100:00100000:3.0:1787560982.069650:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862961664 00000100:00100000:3.0:1787560982.069662:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862962176 00000100:00100000:3.0:1787560982.069664:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862962176 00000100:00100000:3.0:1787560982.069679:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862962048 00000100:00100000:3.0:1787560982.069681:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862962048 00000100:00100000:3.0:1787560982.069690:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862962560 00000100:00100000:3.0:1787560982.069692:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862962560 00000100:00100000:3.0:1787560982.069704:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787560982.069709:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862961664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.069741:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862961664:12345-0@lo:400:kworker.0 Request processed in 32us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560982.069747:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787560982.069759:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787560982.069764:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862962176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.069783:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862962176:12345-0@lo:400:kworker.0 Request processed in 20us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560982.069789:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787560982.069798:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787560982.069804:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862962048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.069825:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862962048:12345-0@lo:400:kworker.0 Request processed in 22us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560982.069831:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787560982.069841:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787560982.069847:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874392862962560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.069868:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874392862962560:12345-0@lo:400:kworker.0 Request processed in 22us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560982.069873:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1787560982.069885:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787560982.069887:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787560982.069895:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862962688 00000100:00100000:3.0:1787560982.069898:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862962688 00000100:00100000:3.0:1787560982.069916:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787560982.069922:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862962688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787560982.069940:0:22745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787560982.069967:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862962688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 45us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560982.069979:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787560982.070017:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862961408:0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.070028:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862961920:0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.070038:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1874392862962432:0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.070047:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1874392862961280:0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.070056:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862961792:0@lo:400:kworker.0 00010000:00080000:3.0:1787560982.070068:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2cce300 x1874392862962304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560982.070078:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862962304:0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.070089:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862962816:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787560982.070120:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862961536:0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.070129:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862962048:0@lo:400:kworker.0 00010000:00080000:3.0:1787560982.070137:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caec2ccf480 x1874392862962560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787560998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787560982.070145:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874392862962560:0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.070153:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862961664:0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.070162:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862962176:0@lo:400:kworker.0 00000100:00100000:3.0:1787560982.070172:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec2ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862962688:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787560982.070403:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862962944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787560982.070451:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560982.070485:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862962944 00000100:00100000:0.0:1787560982.070488:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862962944 00000100:00100000:0.0:1787560982.070512:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787560982.070517:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862962944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787560982.070542:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787560982.070576:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862962944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560982.070583:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787560982.070620:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862962944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560982.070748:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862963072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560982.070788:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560982.070825:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862963072 00000100:00100000:2.0:1787560982.070829:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862963072 00000100:00100000:2.0:1787560982.070850:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787560982.070855:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3baca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862963072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787560982.070865:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787560982.070892:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3baca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862963072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560982.070898:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787560982.070924:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862963072:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787560982.900121:0:23495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787560983.034684:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560983.631305:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560983.631579:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853405952 00000100:00100000:2.0:1787560983.631590:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853405952 00000100:00100000:2.0:1787560983.631665:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 147 00000100:00100000:2.0:1787560983.631681:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bb825e1-70be-45ed-969c-e040921081a0+11:18083:x1874392853405952:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560983.631706:0:22735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560983.631753:0:22735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caffca49400/0x4642c20bf2f35c15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf460602b1 expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.631791:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caffca49400/0x4642c20bf2f35c15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602b1 expref: 12 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.631806:0:22735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caffca49400/0x4642c20bf2f35c15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602b1 expref: 12 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.631837:0:22735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca49400, rc 0) 00000100:00100000:2.0:1787560983.631898:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bb825e1-70be-45ed-969c-e040921081a0+12:18083:x1874392853405952:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 Request processed in 223us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560983.631906:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 147 00000100:00100000:2.0:1787560983.639947:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560983.640022:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853406080 00000100:00100000:0.0:1787560983.640031:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853406080 00000100:00100000:0.0:1787560983.640098:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 148 00000100:00100000:0.0:1787560983.640108:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc47bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bb825e1-70be-45ed-969c-e040921081a0+12:18083:x1874392853406080:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560983.640260:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc47bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bb825e1-70be-45ed-969c-e040921081a0+12:18083:x1874392853406080:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 Request processed in 153us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560983.640269:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 148 00000100:00100000:3.0:1787560983.644623:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560983.645635:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853406208 00000100:00100000:0.0:1787560983.645653:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853406208 00000100:00100000:0.0:1787560983.645727:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 149 00000100:00100000:0.0:1787560983.645737:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4221c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bb825e1-70be-45ed-969c-e040921081a0+12:18083:x1874392853406208:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560983.645941:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4221c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bb825e1-70be-45ed-969c-e040921081a0+12:18083:x1874392853406208:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 Request processed in 204us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560983.645951:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 149 00000100:00100000:3.0:1787560983.666776:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560983.668012:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853406336 00000100:00100000:0.0:1787560983.668033:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853406336 00000100:00100000:0.0:1787560983.668125:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 150 00000100:00100000:0.0:1787560983.668138:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4223c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bb825e1-70be-45ed-969c-e040921081a0+12:18083:x1874392853406336:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787560983.669263:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560983.669298:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caec3088e00/0x4642c20bf2f35c1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x745b4bcf460602b8 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.669343:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec3088e00/0x4642c20bf2f35c1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602b8 expref: 13 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.669381:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caec3088e00/0x4642c20bf2f35c1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602b8 expref: 13 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.669392:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3088e00, rc 0) 00000100:00100000:0.0:1787560983.670961:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4223c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bb825e1-70be-45ed-969c-e040921081a0+13:18083:x1874392853406336:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 Request processed in 2812us (4189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560983.670978:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 150 00000100:00100000:3.0:1787560983.681949:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560983.682082:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853406464 00000100:00100000:2.0:1787560983.682098:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853406464 00000100:00100000:2.0:1787560983.682187:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 151 00000100:00100000:2.0:1787560983.682202:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4223050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bb825e1-70be-45ed-969c-e040921081a0+13:18083:x1874392853406464:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560983.682484:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4223050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bb825e1-70be-45ed-969c-e040921081a0+13:18083:x1874392853406464:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 Request processed in 284us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560983.682494:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 151 00000100:00100000:3.0:1787560983.694423:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560983.694654:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853406592 00000100:00100000:0.0:1787560983.694668:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853406592 00000100:00100000:0.0:1787560983.694747:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 152 00000100:00100000:0.0:1787560983.694760:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4222050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bb825e1-70be-45ed-969c-e040921081a0+13:18083:x1874392853406592:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560983.694958:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4222050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bb825e1-70be-45ed-969c-e040921081a0+13:18083:x1874392853406592:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 Request processed in 200us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560983.694969:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 152 10000000:01000000:1.0:1787560983.795589:0:22737:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787560983.795618:0:22737:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9caffc903800 from 13 10000000:01000000:1.0:1787560983.795625:0:22737:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787560983.795677:0:22737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe400/0x4642c20bf2f35c23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560983.795689:0:22737:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe400/0x4642c20bf2f35c23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560983.795700:0:22737:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe400/0x4642c20bf2f35c23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560983.795730:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862963200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787560983.795813:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560983.795870:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc75eae40 going to sleep for 11 seconds 00000100:00100000:0.0:1787560983.796020:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862963200 00000100:00100000:0.0:1787560983.796028:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862963200 00000100:00100000:0.0:1787560983.796098:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787560983.796109:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4222c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+20:22737:x1874392862963200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787560983.796127:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560983.796145:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caec3089600/0x4642c20bf2f35c2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f35c23 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.796172:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec3089600/0x4642c20bf2f35c2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f35c23 expref: 21 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.796183:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caec3089600/0x4642c20bf2f35c2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35c23 expref: 21 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.796212:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3089600, rc 0) 00000100:00100000:0.0:1787560983.796281:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4222c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+21:22737:x1874392862963200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560983.796287:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787560983.796392:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862963200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560983.796420:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe400/0x4642c20bf2f35c23 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35c2a expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.796457:0:22737:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe400/0x4642c20bf2f35c23 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35c2a expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560983.796533:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862963328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560983.796574:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560983.796604:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc4a33900 going to sleep for 11 seconds 00000100:00100000:0.0:1787560983.796764:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862963328 00000100:00100000:0.0:1787560983.796769:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862963328 00000100:00100000:0.0:1787560983.796800:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787560983.796807:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4220050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+21:22737:x1874392862963328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560983.796922:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4220050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+21:22737:x1874392862963328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560983.796929:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787560983.797034:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862963328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560983.797111:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffb884000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862963456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787560983.797206:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560983.797246:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec42eab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787560983.797290:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862963456 00000100:00100000:2.0:1787560983.797300:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862963456 00000100:00100000:2.0:1787560983.797361:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787560983.797393:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4220450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+21:22737:x1874392862963456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560983.797935:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4220450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+21:22737:x1874392862963456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 547us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560983.797942:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787560983.798051:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffb884000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862963456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787560983.799023:0:25781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787560983.799531:0:22737:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787560983.799626:0:22737:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787560983.799636:0:22737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe400/0x4642c20bf2f35c23 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35c2a expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.799648:0:22737:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cb0021fe400/0x4642c20bf2f35c23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35c2a expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787560983.799658:0:22737:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787560983.799661:0:22737:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9caffbb0c800 from 13 10000000:01000000:2.0:1787560983.799664:0:22737:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787560983.799698:0:22737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca48200/0x4642c20bf2f35c31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.799706:0:22737:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caffca48200/0x4642c20bf2f35c31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.799716:0:22737:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caffca48200/0x4642c20bf2f35c31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560983.799738:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862963584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787560983.799795:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560983.799882:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc4a33cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560983.804134:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862963584 00000100:00100000:1.0:1787560983.804148:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862963584 00000100:00100000:1.0:1787560983.804203:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787560983.804214:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4223850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+21:22737:x1874392862963584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560983.804230:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787560983.804245:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cb0021ff800/0x4642c20bf2f35c38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f35c31 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560983.804272:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cb0021ff800/0x4642c20bf2f35c38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f35c31 expref: 22 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560983.804284:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cb0021ff800/0x4642c20bf2f35c38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35c31 expref: 22 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560983.804294:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb0021ff800, rc 0) 00000100:00100000:1.0:1787560983.804579:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4223850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+22:22737:x1874392862963584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 366us (4783us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560983.804598:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787560983.804704:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862963584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787560983.804723:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caffca48200/0x4642c20bf2f35c31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35c38 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.804741:0:22737:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caffca48200/0x4642c20bf2f35c31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35c38 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560983.804814:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3bad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862963712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787560983.804847:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560983.804885:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc4a33cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787560983.804938:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862963712 00000100:00100000:0.0:1787560983.804943:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862963712 00000100:00100000:0.0:1787560983.805013:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787560983.805026:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4220c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+22:22737:x1874392862963712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560983.805205:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4220c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+22:22737:x1874392862963712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 183us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560983.805216:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787560983.805636:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3bad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862963712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560983.805688:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffb884000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862963840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787560983.805771:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560983.805830:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec42ea900 going to sleep for 11 seconds 00000100:00100000:2.0:1787560983.805983:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862963840 00000100:00100000:2.0:1787560983.805992:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862963840 00000100:00100000:2.0:1787560983.806059:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787560983.806071:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4222850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+22:22737:x1874392862963840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787560983.806193:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4222850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+22:22737:x1874392862963840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560983.806199:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787560983.807475:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffb884000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862963840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787560983.809931:0:25782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787560983.810160:0:22737:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787560983.810186:0:22737:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787560983.810197:0:22737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caffca48200/0x4642c20bf2f35c31 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35c38 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560983.810209:0:22737:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caffca48200/0x4642c20bf2f35c31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35c38 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787560983.810220:0:22737:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787560983.810223:0:22737:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cafffe2b000 from 13 10000000:01000000:3.0:1787560983.810226:0:22737:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787560983.810260:0:22737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc0031a00/0x4642c20bf2f35c3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560983.810279:0:22737:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9cafc0031a00/0x4642c20bf2f35c3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560983.810291:0:22737:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9cafc0031a00/0x4642c20bf2f35c3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560983.810314:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffb884000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862963968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787560983.810380:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560983.810416:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec42eab40 going to sleep for 11 seconds 00000100:00100000:0.0:1787560983.812003:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862963968 00000100:00100000:0.0:1787560983.812016:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862963968 00000100:00100000:0.0:1787560983.812088:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787560983.812099:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4223450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+22:22737:x1874392862963968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787560983.812113:0:22735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560983.812130:0:22735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9caec3089e00/0x4642c20bf2f35c46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f35c3f expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.812170:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9caec3089e00/0x4642c20bf2f35c46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f35c3f expref: 23 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.812181:0:22735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9caec3089e00/0x4642c20bf2f35c46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35c3f expref: 23 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.812191:0:22735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3089e00, rc 0) 00000100:00100000:0.0:1787560983.812265:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4223450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+23:22737:x1874392862963968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (1885us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560983.812270:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787560983.812388:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffb884000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862963968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787560983.812414:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9cafc0031a00/0x4642c20bf2f35c3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35c46 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560983.812422:0:22737:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9cafc0031a00/0x4642c20bf2f35c3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35c46 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560983.812525:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffb884000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862964096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560983.812577:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560983.812619:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec42eab40 going to sleep for 11 seconds 00000100:00100000:0.0:1787560983.813759:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862964096 00000100:00100000:0.0:1787560983.813772:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862964096 00000100:00100000:0.0:1787560983.813848:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787560983.813859:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4221850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+23:22737:x1874392862964096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787560983.814028:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4221850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+23:22737:x1874392862964096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 170us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560983.814035:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787560983.814235:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffb884000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862964096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560983.814298:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffb884000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862964224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787560983.814382:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560983.814509:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec42eab40 going to sleep for 11 seconds 00000100:00100000:1.0:1787560983.815154:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862964224 00000100:00100000:1.0:1787560983.815168:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862964224 00000100:00100000:1.0:1787560983.815226:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787560983.815241:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4221450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+23:22737:x1874392862964224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787560983.816242:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4221450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+23:22737:x1874392862964224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1002us (1858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560983.816251:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787560983.816361:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffb884000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862964224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787560983.818924:0:25783:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787560983.819109:0:22737:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787560983.819134:0:22737:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787560983.819145:0:22737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9cafc0031a00/0x4642c20bf2f35c3f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35c46 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.819156:0:22737:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9cafc0031a00/0x4642c20bf2f35c3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35c46 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787560983.819185:0:22737:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787560983.819188:0:22737:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9caffcb60800 from 13 10000000:01000000:0.0:1787560983.819190:0:22737:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787560983.819228:0:22737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3088400/0x4642c20bf2f35c4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.819235:0:22737:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff9caec3088400/0x4642c20bf2f35c4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.819244:0:22737:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff9caec3088400/0x4642c20bf2f35c4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560983.819269:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862964352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787560983.819328:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560983.819385:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafd99b63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560983.819503:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862964352 00000100:00100000:3.0:1787560983.819511:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862964352 00000100:00100000:3.0:1787560983.819575:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787560983.819584:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4222450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+23:22737:x1874392862964352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787560983.819596:0:22735:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560983.819609:0:22735:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cafc0031200/0x4642c20bf2f35c54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4642c20bf2f35c4d expref: -99 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560983.819634:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cafc0031200/0x4642c20bf2f35c54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4642c20bf2f35c4d expref: 24 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560983.819645:0:22735:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cafc0031200/0x4642c20bf2f35c54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4642c20bf2f35c4d expref: 24 pid: 22735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560983.819653:0:22735:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafc0031200, rc 0) 00000100:00100000:3.0:1787560983.819698:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4222450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c33dd467-64b2-4362-8604-d1a6489592bb+24:22737:x1874392862964352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560983.819705:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787560983.819808:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862964352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787560983.819836:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff9caec3088400/0x4642c20bf2f35c4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35c54 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560983.819845:0:22737:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff9caec3088400/0x4642c20bf2f35c4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4642c20bf2f35c54 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560983.819896:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862964480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787560983.819923:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560983.819951:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc75ea600 going to sleep for 11 seconds 00000100:00100000:3.0:1787560983.819999:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862964480 00000100:00100000:3.0:1787560983.820003:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862964480 00000100:00100000:3.0:1787560983.820037:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787560983.820047:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4220850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+24:22737:x1874392862964480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787560983.820188:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4220850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+24:22737:x1874392862964480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560983.820200:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787560983.820312:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862964480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787560983.820355:0:22737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffba2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862964608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787560983.820424:0:22737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560983.820511:0:22737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc75ea600 going to sleep for 11 seconds 00000100:00100000:0.0:1787560983.820645:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862964608 00000100:00100000:0.0:1787560983.820650:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862964608 00000100:00100000:0.0:1787560983.820711:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787560983.820719:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc4221050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+24:22737:x1874392862964608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787560983.820815:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc4221050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c33dd467-64b2-4362-8604-d1a6489592bb+24:22737:x1874392862964608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560983.820822:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787560983.821099:0:22737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffba2ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c33dd467-64b2-4362-8604-d1a6489592bb:22737:1874392862964608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787560983.829223:0:25784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787560983.836039:0:22737:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787560983.836084:0:22737:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787560983.836099:0:22737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff9caec3088400/0x4642c20bf2f35c4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35c54 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560983.836115:0:22737:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff9caec3088400/0x4642c20bf2f35c4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4642c20bf2f35c54 expref: -99 pid: 22737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560983.961706:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560983.961880:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853406720 00000100:00100000:0.0:1787560983.961891:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853406720 00000100:00080000:3.0:1787560983.961957:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787560983.961968:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:0.0:1787560983.961980:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+6:18704:x1874392853406720:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787560983.962226:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560983.962263:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35c5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf460602bf expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.962327:0:22741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088000/0x4642c20bf2f35c62 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.962338:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088000/0x4642c20bf2f35c62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.962364:0:22741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088000/0x4642c20bf2f35c62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.962380:0:22741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088800/0x4642c20bf2f35c69 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.962531:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088800/0x4642c20bf2f35c69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.962539:0:22741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088800/0x4642c20bf2f35c69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.962685:0:22741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089800/0x4642c20bf2f35c70 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.962694:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089800/0x4642c20bf2f35c70 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.962700:0:22741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089800/0x4642c20bf2f35c70 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560983.962727:0:22741:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787560983.962731:0:22741:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787560983.962768:0:22741:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089800/0x4642c20bf2f35c70 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.962785:0:22741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088000/0x4642c20bf2f35c62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.962792:0:22741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088000/0x4642c20bf2f35c62 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.962799:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088000/0x4642c20bf2f35c62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.962804:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3088000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560983.962807:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088000/0x4642c20bf2f35c62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.962814:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088000/0x4642c20bf2f35c62 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.962825:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafd33ffe00) 00010000:00010000:0.0:1787560983.962827:0:22741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560983.962832:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088000/0x4642c20bf2f35c62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.962839:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088000/0x4642c20bf2f35c62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.962854:0:22741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088800/0x4642c20bf2f35c69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.962860:0:22741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088800/0x4642c20bf2f35c69 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.962865:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088800/0x4642c20bf2f35c69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.962876:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3088800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560983.962879:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088800/0x4642c20bf2f35c69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.962884:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088800/0x4642c20bf2f35c69 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.962891:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9caec2028b00) 00010000:00010000:0.0:1787560983.962893:0:22741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560983.962896:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088800/0x4642c20bf2f35c69 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.962900:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088800/0x4642c20bf2f35c69 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.962932:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35c5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602bf expref: 8 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.962944:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089800/0x4642c20bf2f35c70 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602bf expref: 7 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560983.962950:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9caec2028600) 00010000:00010000:0.0:1787560983.962953:0:22741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787560983.962955:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3089800, rc 0) 00000100:00100000:0.0:1787560983.964719:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+7:18704:x1874392853406720:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 2730us (3012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560983.964731:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:3.0:1787560983.980728:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560983.980836:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853406848 00000100:00100000:1.0:1787560983.980850:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853406848 00000100:00100000:1.0:1787560983.980916:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:1.0:1787560983.980927:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+7:18704:x1874392853406848:12345-192.168.203.29@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787560983.981018:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+7:18704:x1874392853406848:12345-192.168.203.29@tcp:900:lhsmtool_posix.0 Request processed in 94us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560983.981026:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:1.0:1787560983.992108:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560983.992195:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853407104 00000100:00100000:2.0:1787560983.992205:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853407104 00000100:00100000:2.0:1787560983.992269:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:2.0:1787560983.992279:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffba2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+7:18704:x1874392853407104:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787560983.992298:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560983.992318:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48000/0x4642c20bf2f35c77 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf460602c6 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.992411:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35c7e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.992424:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35c7e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.992483:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35c7e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.992500:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35c85 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.992507:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35c85 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.992523:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35c85 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.992755:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49e00/0x4642c20bf2f35c8c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.992764:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49e00/0x4642c20bf2f35c8c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.992771:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49e00/0x4642c20bf2f35c8c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560983.992782:0:22742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1787560983.992932:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35c7e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.992939:0:22742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35c7e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.992945:0:22742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35c7e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.992951:0:22742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560983.992960:0:22742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35c7e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.992967:0:22742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35c7e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.992979:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9caec2028600) 00010000:00010000:2.0:1787560983.992982:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560983.992985:0:22742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35c7e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.992992:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35c7e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.993004:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35c85 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.993009:0:22742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35c85 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.993014:0:22742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35c85 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.993019:0:22742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca48a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560983.993022:0:22742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35c85 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.993027:0:22742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35c85 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.993032:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9cafd33ffb00) 00010000:00010000:2.0:1787560983.993034:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560983.993041:0:22742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35c85 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.993047:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35c85 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.996700:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48000/0x4642c20bf2f35c77 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602c6 expref: 10 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.996729:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49e00/0x4642c20bf2f35c8c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602c6 expref: 9 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560983.996739:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cafd33ffc00) 00010000:00010000:2.0:1787560983.996742:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560983.996745:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca49e00, rc 0) 00000100:00100000:2.0:1787560983.996825:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffba2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+9:18704:x1874392853407104:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 4547us (4725us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1787560983.996835:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:3.0:1787560984.011764:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560984.012655:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853407232 00000100:00100000:0.0:1787560984.012680:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853407232 00000100:00100000:0.0:1787560984.012744:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:0.0:1787560984.012753:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+9:18704:x1874392853407232:12345-192.168.203.29@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787560984.012853:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+9:18704:x1874392853407232:12345-192.168.203.29@tcp:59:lhsmtool_posix.0 Request processed in 101us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560984.012860:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:0.0:1787560984.023661:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560984.024135:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853407360 00000100:00100000:2.0:1787560984.024146:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853407360 00000100:00100000:2.0:1787560984.024224:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 26 00000100:00100000:2.0:1787560984.024236:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+5:18704:x1874392853407360:12345-192.168.203.29@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1787560984.024536:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1787560984.026548:0:22742:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2271us 00000100:00100000:3.0:1787560984.050741:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560984.051248:0:22740:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787560984.051260:0:22740:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787560984.051471:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853407488 00000100:00100000:0.0:1787560984.051481:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853407488 00000100:00100000:2.0:1787560984.051831:0:25786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 27 00000100:00100000:2.0:1787560984.051842:0:25786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca781b59-3c9b-4203-8040-d3d106b1f7b5+9:18710:x1874392853407488:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1787560984.051861:0:25786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560984.051886:0:25786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48000/0x4642c20bf2f35c9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf460602cd expref: -99 pid: 25786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.051945:0:25786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35ca1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.051957:0:25786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35ca1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.051967:0:25786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35ca1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.052028:0:25786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35ca8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.052036:0:25786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.052042:0:25786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.052083:0:25786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35ca1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.052091:0:25786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35ca1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.052098:0:25786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35ca1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.052104:0:25786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca48a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560984.052108:0:25786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35ca1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.052125:0:25786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35ca1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.052136:0:25786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafd33ffe00) 00010000:00010000:2.0:1787560984.052139:0:25786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560984.052144:0:25786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35ca1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.052150:0:25786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35ca1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.052162:0:25786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.052168:0:25786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35ca8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.052173:0:25786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.052178:0:25786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560984.052180:0:25786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.052186:0:25786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35ca8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.052192:0:25786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9cafd33ffb00) 00010000:00010000:2.0:1787560984.052195:0:25786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560984.052197:0:25786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35ca8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.052212:0:25786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35ca8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.052244:0:25786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48000/0x4642c20bf2f35c9a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602cd expref: 10 pid: 25786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.052255:0:25786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafd33ffe00) 00010000:00010000:2.0:1787560984.052257:0:25786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560984.052260:0:25786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48000/0x4642c20bf2f35c9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602cd expref: 10 pid: 25786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.052270:0:25786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca48000, rc 0) 00000100:00100000:2.0:1787560984.052327:0:25786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca781b59-3c9b-4203-8040-d3d106b1f7b5+9:18710:x1874392853407488:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 487us (1599us total) trans 0 rc 301/301 00000100:00100000:2.0:1787560984.052334:0:25786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 27 00010000:00010000:3.0:1787560984.052473:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787560984.062714:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+5:18704:x1874392853407360:12345-192.168.203.29@tcp:59:lhsmtool_posix.0 Request processed in 38468us (39049us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560984.062729:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 26 00000100:00100000:0.0:1787560984.071958:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560984.072058:0:22749:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853407616 00000100:00100000:2.0:1787560984.072068:0:22749:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853407616 00000100:00100000:2.0:1787560984.072124:0:22749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:2.0:1787560984.072135:0:22749:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+9:18710:x1874392853407616:12345-192.168.203.29@tcp:700:lfs.0 00000100:00100000:2.0:1787560984.072220:0:22749:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+9:18710:x1874392853407616:12345-192.168.203.29@tcp:700:lfs.0 Request processed in 86us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560984.072228:0:22749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:2.0:1787560984.076221:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560984.076357:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853407872 00000100:00100000:0.0:1787560984.076367:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853407872 00000100:00100000:0.0:1787560984.076424:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 28 00000100:00100000:0.0:1787560984.076465:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+9:18710:x1874392853407872:12345-192.168.203.29@tcp:36:lfs.0 00010000:00010000:0.0:1787560984.076527:0:22740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560984.076554:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49c00/0x4642c20bf2f35bc8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606023a expref: 9 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.076570:0:22740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafd33ffe00) 00010000:00010000:0.0:1787560984.076574:0:22740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560984.076632:0:22740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089c00/0x4642c20bf2f35caf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.076646:0:22740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe000/0x4642c20bf2f35c07 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602aa expref: 5 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.076654:0:22740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089c00/0x4642c20bf2f35caf lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.076704:0:22740:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe000/0x4642c20bf2f35c07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602aa expref: 5 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.076717:0:22740:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe000/0x4642c20bf2f35c07 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602aa expref: 5 pid: 22741 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560984.076731:0:22740:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab13800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22740:1874392862964736:192.168.203.29@tcp:104: 00000100:00100000:0.0:1787560984.076825:0:22740:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc2f41900 going to sleep for 11 seconds 00000100:00100000:0.0:1787560984.079365:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560984.079475:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853408000 00000100:00100000:1.0:1787560984.079485:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853408000 00010000:00010000:1.0:1787560984.079541:0:22725:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe000/0x4642c20bf2f35c07 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602aa expref: 6 pid: 22741 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560984.079578:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:1.0:1787560984.079588:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8c1ddb2-5530-4170-b71a-50058cae7059+6:2405:x1874392853408000:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560984.079601:0:22725:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560984.079607:0:22725:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe000/0x4642c20bf2f35c07 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602aa expref: 6 pid: 22741 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560984.079637:0:22725:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe000/0x4642c20bf2f35c07 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602aa expref: 6 pid: 22741 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560984.079658:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafd33ffe00) 00010000:00010000:1.0:1787560984.079663:0:22725:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089c00/0x4642c20bf2f35caf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560984.079672:0:22725:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089c00/0x4642c20bf2f35caf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560984.079678:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089c00/0x4642c20bf2f35caf lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560984.079694:0:22725:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560984.079745:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8c1ddb2-5530-4170-b71a-50058cae7059+6:2405:x1874392853408000:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 157us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560984.079752:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00080000:3.0:1787560984.079931:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787560984.080231:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021fe000/0x4642c20bf2f35c07 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602aa expref: 5 pid: 22741 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560984.080261:0:22740:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab13800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22740:1874392862964736:192.168.203.29@tcp:104: 00010000:00010000:2.0:1787560984.080283:0:22740:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089c00/0x4642c20bf2f35caf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.080292:0:22740:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089c00/0x4642c20bf2f35caf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.080299:0:22740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089c00/0x4642c20bf2f35caf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.080321:0:22740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48000/0x4642c20bf2f35cb6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.080332:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48000/0x4642c20bf2f35cb6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.080340:0:22740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48000/0x4642c20bf2f35cb6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.081974:0:22740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35cbd lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.081992:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35cbd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.082002:0:22740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35cbd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787560984.082018:0:22740:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e79b61b reply state 00000000ea205793 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35cbd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.082041:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35cbd lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.082047:0:22740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9cafd33ff400) 00010000:00010000:2.0:1787560984.082050:0:22740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787560984.082053:0:22740:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787560984.082059:0:22740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787560984.082067:0:22740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089c00/0x4642c20bf2f35caf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.082072:0:22740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089c00/0x4642c20bf2f35caf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.082078:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089c00/0x4642c20bf2f35caf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.082084:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3089c00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560984.082088:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089c00/0x4642c20bf2f35caf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.082095:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089c00/0x4642c20bf2f35caf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.082104:0:22740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafd33ffe00) 00010000:00010000:2.0:1787560984.082106:0:22740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560984.082109:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089c00/0x4642c20bf2f35caf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.082115:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089c00/0x4642c20bf2f35caf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787560984.082142:0:22740:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e79b61b reply state 00000000ea205793 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48000/0x4642c20bf2f35cb6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.082150:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48000/0x4642c20bf2f35cb6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.082156:0:22740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9cafd33ffb00) 00010000:00010000:2.0:1787560984.082157:0:22740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787560984.082160:0:22740:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787560984.082254:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+10:18710:x1874392853407872:12345-192.168.203.29@tcp:36:lfs.0 Request processed in 5790us (6041us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1787560984.082263:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 28 00000100:00100000:0.0:1787560984.218684:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560984.218755:0:25786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853408128 00000100:00100000:2.0:1787560984.218766:0:25786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853408128 00000100:00100000:2.0:1787560984.218839:0:25786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 29 00000100:00100000:2.0:1787560984.218850:0:25786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca781b59-3c9b-4203-8040-d3d106b1f7b5+10:18718:x1874392853408128:12345-192.168.203.29@tcp:101:lctl.0 00010000:00010000:2.0:1787560984.218875:0:25786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560984.218902:0:25786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35cc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf460602d4 expref: -99 pid: 25786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.218975:0:25786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49a00/0x4642c20bf2f35ccb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.218990:0:25786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49a00/0x4642c20bf2f35ccb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.219001:0:25786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49a00/0x4642c20bf2f35ccb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560984.219063:0:25786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787560984.219066:0:25786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787560984.219119:0:25786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49a00/0x4642c20bf2f35ccb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.219144:0:25786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35cc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602d4 expref: 12 pid: 25786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.219164:0:25786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49a00/0x4642c20bf2f35ccb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602d4 expref: 11 pid: 25786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.219173:0:25786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafd33ffe00) 00010000:00010000:2.0:1787560984.219176:0:25786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787560984.219180:0:25786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca49a00, rc 0) 00000100:00100000:2.0:1787560984.219593:0:25786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca781b59-3c9b-4203-8040-d3d106b1f7b5+11:18718:x1874392853408128:12345-192.168.203.29@tcp:101:lctl.0 Request processed in 743us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560984.219600:0:25786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 29 00000100:00100000:1.0:1787560984.258065:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560984.258149:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853408256 00000100:00100000:3.0:1787560984.258159:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853408256 00000100:00100000:3.0:1787560984.258220:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 30 00000100:00100000:3.0:1787560984.258229:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffba2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8c1ddb2-5530-4170-b71a-50058cae7059+5:18719:x1874392853408256:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1787560984.258248:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560984.258272:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030c00/0x4642c20bf2f35cd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf460602db expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.258333:0:22741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030a00/0x4642c20bf2f35cd9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.258347:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030a00/0x4642c20bf2f35cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.258371:0:22741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030a00/0x4642c20bf2f35cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560984.258422:0:22741:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787560984.258427:0:22741:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787560984.258752:0:22741:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030a00/0x4642c20bf2f35cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.258777:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030c00/0x4642c20bf2f35cd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602db expref: 7 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.258815:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030a00/0x4642c20bf2f35cd9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602db expref: 6 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.258824:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafd33ffe00) 00010000:00010000:3.0:1787560984.258827:0:22741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787560984.258830:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafc0030a00, rc 0) 00000100:00100000:3.0:1787560984.258933:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffba2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8c1ddb2-5530-4170-b71a-50058cae7059+6:18719:x1874392853408256:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 705us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560984.258941:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 30 00000100:00100000:0.0:1787560984.264718:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560984.264948:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853408384 00000100:00100000:3.0:1787560984.264958:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853408384 00000100:00100000:3.0:1787560984.265015:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 31 00000100:00100000:3.0:1787560984.265026:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8c1ddb2-5530-4170-b71a-50058cae7059+6:18719:x1874392853408384:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1787560984.265048:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560984.265069:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030c00/0x4642c20bf2f35ce0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf460602e2 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.265135:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35ce7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.265146:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35ce7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.265156:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35ce7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.265165:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f35cee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.265185:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f35cee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.265191:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f35cee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.265263:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f35cf5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.265271:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f35cf5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.265277:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f35cf5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560984.265314:0:22742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787560984.265318:0:22742:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787560984.265337:0:22742:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f35cf5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.265361:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35ce7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.265368:0:22742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35ce7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.265373:0:22742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35ce7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.265378:0:22742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc0030800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560984.265382:0:22742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35ce7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.265395:0:22742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35ce7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.265406:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafd33ffe00) 00010000:00010000:3.0:1787560984.265409:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560984.265413:0:22742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35ce7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.265419:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35ce7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.265615:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f35cee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.265623:0:22742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f35cee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.265629:0:22742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f35cee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.265634:0:22742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc0030400 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560984.265637:0:22742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f35cee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.265643:0:22742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f35cee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.265651:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9cafd33ffb00) 00010000:00010000:3.0:1787560984.265653:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560984.265661:0:22742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f35cee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.265678:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f35cee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.265707:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030c00/0x4642c20bf2f35ce0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602e2 expref: 8 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.265722:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f35cf5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602e2 expref: 7 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.265729:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9cafd33ff400) 00010000:00010000:3.0:1787560984.265731:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787560984.265734:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafc0030200, rc 0) 00000100:00100000:3.0:1787560984.265810:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8c1ddb2-5530-4170-b71a-50058cae7059+7:18719:x1874392853408384:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 785us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560984.266256:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 31 00000100:00100000:0.0:1787560984.271037:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560984.271145:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853408512 00000100:00100000:1.0:1787560984.271155:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853408512 00000100:00100000:1.0:1787560984.271230:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:1.0:1787560984.271242:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d8c1ddb2-5530-4170-b71a-50058cae7059+5:18719:x1874392853408512:12345-192.168.203.29@tcp:900:lfs.0 00000100:00100000:1.0:1787560984.271374:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d8c1ddb2-5530-4170-b71a-50058cae7059+5:18719:x1874392853408512:12345-192.168.203.29@tcp:900:lfs.0 Request processed in 133us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560984.271389:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00080000:3.0:1787560984.271578:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787560984.281506:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560984.282243:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853408768 00000100:00100000:2.0:1787560984.282256:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853408768 00000100:00100000:2.0:1787560984.282331:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 32 00000100:00100000:2.0:1787560984.282343:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8c1ddb2-5530-4170-b71a-50058cae7059+7:18719:x1874392853408768:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1787560984.282364:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560984.282397:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35cfc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf460602e9 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560984.282539:0:22740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787560984.282643:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35cfc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602e9 expref: 9 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.282673:0:22740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafd33ffe00) 00010000:00010000:2.0:1787560984.282677:0:22740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787560984.282683:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35cfc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602e9 expref: 9 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.282697:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca48a00, rc 0) 00000100:00100000:2.0:1787560984.282766:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8c1ddb2-5530-4170-b71a-50058cae7059+8:18719:x1874392853408768:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 425us (1271us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1787560984.282773:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 32 00000100:00100000:0.0:1787560984.290728:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560984.291484:0:25786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853409024 00000100:00100000:2.0:1787560984.291495:0:25786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853409024 00000100:00100000:2.0:1787560984.291622:0:25786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:2.0:1787560984.291634:0:25786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8c1ddb2-5530-4170-b71a-50058cae7059+8:18719:x1874392853409024:12345-192.168.203.29@tcp:36:lfs.0 00010000:00010000:2.0:1787560984.291687:0:25786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560984.291713:0:25786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f35cf5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602e2 expref: 8 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.291735:0:25786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9cafd33ff400) 00010000:00010000:2.0:1787560984.291740:0:25786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787560984.291761:0:25786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49c00/0x4642c20bf2f35d0a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.291774:0:25786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49c00/0x4642c20bf2f35d0a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.291782:0:25786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49c00/0x4642c20bf2f35d0a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787560984.291972:0:25786:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057c737a5 reply state 000000001f566687 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49c00/0x4642c20bf2f35d0a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.291984:0:25786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49c00/0x4642c20bf2f35d0a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.291990:0:25786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9cafd33ff400) 00010000:00010000:2.0:1787560984.291993:0:25786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1787560984.291995:0:25786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787560984.292001:0:25786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787560984.292095:0:25786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8c1ddb2-5530-4170-b71a-50058cae7059+9:18719:x1874392853409024:12345-192.168.203.29@tcp:36:lfs.0 Request processed in 463us (1376us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1787560984.292101:0:25786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:0.0:1787560984.307605:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560984.307698:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853409280 00000100:00100000:2.0:1787560984.307709:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853409280 00000100:00100000:2.0:1787560984.307767:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:2.0:1787560984.307777:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8c1ddb2-5530-4170-b71a-50058cae7059+9:18719:x1874392853409280:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:2.0:1787560984.308000:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8c1ddb2-5530-4170-b71a-50058cae7059+10:18719:x1874392853409280:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 223us (408us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1787560984.308009:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:0.0:1787560984.320496:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560984.328364:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853409536 00000100:00100000:2.0:1787560984.328380:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853409536 00000100:00100000:2.0:1787560984.328639:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 34 00000100:00100000:2.0:1787560984.328651:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8c1ddb2-5530-4170-b71a-50058cae7059+10:18719:x1874392853409536:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1787560984.328675:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560984.328696:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35d11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf460602f0 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.328790:0:22740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f35d18 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.328804:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f35d18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.328815:0:22740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f35d18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.328838:0:22740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffc00/0x4642c20bf2f35d1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.328845:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffc00/0x4642c20bf2f35d1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.328852:0:22740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffc00/0x4642c20bf2f35d1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560984.328947:0:22740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787560984.329020:0:22740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f35d18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.329027:0:22740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f35d18 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.329033:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f35d18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.329039:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca48600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560984.329043:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f35d18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.329059:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f35d18 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.329082:0:22740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafd33ffe00) 00010000:00010000:2.0:1787560984.329085:0:22740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560984.329090:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f35d18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.329095:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f35d18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.329109:0:22740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffc00/0x4642c20bf2f35d1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.329114:0:22740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffc00/0x4642c20bf2f35d1f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.329119:0:22740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffc00/0x4642c20bf2f35d1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.329123:0:22740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbffc00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560984.329126:0:22740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffc00/0x4642c20bf2f35d1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.329132:0:22740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffc00/0x4642c20bf2f35d1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.329138:0:22740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9cafd33ffb00) 00010000:00010000:2.0:1787560984.329140:0:22740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560984.329143:0:22740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffc00/0x4642c20bf2f35d1f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.329158:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffc00/0x4642c20bf2f35d1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.329191:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35d11 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602f0 expref: 12 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.329201:0:22740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafd33ffe00) 00010000:00010000:2.0:1787560984.329203:0:22740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787560984.329207:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35d11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602f0 expref: 12 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.329216:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca48a00, rc 0) 00000100:00100000:2.0:1787560984.329283:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8c1ddb2-5530-4170-b71a-50058cae7059+11:18719:x1874392853409536:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 634us (8798us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1787560984.329291:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 34 00000100:00100000:1.0:1787560984.337891:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560984.338063:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853409664 00000100:00100000:3.0:1787560984.338074:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853409664 00000100:00100000:3.0:1787560984.338137:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 35 00000100:00100000:3.0:1787560984.338148:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffba2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8c1ddb2-5530-4170-b71a-50058cae7059+11:18719:x1874392853409664:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1787560984.338175:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560984.338198:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030c00/0x4642c20bf2f35d2d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf460602f7 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.338299:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f35d34 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.338333:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f35d34 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.338344:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f35d34 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560984.338369:0:22742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787560984.338556:0:22742:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787560984.338583:0:22742:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f35d34 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.338614:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030c00/0x4642c20bf2f35d2d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602f7 expref: 13 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.338634:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f35d34 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602f7 expref: 12 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.338642:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9cafd33ff400) 00010000:00010000:3.0:1787560984.338645:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787560984.338649:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafc0030400, rc 0) 00000100:00100000:3.0:1787560984.338711:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffba2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8c1ddb2-5530-4170-b71a-50058cae7059+12:18719:x1874392853409664:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 563us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560984.338719:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 35 00000100:00100000:0.0:1787560984.354032:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560984.354193:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853409792 00000100:00100000:2.0:1787560984.354205:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853409792 00000100:00100000:2.0:1787560984.354276:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:2.0:1787560984.354288:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8c1ddb2-5530-4170-b71a-50058cae7059+12:18719:x1874392853409792:12345-192.168.203.29@tcp:37:lfs.0 00000100:00100000:2.0:1787560984.360402:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8c1ddb2-5530-4170-b71a-50058cae7059+12:18719:x1874392853409792:12345-192.168.203.29@tcp:37:lfs.0 Request processed in 6106us (6369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560984.360416:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:1.0:1787560984.369754:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560984.370075:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853410048 00000100:00100000:0.0:1787560984.370086:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853410048 00000100:00100000:0.0:1787560984.370163:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:0.0:1787560984.370178:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc2c82050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8c1ddb2-5530-4170-b71a-50058cae7059+12:18719:x1874392853410048:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:0.0:1787560984.370649:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc2c82050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8c1ddb2-5530-4170-b71a-50058cae7059+13:18719:x1874392853410048:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 469us (906us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1787560984.370665:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:0.0:1787560984.472323:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560984.472469:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853410176 00000100:00100000:3.0:1787560984.472479:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853410176 00000100:00100000:3.0:1787560984.472548:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 36 00000100:00100000:3.0:1787560984.472560:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafeab10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+11:18725:x1874392853410176:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:3.0:1787560984.472580:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560984.472606:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030c00/0x4642c20bf2f35d3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf460602fe expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.472670:0:22741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35d42 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.472684:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35d42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.472695:0:22741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35d42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.472706:0:22741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f35d49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.472713:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f35d49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.472720:0:22741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f35d49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.472789:0:22741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030600/0x4642c20bf2f35d50 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.472798:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030600/0x4642c20bf2f35d50 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.472805:0:22741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030600/0x4642c20bf2f35d50 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787560984.472849:0:22741:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787560984.472853:0:22741:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787560984.472889:0:22741:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030600/0x4642c20bf2f35d50 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.472907:0:22741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35d42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.472912:0:22741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35d42 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.472918:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35d42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.472923:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc0030800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560984.472927:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35d42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.472934:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35d42 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.472945:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafd33ffe00) 00010000:00010000:3.0:1787560984.472948:0:22741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560984.472952:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35d42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.472957:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35d42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.472970:0:22741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f35d49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.472975:0:22741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f35d49 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.472980:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f35d49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.472990:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc0030200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:3.0:1787560984.472993:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f35d49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.473000:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f35d49 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.473007:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9cafd33ffb00) 00010000:00010000:3.0:1787560984.473010:0:22741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787560984.473013:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f35d49 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.473018:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f35d49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.473043:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030c00/0x4642c20bf2f35d3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602fe expref: 13 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.473056:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030600/0x4642c20bf2f35d50 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602fe expref: 12 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560984.473063:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9cafd33ff400) 00010000:00010000:3.0:1787560984.473065:0:22741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787560984.473067:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafc0030600, rc 0) 00000100:00100000:3.0:1787560984.473225:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafeab10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+12:18725:x1874392853410176:12345-192.168.203.29@tcp:101:bash.0 Request processed in 666us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560984.473232:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 36 00000100:00100000:1.0:1787560984.487039:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560984.487148:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853410304 00000100:00100000:2.0:1787560984.487160:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853410304 00000100:00100000:2.0:1787560984.487224:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:2.0:1787560984.487235:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffba2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+5:18725:x1874392853410304:12345-192.168.203.29@tcp:900:bash.0 00000100:00100000:2.0:1787560984.487331:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffba2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+5:18725:x1874392853410304:12345-192.168.203.29@tcp:900:bash.0 Request processed in 97us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560984.487338:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:1.0:1787560984.495005:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560984.495335:0:25786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853410560 00000100:00100000:2.0:1787560984.495346:0:25786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853410560 00000100:00100000:2.0:1787560984.495410:0:25786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 37 00000100:00100000:2.0:1787560984.495422:0:25786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffba2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca781b59-3c9b-4203-8040-d3d106b1f7b5+12:18725:x1874392853410560:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:2.0:1787560984.495480:0:25786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560984.495501:0:25786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffc00/0x4642c20bf2f35d57 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060305 expref: -99 pid: 25786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.495616:0:25786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f35d5e lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.495632:0:25786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f35d34 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602f7 expref: 12 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.495641:0:25786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f35d5e lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.495673:0:25786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f35d34 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602f7 expref: 12 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.495686:0:25786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f35d34 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602f7 expref: 12 pid: 22742 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560984.495699:0:25786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baf100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25786:1874392862964864:192.168.203.29@tcp:104: 00000100:00100000:2.0:1787560984.496064:0:25786:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc4a336c0 going to sleep for 11 seconds 00000040:00080000:0.0:1787560984.501434:0:22774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787560984.502680:0:25786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baf100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25786:1874392862964864:192.168.203.29@tcp:104: 00010000:00010000:2.0:1787560984.502707:0:25786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f35d5e lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560984.506400:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560984.506807:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853410688 00000100:00100000:2.0:1787560984.506825:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853410688 00010000:00010000:2.0:1787560984.506867:0:22726:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f35d34 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602f7 expref: 13 pid: 22742 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560984.506907:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:2.0:1787560984.506917:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffba2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8c1ddb2-5530-4170-b71a-50058cae7059+13:2404:x1874392853410688:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560984.506931:0:22726:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560984.506938:0:22726:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f35d34 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602f7 expref: 13 pid: 22742 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.506952:0:22726:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f35d34 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602f7 expref: 13 pid: 22742 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.506976:0:22726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030400/0x4642c20bf2f35d34 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf460602f7 expref: 13 pid: 22742 timeout: 803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.506995:0:22726:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9cafd33ff400) 00010000:00010000:2.0:1787560984.507000:0:22726:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f35d5e lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.507011:0:22726:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f35d5e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.507035:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f35d5e lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.507058:0:22726:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560984.507118:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffba2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8c1ddb2-5530-4170-b71a-50058cae7059+12:2404:x1874392853410688:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 201us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560984.507126:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 16 00010000:00010000:0.0:1787560984.508034:0:25786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f35d5e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.508047:0:25786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f35d5e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.508122:0:25786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088800/0x4642c20bf2f35d65 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.508134:0:25786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088800/0x4642c20bf2f35d65 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.508144:0:25786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088800/0x4642c20bf2f35d65 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.509224:0:25786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35d6c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.509237:0:25786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35d6c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.509246:0:25786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35d6c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560984.509259:0:25786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787560984.509302:0:25786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f35d5e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.509312:0:25786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f35d5e lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.509320:0:25786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f35d5e lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.509347:0:25786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbfee00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560984.509351:0:25786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f35d5e lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.509361:0:25786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f35d5e lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.509378:0:25786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9cafd33ff400) 00010000:00010000:0.0:1787560984.509381:0:25786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560984.509386:0:25786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f35d5e lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.509392:0:25786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f35d5e lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787560984.509406:0:25786:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000054dc854b reply state 00000000270f5e52 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088800/0x4642c20bf2f35d65 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.509417:0:25786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088800/0x4642c20bf2f35d65 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.509423:0:25786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9caec2028b00) 00010000:00010000:0.0:1787560984.509426:0:25786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787560984.509468:0:25786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787560984.509504:0:25786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffc00/0x4642c20bf2f35d57 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060305 expref: 15 pid: 25786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.509531:0:25786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35d6c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060305 expref: 14 pid: 25786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.509550:0:25786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9caec2028400) 00010000:00010000:0.0:1787560984.509552:0:25786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1787560984.509555:0:25786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3089000, rc 0) 00000100:00100000:0.0:1787560984.510216:0:25786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffba2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca781b59-3c9b-4203-8040-d3d106b1f7b5+15:18725:x1874392853410560:12345-192.168.203.29@tcp:101:bash.0 Request processed in 14794us (15230us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1787560984.510226:0:25786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 37 00000100:00100000:1.0:1787560984.531676:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560984.532283:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853410816 00000100:00100000:2.0:1787560984.532293:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853410816 00000100:00100000:2.0:1787560984.532400:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 38 00000100:00100000:2.0:1787560984.532411:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffba2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+15:18725:x1874392853410816:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:2.0:1787560984.532463:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560984.532483:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffa00/0x4642c20bf2f35d7a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4606030c expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.532555:0:22740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f35d81 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.532569:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f35d81 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.532580:0:22740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f35d81 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560984.532630:0:22740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787560984.532635:0:22740:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787560984.532659:0:22740:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f35d81 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.532687:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f35d81 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.532712:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffa00/0x4642c20bf2f35d7a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606030c expref: 17 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.532731:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f35d81 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606030c expref: 16 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.532741:0:22740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9caec2028400) 00010000:00010000:2.0:1787560984.532743:0:22740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787560984.532747:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbffe00, rc 0) 00000100:00100000:2.0:1787560984.532845:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffba2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+16:18725:x1874392853410816:12345-192.168.203.29@tcp:101:bash.0 Request processed in 433us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560984.532857:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 38 00000100:00100000:1.0:1787560984.538280:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560984.538389:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853411072 00000100:00100000:0.0:1787560984.538400:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853411072 00000100:00100000:0.0:1787560984.538613:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:0.0:1787560984.538626:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffba2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+16:18725:x1874392853411072:12345-192.168.203.29@tcp:35:bash.0 00000100:00100000:0.0:1787560984.539130:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffba2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+17:18725:x1874392853411072:12345-192.168.203.29@tcp:35:bash.0 Request processed in 502us (856us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1787560984.539146:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:1.0:1787560984.583056:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560984.583128:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560984.583183:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560984.583230:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560984.583265:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560984.583297:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560984.583327:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560984.583358:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560984.583396:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560984.583494:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853411712 00000100:00100000:1.0:1787560984.583504:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853411712 00000100:00100000:1.0:1787560984.583573:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853412224 00000100:00100000:1.0:1787560984.583580:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853412224 00000100:00100000:1.0:1787560984.583603:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853411584 00000100:00100000:1.0:1787560984.583608:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853411584 00000100:00100000:1.0:1787560984.583631:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853412096 00000100:00100000:1.0:1787560984.583636:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853412096 00000100:00100000:1.0:1787560984.583664:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:1.0:1787560984.583679:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+5:2402:x1874392853411712:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560984.583786:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+5:2402:x1874392853411712:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 110us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560984.583800:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:1.0:1787560984.583826:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:1.0:1787560984.583838:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8c1ddb2-5530-4170-b71a-50058cae7059+5:2402:x1874392853412224:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560984.583907:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8c1ddb2-5530-4170-b71a-50058cae7059+5:2402:x1874392853412224:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 71us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560984.583918:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:1.0:1787560984.583938:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:1.0:1787560984.583950:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2006680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+5:2402:x1874392853411584:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560984.583973:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2006680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+5:2402:x1874392853411584:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 27us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560984.583979:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:1.0:1787560984.583989:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:1.0:1787560984.583994:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8c1ddb2-5530-4170-b71a-50058cae7059+5:2402:x1874392853412096:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1787560984.584014:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8c1ddb2-5530-4170-b71a-50058cae7059+5:2402:x1874392853412096:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 20us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560984.584020:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:0.0:1787560984.584357:0:25786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853411456 00000100:00100000:0.0:1787560984.584362:0:25786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853411456 00000100:00100000:0.0:1787560984.584387:0:25786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853411968 00000100:00100000:0.0:1787560984.584390:0:25786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853411968 00000100:00100000:0.0:1787560984.584400:0:25786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853411328 00000100:00100000:0.0:1787560984.584403:0:25786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853411328 00000100:00100000:0.0:1787560984.584413:0:25786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853411840 00000100:00100000:0.0:1787560984.584415:0:25786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853411840 00000100:00100000:0.0:1787560984.584497:0:25786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 54 00000100:00100000:0.0:1787560984.584528:0:25786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffba2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca781b59-3c9b-4203-8040-d3d106b1f7b5+5:2402:x1874392853411456:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560984.584591:0:25786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffba2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca781b59-3c9b-4203-8040-d3d106b1f7b5+5:2402:x1874392853411456:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 66us (1462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560984.584602:0:25786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 54 00000100:00100000:0.0:1787560984.584649:0:25786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 55 00000100:00100000:0.0:1787560984.584662:0:25786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2004380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8c1ddb2-5530-4170-b71a-50058cae7059+5:2402:x1874392853411968:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560984.584700:0:25786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2004380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8c1ddb2-5530-4170-b71a-50058cae7059+5:2402:x1874392853411968:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 40us (1471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560984.584710:0:25786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 55 00000100:00100000:0.0:1787560984.584730:0:25786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 56 00000100:00100000:0.0:1787560984.584743:0:25786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca781b59-3c9b-4203-8040-d3d106b1f7b5+17:2402:x1874392853411328:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560984.584787:0:25786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2006d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca781b59-3c9b-4203-8040-d3d106b1f7b5+17:2402:x1874392853411328:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 46us (1489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560984.584797:0:25786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 56 00000100:00100000:0.0:1787560984.584819:0:25786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 57 00000100:00100000:0.0:1787560984.584830:0:25786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8c1ddb2-5530-4170-b71a-50058cae7059+12:2402:x1874392853411840:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1787560984.584873:0:25786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8c1ddb2-5530-4170-b71a-50058cae7059+12:2402:x1874392853411840:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 44us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560984.584882:0:25786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 57 00000100:00080000:3.0:1787560984.586182:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787560984.586202:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787560984.586313:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853411200 00000100:00100000:3.0:1787560984.586325:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853411200 00000100:00100000:3.0:1787560984.586402:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 165 00000100:00100000:3.0:1787560984.586419:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bb825e1-70be-45ed-969c-e040921081a0+13:2402:x1874392853411200:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1787560984.586569:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bb825e1-70be-45ed-969c-e040921081a0+13:2402:x1874392853411200:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 157us (3524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560984.586577:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 165 00000100:00100000:1.0:1787560984.712818:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560984.712954:0:25786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853412480 00000100:00100000:0.0:1787560984.712963:0:25786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853412480 00000100:00100000:0.0:1787560984.713021:0:25786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 39 00000100:00100000:0.0:1787560984.713030:0:25786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca781b59-3c9b-4203-8040-d3d106b1f7b5+17:18735:x1874392853412480:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:0.0:1787560984.713049:0:25786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560984.713069:0:25786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088000/0x4642c20bf2f35d88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060313 expref: -99 pid: 25786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560984.713154:0:25786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787560984.713234:0:25786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088000/0x4642c20bf2f35d88 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060313 expref: 19 pid: 25786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.713260:0:25786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cafd33ffe00) 00010000:00010000:0.0:1787560984.713263:0:25786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787560984.713268:0:25786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088000/0x4642c20bf2f35d88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060313 expref: 19 pid: 25786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.713282:0:25786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3088000, rc 0) 00000100:00100000:0.0:1787560984.713335:0:25786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca781b59-3c9b-4203-8040-d3d106b1f7b5+18:18735:x1874392853412480:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 306us (526us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1787560984.713341:0:25786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 39 00000100:00100000:1.0:1787560984.718689:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560984.718757:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853412736 00000100:00100000:3.0:1787560984.718768:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853412736 00000100:00100000:3.0:1787560984.719106:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:3.0:1787560984.719118:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+18:18735:x1874392853412736:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:3.0:1787560984.719382:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+19:18735:x1874392853412736:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 265us (701us total) trans 12884901899 rc 0/0 00000100:00100000:3.0:1787560984.719391:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:1.0:1787560984.771088:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560984.771183:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853412992 00000100:00100000:2.0:1787560984.771193:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853412992 00000100:00100000:2.0:1787560984.771254:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00100000:2.0:1787560984.771264:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+19:18738:x1874392853412992:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1787560984.771287:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560984.771306:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffa00/0x4642c20bf2f35d96 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4606031a expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.771501:0:22740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f35d9d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.771527:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f35d9d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.771547:0:22740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f35d9d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560984.771560:0:22740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787560984.771659:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffa00/0x4642c20bf2f35d96 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606031a expref: 22 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.771677:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f35d9d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606031a expref: 21 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.771686:0:22740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9caec2028400) 00010000:00010000:2.0:1787560984.771689:0:22740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787560984.771692:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbff600, rc 0) 00000100:00100000:2.0:1787560984.771754:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+21:18738:x1874392853412992:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 491us (674us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1787560984.771762:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00100000:1.0:1787560984.775175:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560984.775219:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560984.775303:0:25786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853413120 00000100:00100000:0.0:1787560984.775313:0:25786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853413120 00000100:00100000:0.0:1787560984.775386:0:25786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 41 00000100:00100000:0.0:1787560984.775396:0:25786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca781b59-3c9b-4203-8040-d3d106b1f7b5+21:18738:x1874392853413120:12345-192.168.203.29@tcp:54:lfs.0 00010000:00010000:0.0:1787560984.775497:0:25786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088000/0x4642c20bf2f35dab lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.775522:0:25786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088000/0x4642c20bf2f35dab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.775533:0:25786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088000/0x4642c20bf2f35dab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.775565:0:25786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088000/0x4642c20bf2f35dab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.775572:0:25786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088000/0x4642c20bf2f35dab lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.775595:0:25786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088000/0x4642c20bf2f35dab lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.775601:0:25786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3088000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560984.775605:0:25786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088000/0x4642c20bf2f35dab lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.775612:0:25786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088000/0x4642c20bf2f35dab lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.775623:0:25786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9caec2028400) 00010000:00010000:0.0:1787560984.775625:0:25786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787560984.775630:0:25786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088000/0x4642c20bf2f35dab lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560984.775636:0:25786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088000/0x4642c20bf2f35dab lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560984.775694:0:25786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca781b59-3c9b-4203-8040-d3d106b1f7b5+21:18738:x1874392853413120:12345-192.168.203.29@tcp:54:lfs.0 Request processed in 300us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560984.775701:0:25786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 41 00000100:00100000:2.0:1787560984.776305:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853413248 00000100:00100000:2.0:1787560984.776314:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853413248 00000100:00100000:2.0:1787560984.776364:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:2.0:1787560984.776373:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2007100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+21:2404:x1874392853413248:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560984.776395:0:22727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560984.776412:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f35d9d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606031a expref: 21 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560984.776425:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9caec2028400) 00010000:00010000:2.0:1787560984.776588:0:22727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560984.776629:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2007100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+20:2404:x1874392853413248:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 256us (1408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560984.776636:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:1.0:1787560984.779767:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560984.779842:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853413504 00000100:00100000:0.0:1787560984.779852:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853413504 00000100:00100000:0.0:1787560984.779910:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:0.0:1787560984.779921:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+20:18738:x1874392853413504:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:0.0:1787560984.780136:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+21:18738:x1874392853413504:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 217us (378us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1787560984.780143:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00000040:00080000:1.0:1787560984.949119:0:23495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787560985.076830:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787560985.096737:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560985.097706:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853413760 00000100:00100000:2.0:1787560985.097717:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853413760 00000100:00080000:3.0:1787560985.097920:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787560985.097983:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 42 00000100:00100000:2.0:1787560985.097995:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+21:18769:x1874392853413760:12345-192.168.203.29@tcp:101:cat.0 00010000:00010000:2.0:1787560985.098017:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560985.098037:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f35db2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060321 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.098139:0:22740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffa00/0x4642c20bf2f35db9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.098154:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffa00/0x4642c20bf2f35db9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.098166:0:22740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffa00/0x4642c20bf2f35db9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560985.098178:0:22740:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787560985.098299:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f35db2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060321 expref: 24 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.098319:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffa00/0x4642c20bf2f35db9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060321 expref: 23 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.098328:0:22740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9caec2028400) 00010000:00010000:2.0:1787560985.098331:0:22740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787560985.099160:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbffa00, rc 0) 00000100:00100000:2.0:1787560985.099675:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+23:18769:x1874392853413760:12345-192.168.203.29@tcp:101:cat.0 Request processed in 1677us (2941us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1787560985.099684:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 42 00000100:00100000:1.0:1787560985.117599:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560985.117745:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560985.117844:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853414144 00000100:00100000:2.0:1787560985.117854:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853414144 00000100:00100000:2.0:1787560985.117918:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:2.0:1787560985.117929:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3242680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+23:2403:x1874392853414144:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560985.117945:0:22725:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560985.117968:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffa00/0x4642c20bf2f35db9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060321 expref: 23 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.117989:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9caec2028400) 00010000:00010000:2.0:1787560985.117994:0:22725:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560985.118047:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3242680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+22:2403:x1874392853414144:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 120us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560985.118055:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:0.0:1787560985.118228:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853414016 00000100:00100000:0.0:1787560985.118233:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853414016 00000100:00100000:0.0:1787560985.118272:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:0.0:1787560985.118280:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+22:18769:x1874392853414016:12345-192.168.203.29@tcp:35:cat.0 00000100:00100000:0.0:1787560985.118588:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+23:18769:x1874392853414016:12345-192.168.203.29@tcp:35:cat.0 Request processed in 307us (999us total) trans 12884901903 rc 0/0 00000100:00100000:0.0:1787560985.118596:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:3.0:1787560985.192822:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560985.192909:0:25786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853414400 00000100:00100000:0.0:1787560985.192926:0:25786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853414400 00000100:00100000:0.0:1787560985.193009:0:25786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 43 00000100:00100000:0.0:1787560985.193020:0:25786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca781b59-3c9b-4203-8040-d3d106b1f7b5+23:18775:x1874392853414400:12345-192.168.203.29@tcp:101:dd.0 00010000:00010000:0.0:1787560985.193048:0:25786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560985.193077:0:25786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088000/0x4642c20bf2f35dc7 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060328 expref: -99 pid: 25786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.193210:0:25786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089c00/0x4642c20bf2f35dce lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.193231:0:25786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35d6c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060305 expref: 24 pid: 25786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.193242:0:25786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f35d81 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606030c expref: 24 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.193253:0:25786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089c00/0x4642c20bf2f35dce lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.193325:0:25786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f35d81 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606030c expref: 24 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.193363:0:25786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f35d81 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606030c expref: 24 pid: 22740 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560985.193397:0:25786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cafeab10e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25786:1874392862964992:192.168.203.29@tcp:104: 00010000:00010000:0.0:1787560985.193604:0:25786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35d6c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060305 expref: 24 pid: 25786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.193618:0:25786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35d6c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060305 expref: 24 pid: 25786 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560985.193632:0:25786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25786:1874392862965120:192.168.203.29@tcp:104: 00000100:00100000:0.0:1787560985.193669:0:25786:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc59570c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787560985.196105:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560985.196140:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560985.196239:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853414528 00000100:00100000:2.0:1787560985.196248:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853414528 00010000:00010000:2.0:1787560985.196284:0:22727:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f35d81 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606030c expref: 25 pid: 22740 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560985.196324:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853414656 00000100:00100000:2.0:1787560985.196327:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853414656 00010000:00010000:2.0:1787560985.196351:0:22727:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35d6c lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060305 expref: 26 pid: 25786 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560985.196368:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:2.0:1787560985.196395:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3240000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+26:2404:x1874392853414528:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560985.196410:0:22727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560985.196417:0:22727:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f35d81 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606030c expref: 26 pid: 22740 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.196466:0:22727:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f35d81 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606030c expref: 26 pid: 22740 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.196488:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9caec2028400) 00010000:00010000:2.0:1787560985.196494:0:22727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089c00/0x4642c20bf2f35dce lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.196512:0:22727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089c00/0x4642c20bf2f35dce lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.196519:0:22727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560985.196568:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3240000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+26:2404:x1874392853414528:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 175us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560985.196575:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:2.0:1787560985.196593:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:2.0:1787560985.196599:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafdf2c1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+25:2404:x1874392853414656:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787560985.196607:0:22727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560985.196612:0:22727:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35d6c lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060305 expref: 25 pid: 25786 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.196622:0:22727:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35d6c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060305 expref: 25 pid: 25786 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.196644:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9caec2028400) 00010000:00010000:2.0:1787560985.196648:0:22727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089c00/0x4642c20bf2f35dce lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.196655:0:22727:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089c00/0x4642c20bf2f35dce lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.196662:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089c00/0x4642c20bf2f35dce lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.196678:0:22727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560985.196697:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafdf2c1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+25:2404:x1874392853414656:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 98us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560985.196704:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 18 00010000:00010000:0.0:1787560985.197744:0:25786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f35d81 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606030c expref: 24 pid: 22740 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560985.197764:0:25786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cafeab10e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25786:1874392862964992:192.168.203.29@tcp:104: 00010000:00010000:0.0:1787560985.197787:0:25786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35d6c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060305 expref: 23 pid: 25786 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560985.197800:0:25786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25786:1874392862965120:192.168.203.29@tcp:104: 00010000:00010000:0.0:1787560985.197821:0:25786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089c00/0x4642c20bf2f35dce lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.197841:0:25786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089c00/0x4642c20bf2f35dce lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.197847:0:25786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089c00/0x4642c20bf2f35dce lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560985.197867:0:25786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787560985.198018:0:25786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088000/0x4642c20bf2f35dc7 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060328 expref: 24 pid: 25786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.198035:0:25786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089c00/0x4642c20bf2f35dce lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060328 expref: 23 pid: 25786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.198043:0:25786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9caec2028400) 00010000:00010000:0.0:1787560985.198046:0:25786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787560985.198049:0:25786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3089c00, rc 0) 00000100:00100000:0.0:1787560985.198139:0:25786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca781b59-3c9b-4203-8040-d3d106b1f7b5+23:18775:x1874392853414400:12345-192.168.203.29@tcp:101:dd.0 Request processed in 5121us (5346us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1787560985.198146:0:25786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 43 00000100:00100000:1.0:1787560985.217138:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560985.217228:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853414784 00000100:00100000:2.0:1787560985.217536:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853414784 00000100:00100000:2.0:1787560985.217601:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00100000:2.0:1787560985.217612:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+23:18775:x1874392853414784:12345-192.168.203.29@tcp:101:dd.0 00010000:00010000:2.0:1787560985.217691:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560985.217713:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffa00/0x4642c20bf2f35ddc lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4606032f expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.217748:0:22740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f35de3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.217763:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f35de3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.217774:0:22740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f35de3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.217899:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffa00/0x4642c20bf2f35ddc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606032f expref: 25 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.217917:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f35de3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606032f expref: 24 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.217925:0:22740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9caec2028400) 00010000:00010000:2.0:1787560985.217928:0:22740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787560985.217932:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbff600, rc 0) 00000100:00100000:2.0:1787560985.218030:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+24:18775:x1874392853414784:12345-192.168.203.29@tcp:101:dd.0 Request processed in 419us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560985.218037:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00100000:1.0:1787560985.229932:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560985.230028:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853415040 00000100:00100000:2.0:1787560985.230039:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853415040 00000100:00100000:2.0:1787560985.230090:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 45 00000100:00100000:2.0:1787560985.230102:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+24:18775:x1874392853415040:12345-192.168.203.29@tcp:36:dd.0 00010000:00010000:2.0:1787560985.230328:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f35dea lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.230345:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f35dea lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.230356:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f35dea lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787560985.230396:0:22742:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1787560985.230419:0:22742:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037a6209b reply state 000000000acc669f transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f35dea lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.230483:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f35dea lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.230490:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9caec2028400) 00010000:00010000:2.0:1787560985.230493:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787560985.230496:0:22742:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787560985.230587:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+27:18775:x1874392853415040:12345-192.168.203.29@tcp:36:dd.0 Request processed in 486us (665us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1787560985.230595:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 45 00000020:00080000:2.0:1787560985.230600:0:22742:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787560985.231984:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560985.232070:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853415168 00000100:00100000:0.0:1787560985.232084:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853415168 00000100:00100000:0.0:1787560985.232160:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 46 00000100:00100000:0.0:1787560985.232175:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+27:18775:x1874392853415168:12345-192.168.203.29@tcp:101:dd.0 00010000:00010000:0.0:1787560985.232209:0:22741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560985.232237:0:22741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088000/0x4642c20bf2f35df1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060336 expref: -99 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.232332:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088000/0x4642c20bf2f35df1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060336 expref: 28 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.232345:0:22741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088000/0x4642c20bf2f35df1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060336 expref: 28 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.232364:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9caec2028400) 00010000:00010000:0.0:1787560985.232367:0:22741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787560985.232370:0:22741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3088000, rc 0) 00000100:00100000:0.0:1787560985.232501:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+28:18775:x1874392853415168:12345-192.168.203.29@tcp:101:dd.0 Request processed in 329us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560985.232520:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 46 00000100:00100000:1.0:1787560985.243103:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560985.243267:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853415424 00000100:00100000:2.0:1787560985.243281:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853415424 00000100:00100000:2.0:1787560985.243408:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:2.0:1787560985.243423:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3243b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+28:18775:x1874392853415424:12345-192.168.203.29@tcp:103:dd.0 00010000:00010000:2.0:1787560985.243514:0:22727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787560985.243548:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088000/0x4642c20bf2f35df1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060336 expref: 28 pid: 22741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.243577:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9caec2028400) 00010000:00010000:2.0:1787560985.243583:0:22727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787560985.243655:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3243b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+27:18775:x1874392853415424:12345-192.168.203.29@tcp:103:dd.0 Request processed in 236us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560985.243664:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:1.0:1787560985.245548:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560985.245595:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853415552 00000100:00100000:2.0:1787560985.245617:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853415552 00000100:00100000:2.0:1787560985.245688:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 47 00000100:00100000:2.0:1787560985.245699:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+27:18775:x1874392853415552:12345-192.168.203.29@tcp:58:dd.0 00010000:00010000:2.0:1787560985.245841:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffa00/0x4642c20bf2f35df8 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.245858:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffa00/0x4642c20bf2f35df8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.245868:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffa00/0x4642c20bf2f35df8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787560985.247071:0:22742:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787560985.247105:0:22742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1787560985.247225:0:22742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1787560985.247364:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+27:18775:x1874392853415552:12345-192.168.203.29@tcp:58:dd.0 Request processed in 1658us (1818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560985.247376:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 47 00000100:00100000:3.0:1787560985.249338:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560985.249412:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853415680 00000100:00100000:2.0:1787560985.249489:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853415680 00000100:00100000:2.0:1787560985.249628:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 48 00000100:00100000:2.0:1787560985.249641:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+27:18775:x1874392853415680:12345-192.168.203.29@tcp:101:dd.0 00010000:00010000:2.0:1787560985.249680:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560985.249711:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f35dff lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4606033d expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.249792:0:22740:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffa00/0x4642c20bf2f35df8 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.249806:0:22740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f35dff lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606033d expref: 28 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.249830:0:22740:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffa00/0x4642c20bf2f35df8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.249863:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f35dff lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606033d expref: 28 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.249880:0:22740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9caec2028400) 00010000:00010000:2.0:1787560985.249884:0:22740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787560985.249888:0:22740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f35dff lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606033d expref: 28 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.249897:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbffe00, rc 0) 00000100:00100000:2.0:1787560985.249971:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+28:18775:x1874392853415680:12345-192.168.203.29@tcp:101:dd.0 Request processed in 332us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560985.249980:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 48 00000040:00080000:0.0:1787560985.523735:0:22774:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787560985.523747:0:22774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787560985.523786:0:22774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1787560985.523797:0:22774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1787560985.523985:0:22774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22774:1874392862965248:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787560985.524104:0:22774:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc5957000 going to sleep for 11 seconds 00000100:00100000:3.0:1787560985.531094:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560985.531810:0:22774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22774:1874392862965248:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787560985.532363:0:25786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853415808 00000100:00100000:1.0:1787560985.532374:0:25786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853415808 00000100:00100000:2.0:1787560985.532548:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 49 00000100:00100000:2.0:1787560985.532569:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+28:18776:x1874392853415808:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787560985.532647:0:22742:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787560985.532836:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+28:18776:x1874392853415808:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 Request processed in 274us (1760us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560985.532846:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 49 00000100:00100000:3.0:1787560985.536695:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560985.536881:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853415936 00000100:00100000:0.0:1787560985.536895:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853415936 00000100:00100000:0.0:1787560985.536975:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 50 00000100:00100000:0.0:1787560985.536987:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+28:18776:x1874392853415936:12345-192.168.203.29@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787560985.537085:0:22741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e06 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.537125:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e06 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.537139:0:22741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e06 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.539967:0:22741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088c00/0x4642c20bf2f35e0d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.539993:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088c00/0x4642c20bf2f35e0d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.540006:0:22741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088c00/0x4642c20bf2f35e0d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.540301:0:22741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089a00/0x4642c20bf2f35e14 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.540312:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089a00/0x4642c20bf2f35e14 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.540320:0:22741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089a00/0x4642c20bf2f35e14 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560985.540379:0:22741:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787560985.540384:0:22741:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787560985.540401:0:22741:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089a00/0x4642c20bf2f35e14 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.540415:0:22741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e06 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.540461:0:22741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e06 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.540468:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e06 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.540474:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3089000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560985.540479:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e06 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.540486:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e06 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.540508:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cafd33ffc00) 00010000:00010000:0.0:1787560985.540512:0:22741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560985.540516:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e06 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.540522:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e06 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.540539:0:22741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088c00/0x4642c20bf2f35e0d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.540545:0:22741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088c00/0x4642c20bf2f35e0d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.542336:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088c00/0x4642c20bf2f35e0d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.542355:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3088c00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560985.542378:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088c00/0x4642c20bf2f35e0d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.542387:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088c00/0x4642c20bf2f35e0d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.542403:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9caec2028d00) 00010000:00010000:0.0:1787560985.542406:0:22741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560985.542410:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088c00/0x4642c20bf2f35e0d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.542416:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088c00/0x4642c20bf2f35e0d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.542460:0:22741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089a00/0x4642c20bf2f35e14 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.542468:0:22741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089a00/0x4642c20bf2f35e14 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.542474:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089a00/0x4642c20bf2f35e14 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.542479:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3089a00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560985.542481:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089a00/0x4642c20bf2f35e14 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.542487:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089a00/0x4642c20bf2f35e14 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.542495:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9caec2028400) 00010000:00010000:0.0:1787560985.542498:0:22741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560985.542517:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089a00/0x4642c20bf2f35e14 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.542523:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089a00/0x4642c20bf2f35e14 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560985.543970:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+28:18776:x1874392853415936:12345-192.168.203.29@tcp:34:lhsmtool_posix.0 Request processed in 6970us (7278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560985.543987:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 50 00000100:00100000:1.0:1787560985.547466:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560985.548298:0:25786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853416192 00000100:00100000:0.0:1787560985.548321:0:25786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853416192 00000100:00100000:0.0:1787560985.548427:0:25786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 51 00000100:00100000:0.0:1787560985.548515:0:25786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca781b59-3c9b-4203-8040-d3d106b1f7b5+28:18776:x1874392853416192:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787560985.548546:0:25786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560985.549360:0:25786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e1b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060344 expref: -99 pid: 25786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.549543:0:25786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089200/0x4642c20bf2f35e22 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.552632:0:25786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089200/0x4642c20bf2f35e22 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.552660:0:25786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089200/0x4642c20bf2f35e22 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787560985.552688:0:25786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787560985.552812:0:25786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089200/0x4642c20bf2f35e22 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.552821:0:25786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089200/0x4642c20bf2f35e22 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.552845:0:25786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089200/0x4642c20bf2f35e22 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.552852:0:25786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3089200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560985.552857:0:25786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089200/0x4642c20bf2f35e22 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.552865:0:25786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089200/0x4642c20bf2f35e22 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.552878:0:25786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9caec2028400) 00010000:00010000:0.0:1787560985.552882:0:25786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787560985.552886:0:25786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089200/0x4642c20bf2f35e22 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.552892:0:25786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089200/0x4642c20bf2f35e22 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.552960:0:25786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e1b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060344 expref: 30 pid: 25786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.552971:0:25786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cafd33ffc00) 00010000:00010000:0.0:1787560985.552974:0:25786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787560985.552978:0:25786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e1b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060344 expref: 30 pid: 25786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.552987:0:25786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3089000, rc 0) 00000100:00100000:0.0:1787560985.553070:0:25786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca781b59-3c9b-4203-8040-d3d106b1f7b5+29:18776:x1874392853416192:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 4574us (5656us total) trans 12884901907 rc 301/301 00000100:00100000:0.0:1787560985.553089:0:25786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 51 00000100:00100000:3.0:1787560985.559283:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560985.559384:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853416320 00000100:00100000:2.0:1787560985.559400:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853416320 00000100:00100000:2.0:1787560985.559526:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:2.0:1787560985.559543:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+29:18776:x1874392853416320:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787560985.559620:0:22740:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787560985.559827:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+29:18776:x1874392853416320:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 Request processed in 288us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560985.559859:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:3.0:1787560985.571651:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560985.571878:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853416576 00000100:00100000:2.0:1787560985.571899:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853416576 00000100:00100000:2.0:1787560985.572004:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 53 00000100:00100000:2.0:1787560985.572020:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+29:18776:x1874392853416576:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787560985.572051:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560985.572082:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffc00/0x4642c20bf2f35e30 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4606034b expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787560985.572722:0:22742:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x23:0x0], count =31 00000004:00080000:2.0:1787560985.572734:0:22742:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x23:0x0]+31 in llog 00000004:00080000:2.0:1787560985.572762:0:22742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:2.0:1787560985.572982:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f35e37 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.573001:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f35e37 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.573015:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f35e37 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.573097:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffc00/0x4642c20bf2f35e30 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606034b expref: 32 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.573120:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f35e37 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606034b expref: 31 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.573130:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9cafd33ff900) 00010000:00010000:2.0:1787560985.573154:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787560985.573159:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffcbfee00, rc 0) 00000100:00100000:2.0:1787560985.573255:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+31:18776:x1874392853416576:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 1238us (1612us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1787560985.573264:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 53 00000100:00100000:1.0:1787560985.591932:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560985.592643:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853416832 00000100:00100000:0.0:1787560985.592664:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853416832 00000100:00100000:0.0:1787560985.592947:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 54 00000100:00100000:0.0:1787560985.592963:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+31:18776:x1874392853416832:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787560985.593045:0:22741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787560985.593083:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbfee00/0x4642c20bf2f35e37 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606034b expref: 31 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.593107:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9cafd33ff900) 00010000:00010000:0.0:1787560985.593120:0:22741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787560985.593151:0:22741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e45 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.593168:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e45 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.593179:0:22741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e45 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.593216:0:22741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089200/0x4642c20bf2f35e4c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x119884fb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.593224:0:22741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089200/0x4642c20bf2f35e4c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x119884fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.593231:0:22741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089200/0x4642c20bf2f35e4c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x119884fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.593693:0:22741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e45 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.593702:0:22741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e45 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.593709:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e45 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.593715:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3089000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560985.593720:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e45 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.593728:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e45 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.593738:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9cafd33ff400) 00010000:00010000:0.0:1787560985.593741:0:22741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560985.593746:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e45 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.593753:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e45 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.593766:0:22741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089200/0x4642c20bf2f35e4c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x119884fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.593772:0:22741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089200/0x4642c20bf2f35e4c lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x119884fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.593777:0:22741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089200/0x4642c20bf2f35e4c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x119884fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.593791:0:22741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3089200 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560985.593795:0:22741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089200/0x4642c20bf2f35e4c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x119884fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.593802:0:22741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089200/0x4642c20bf2f35e4c lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x119884fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.593811:0:22741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x119884fb (ffff9caec2028d00) 00010000:00010000:0.0:1787560985.593813:0:22741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787560985.593816:0:22741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089200/0x4642c20bf2f35e4c lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x119884fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.593822:0:22741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089200/0x4642c20bf2f35e4c lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x119884fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22741 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560985.594025:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+30:18776:x1874392853416832:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 1063us (2099us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787560985.594035:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 54 00000100:00100000:3.0:1787560985.598081:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560985.598170:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853416960 00000100:00100000:2.0:1787560985.598202:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853416960 00000100:00100000:2.0:1787560985.598373:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 55 00000100:00100000:2.0:1787560985.598398:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+30:18776:x1874392853416960:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787560985.598479:0:22742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560985.598526:0:22742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffc00/0x4642c20bf2f35e53 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060352 expref: -99 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.598579:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35e5a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.598597:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35e5a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.598612:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35e5a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.598779:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffc00/0x4642c20bf2f35e53 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060352 expref: 32 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.598801:0:22742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48a00/0x4642c20bf2f35e5a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060352 expref: 31 pid: 22742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.598812:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9cafd33ff800) 00010000:00010000:2.0:1787560985.598823:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787560985.598828:0:22742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caffca48a00, rc 0) 00000100:00100000:2.0:1787560985.598906:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+31:18776:x1874392853416960:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 520us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560985.598920:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 55 00000100:00100000:1.0:1787560985.603283:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560985.603345:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853417216 00000100:00100000:2.0:1787560985.603361:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853417216 00000100:00100000:2.0:1787560985.603604:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 56 00000100:00100000:2.0:1787560985.603619:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+31:18776:x1874392853417216:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787560985.603769:0:22740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f35e61 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.603790:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f35e61 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.603863:0:22740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f35e61 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787560985.604101:0:22740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:2.0:1787560985.604111:0:22740:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 704943679735ns, next at 705943676915ns, rc = 0 00000004:00010000:2.0:1787560985.604178:0:22740:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079b664b0 reply state 000000005956afd4 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f35e61 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.604202:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f35e61 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.604211:0:22740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9cafd33ff800) 00010000:00010000:2.0:1787560985.604214:0:22740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787560985.604220:0:22740:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787560985.604348:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+33:18776:x1874392853417216:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 731us (1093us total) trans 12884901909 rc 0/0 00000100:00100000:2.0:1787560985.604365:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 56 00000100:00100000:1.0:1787560985.606143:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560985.606321:0:25786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853417344 00000100:00100000:0.0:1787560985.606333:0:25786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853417344 00000100:00100000:0.0:1787560985.606475:0:25786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 57 00000100:00100000:0.0:1787560985.606489:0:25786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca781b59-3c9b-4203-8040-d3d106b1f7b5+33:18776:x1874392853417344:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787560985.606539:0:25786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787560985.606567:0:25786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089200/0x4642c20bf2f35e68 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060359 expref: -99 pid: 25786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.606650:0:25786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089200/0x4642c20bf2f35e68 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060359 expref: 34 pid: 25786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.606684:0:25786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089200/0x4642c20bf2f35e68 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060359 expref: 34 pid: 25786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.606705:0:25786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9cafd33ff800) 00010000:00010000:0.0:1787560985.606707:0:25786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787560985.606711:0:25786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9caec3089200, rc 0) 00000100:00100000:0.0:1787560985.606774:0:25786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca781b59-3c9b-4203-8040-d3d106b1f7b5+34:18776:x1874392853417344:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 289us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560985.606789:0:25786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 57 00000100:00100000:3.0:1787560985.611666:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560985.611847:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853417472 00000100:00100000:2.0:1787560985.611862:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853417472 00000100:00100000:2.0:1787560985.611954:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:2.0:1787560985.611968:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc7752c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+5:2404:x1874392853417472:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787560985.612406:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc7752c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+6:2404:x1874392853417472:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 Request processed in 440us (758us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1787560985.612415:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:1.0:1787560985.616414:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560985.616767:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853417728 00000100:00100000:0.0:1787560985.616850:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853417728 00000100:00100000:0.0:1787560985.616987:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:0.0:1787560985.617003:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+34:18776:x1874392853417728:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787560985.619016:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+35:18776:x1874392853417728:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 2003us (2603us total) trans 12884901910 rc 0/0 00000100:00100000:0.0:1787560985.619031:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:3.0:1787560985.623071:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560985.623325:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853417984 00000100:00100000:0.0:1787560985.623768:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853417984 00000100:00100000:0.0:1787560985.624090:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 58 00000100:00100000:0.0:1787560985.624105:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+35:18776:x1874392853417984:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787560985.624294:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+35:18776:x1874392853417984:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 193us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560985.624303:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 58 00000100:00100000:3.0:1787560985.627957:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560985.629595:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853418112 00000100:00100000:2.0:1787560985.629613:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853418112 00000100:00100000:2.0:1787560985.629705:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 59 00000100:00100000:2.0:1787560985.629716:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+35:18776:x1874392853418112:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787560985.629744:0:22740:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787560985.630142:0:22740:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177000/0x4642c20bf2f35e6f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060360 expref: -99 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.630389:0:22740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177400/0x4642c20bf2f35e76 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.630408:0:22740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177400/0x4642c20bf2f35e76 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.630421:0:22740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177400/0x4642c20bf2f35e76 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787560985.630703:0:22740:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787560985.630729:0:22740:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177400/0x4642c20bf2f35e76 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.630859:0:22740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177000/0x4642c20bf2f35e6f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060360 expref: 37 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.630889:0:22740:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177400/0x4642c20bf2f35e76 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060360 expref: 36 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.630900:0:22740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9cafd33ff800) 00010000:00010000:2.0:1787560985.630904:0:22740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787560985.630909:0:22740:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cb002177400, rc 0) 00000100:00100000:2.0:1787560985.631059:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+36:18776:x1874392853418112:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 1342us (3115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560985.631069:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 59 00000100:00100000:1.0:1787560985.635098:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560985.635165:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853418240 00000100:00100000:3.0:1787560985.635179:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853418240 00000100:00100000:3.0:1787560985.635259:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:3.0:1787560985.635272:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+6:2405:x1874392853418240:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787560985.635295:0:24250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560985.635322:0:24250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025b60759/0x4642c20bf2f35e7d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf46060367 expref: -99 pid: 24250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787560985.635356:0:24250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c0419, blocks: 0x0 00010000:00010000:3.0:1787560985.635381:0:24250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=704s v=(0 0) 00010000:00010000:3.0:1787560985.635387:0:24250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787560985.635399:0:24250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025b60759/0x4642c20bf2f35e7d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060367 expref: 7 pid: 24250 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560985.635421:0:24250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000025b60759/0x4642c20bf2f35e7d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060367 expref: 7 pid: 24250 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560985.635457:0:24250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafc0030c00, rc 0) 00000100:00100000:3.0:1787560985.635545:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+7:2405:x1874392853418240:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 274us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560985.635552:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:3.0:1787560985.638401:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560985.638876:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853418496 00000100:00100000:0.0:1787560985.638907:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853418496 00000100:00100000:1.0:1787560985.639986:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 60 00000100:00100000:1.0:1787560985.640004:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+36:18776:x1874392853418496:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787560985.640290:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+36:18776:x1874392853418496:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 289us (1900us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560985.640299:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 60 00000100:00100000:1.0:1787560985.647008:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560985.647248:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853418624 00000100:00100000:2.0:1787560985.647578:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853418624 00000100:00100000:2.0:1787560985.647714:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 61 00000100:00100000:2.0:1787560985.647728:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+36:18776:x1874392853418624:12345-192.168.203.29@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787560985.651412:0:22720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:3.0:1787560985.651557:0:22720:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1787560985.651609:0:22720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:0.0:1787560985.651909:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49c00/0x4642c20bf2f35d0a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.651926:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49c00/0x4642c20bf2f35d0a lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.651937:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49c00/0x4642c20bf2f35d0a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.651943:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49c00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:0.0:1787560985.651949:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49c00/0x4642c20bf2f35d0a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.651957:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49c00/0x4642c20bf2f35d0a lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.651979:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9cafd33ff400) 00010000:00010000:0.0:1787560985.651983:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1787560985.651990:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49c00/0x4642c20bf2f35d0a lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.651996:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49c00/0x4642c20bf2f35d0a lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560985.652029:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787560985.652222:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862965376:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787560985.652955:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560985.653022:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862965376 00000100:00100000:1.0:1787560985.653042:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862965376 00000100:00100000:1.0:1787560985.653130:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787560985.653145:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862965376:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787560985.653346:0:24249:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787560985.653351:0:24249:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787560985.653353:0:24249:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787560985.653356:0:24249:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1787560985 -> 1787560985 00002000:00010000:1.0:1787560985.653358:0:24249:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00080000:0.0:1787560985.653644:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787560985.653936:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3623:x1874392862965376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 792us (980us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1787560985.653947:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:3.0:1787560985.654219:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9caffcbbad80/2, rc 0, transno 12884901892 00000100:00100000:3.0:1787560985.654228:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862965376:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1787560985.654661:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48000/0x4642c20bf2f35cb6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.654862:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48000/0x4642c20bf2f35cb6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.654871:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48000/0x4642c20bf2f35cb6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.654879:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca48000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560985.654886:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48000/0x4642c20bf2f35cb6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.654903:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48000/0x4642c20bf2f35cb6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.654924:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9cafd33ffb00) 00010000:00010000:2.0:1787560985.654927:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560985.654933:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48000/0x4642c20bf2f35cb6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.654940:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48000/0x4642c20bf2f35cb6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.654967:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35cbd lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.654974:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35cbd lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.654980:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35cbd lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.654985:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca49600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560985.654988:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35cbd lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.654994:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35cbd lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.655001:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9cafd33ff400) 00010000:00010000:2.0:1787560985.655004:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560985.655007:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35cbd lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.655020:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca49600/0x4642c20bf2f35cbd lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.657593:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088800/0x4642c20bf2f35d65 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.657630:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088800/0x4642c20bf2f35d65 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.657640:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088800/0x4642c20bf2f35d65 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.657648:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3088800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560985.657654:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088800/0x4642c20bf2f35d65 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.657665:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088800/0x4642c20bf2f35d65 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.657686:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9caec2028b00) 00010000:00010000:2.0:1787560985.657690:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560985.657696:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088800/0x4642c20bf2f35d65 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.657703:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3088800/0x4642c20bf2f35d65 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.657744:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f35dea lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.657751:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f35dea lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.657796:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f35dea lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.657802:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbff000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560985.657805:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f35dea lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.657812:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f35dea lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.657822:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9caec2028400) 00010000:00010000:2.0:1787560985.657825:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787560985.657828:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f35dea lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.657835:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff000/0x4642c20bf2f35dea lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.657848:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f35e61 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.657854:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f35e61 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.657860:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f35e61 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.657865:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffca48600 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:2.0:1787560985.657869:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f35e61 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.657885:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f35e61 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.657894:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9cafd33ff800) 00010000:00010000:2.0:1787560985.657896:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787560985.657900:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f35e61 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.657905:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffca48600/0x4642c20bf2f35e61 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22740 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560985.658355:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+15:18776:x1874392853418624:12345-192.168.203.29@tcp:44:lhsmtool_posix.0 Request processed in 10623us (11369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560985.658368:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 61 00000100:00100000:2.0:1787560985.670813:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560985.671082:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853418752 00000100:00100000:3.0:1787560985.671098:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853418752 00000100:00100000:3.0:1787560985.671192:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:3.0:1787560985.671204:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+7:2405:x1874392853418752:12345-192.168.203.29@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787560985.671578:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+7:2405:x1874392853418752:12345-192.168.203.29@tcp:16:lhsmtool_posix.0 Request processed in 373us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560985.671587:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:1.0:1787560985.678226:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560985.678394:0:25786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853419008 00000100:00100000:3.0:1787560985.678408:0:25786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853419008 00000100:00100000:3.0:1787560985.678545:0:25786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 62 00000100:00100000:3.0:1787560985.678559:0:25786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca781b59-3c9b-4203-8040-d3d106b1f7b5+15:18776:x1874392853419008:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787560985.678644:0:25786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560985.678694:0:25786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002177400/0x4642c20bf2f35e76 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060360 expref: 15 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560985.678724:0:25786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9cafd33ff800) 00010000:00010000:3.0:1787560985.678731:0:25786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787560985.678794:0:25786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f35e84 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560985.678820:0:25786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f35e84 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560985.678835:0:25786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f35e84 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787560985.679039:0:25786:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ea8fd6d4 reply state 00000000dd42cdb9 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f35e84 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560985.679083:0:25786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030200/0x4642c20bf2f35e84 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560985.679089:0:25786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9cafd33ff800) 00010000:00010000:3.0:1787560985.679093:0:25786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787560985.679096:0:25786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787560985.679261:0:25786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca781b59-3c9b-4203-8040-d3d106b1f7b5+16:18776:x1874392853419008:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 703us (1054us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1787560985.679270:0:25786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 62 00000100:00100000:1.0:1787560985.683007:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560985.683844:0:24248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853419136 00000100:00100000:0.0:1787560985.683862:0:24248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853419136 00000100:00100000:0.0:1787560985.683995:0:24248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 26 00000100:00100000:0.0:1787560985.684008:0:24248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+7:2405:x1874392853419136:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787560985.684248:0:24248:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787560985.684253:0:24248:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1787560984 00002000:00010000:0.0:1787560985.684255:0:24248:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1787560984 00002000:00010000:0.0:1787560985.684258:0:24248:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1787560985 -> 1787560984 00002000:00010000:0.0:1787560985.684261:0:24248:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787560985.684354:0:24248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+8:2405:x1874392853419136:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 Request processed in 347us (1693us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1787560985.684361:0:24248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 26 00000100:00100000:2.0:1787560985.686941:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560985.688319:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853419264 00000100:00100000:1.0:1787560985.688338:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853419264 00000100:00100000:1.0:1787560985.688449:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 27 00000100:00100000:1.0:1787560985.688463:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3baea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+8:2404:x1874392853419264:12345-192.168.203.29@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787560985.688533:0:24249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005283323a/0x4642c20bf2f35e8b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.688558:0:24249:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787560985.688564:0:24249:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560985.688572:0:24249:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005283323a/0x4642c20bf2f35e8b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.688590:0:24249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005283323a/0x4642c20bf2f35e8b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.688639:0:24249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005283323a/0x4642c20bf2f35e8b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.688649:0:24249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005283323a/0x4642c20bf2f35e8b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.688658:0:24249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005283323a/0x4642c20bf2f35e8b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.688685:0:24249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021fe000 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560985.688691:0:24249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005283323a/0x4642c20bf2f35e8b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.688701:0:24249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005283323a/0x4642c20bf2f35e8b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.688722:0:24249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005283323a/0x4642c20bf2f35e8b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.688731:0:24249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005283323a/0x4642c20bf2f35e8b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560985.689277:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3baea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+8:2404:x1874392853419264:12345-192.168.203.29@tcp:1:lhsmtool_posix.0 Request processed in 813us (2353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560985.689289:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 27 00000100:00100000:1.0:1787560985.697991:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560985.698098:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853419520 00000100:00100000:3.0:1787560985.698112:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853419520 00000100:00100000:3.0:1787560985.698207:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 63 00000100:00100000:3.0:1787560985.698222:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+16:18776:x1874392853419520:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787560985.698344:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35e92 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560985.698366:0:22742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f35de3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606032f expref: 16 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560985.698378:0:22742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35e92 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560985.698461:0:22742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f35de3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606032f expref: 16 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560985.698480:0:22742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f35de3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606032f expref: 16 pid: 22740 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560985.698535:0:22742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffb885f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22742:1874392862965504:192.168.203.29@tcp:104: 00000100:00100000:3.0:1787560985.698657:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9caec42eaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787560985.702685:0:22742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffb885f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22742:1874392862965504:192.168.203.29@tcp:104: 00010000:00010000:3.0:1787560985.702727:0:22742:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35e92 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560985.706121:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560985.706364:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853419648 00000100:00100000:3.0:1787560985.706378:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853419648 00010000:00010000:3.0:1787560985.706474:0:22725:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f35de3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606032f expref: 17 pid: 22740 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560985.706529:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:3.0:1787560985.706541:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3242d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+17:2405:x1874392853419648:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560985.706560:0:22725:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560985.706568:0:22725:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f35de3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606032f expref: 17 pid: 22740 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560985.706584:0:22725:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f35de3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606032f expref: 17 pid: 22740 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560985.706610:0:22725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbff600/0x4642c20bf2f35de3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606032f expref: 17 pid: 22740 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560985.706630:0:22725:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9caec2028400) 00010000:00010000:3.0:1787560985.706637:0:22725:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f35dff lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606033d expref: 16 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560985.706668:0:22725:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35e92 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560985.706677:0:22725:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35e92 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560985.706685:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35e92 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560985.706710:0:22725:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560985.706796:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3242d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+16:2405:x1874392853419648:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 257us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560985.706804:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 19 00010000:00010000:0.0:1787560985.707142:0:22742:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35e92 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.707153:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35e92 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.707732:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e99 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.707757:0:22742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089200/0x4642c20bf2f35e68 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060359 expref: 16 pid: 25786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.707766:0:22742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e99 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.707973:0:22742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089200/0x4642c20bf2f35e68 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060359 expref: 16 pid: 25786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.708008:0:22742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089200/0x4642c20bf2f35e68 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060359 expref: 16 pid: 25786 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560985.708026:0:22742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22742:1874392862965632:192.168.203.29@tcp:104: 00000100:00100000:0.0:1787560985.708120:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc59573c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787560985.713173:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560985.713383:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853419776 00000100:00100000:3.0:1787560985.713397:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853419776 00010000:00010000:3.0:1787560985.713489:0:22727:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089200/0x4642c20bf2f35e68 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060359 expref: 17 pid: 25786 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787560985.713551:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:3.0:1787560985.713564:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+17:2405:x1874392853419776:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787560985.713585:0:22727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787560985.713594:0:22727:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089200/0x4642c20bf2f35e68 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060359 expref: 17 pid: 25786 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560985.713610:0:22727:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089200/0x4642c20bf2f35e68 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060359 expref: 17 pid: 25786 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560985.713664:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9cafd33ff800) 00010000:00010000:3.0:1787560985.713670:0:22727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e99 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560985.713681:0:22727:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e99 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560985.713688:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e99 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560985.713711:0:22727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787560985.713785:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+17:2405:x1874392853419776:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 223us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560985.713793:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 20 00010000:00010000:0.0:1787560985.716651:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089200/0x4642c20bf2f35e68 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060359 expref: 16 pid: 25786 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560985.716693:0:22742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22742:1874392862965632:192.168.203.29@tcp:104: 00010000:00010000:0.0:1787560985.716730:0:22742:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e99 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.716741:0:22742:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e99 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.716748:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e99 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787560985.717744:0:22742:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:0.0:1787560985.718004:0:22742:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:0.0:1787560985.718051:0:22742:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:0.0:1787560985.718320:0:22742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffcbb9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22742:1874392862965760:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787560985.718422:0:22742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560985.719019:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc5957c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787560985.719076:0:23481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862965760 00000100:00100000:3.0:1787560985.719087:0:23481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862965760 00000100:00100000:3.0:1787560985.719317:0:23481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787560985.719331:0:23481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22742:x1874392862965760:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787560985.719724:0:23481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22742:x1874392862965760:12345-0@lo:1000:mdt00_002.0 Request processed in 395us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560985.719734:0:23481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787560985.720035:0:22742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffcbb9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22742:1874392862965760:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787560985.720419:0:22742:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:1.0:1787560985.720939:0:22742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3240700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22742:1874392862965888:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787560985.721015:0:22742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560985.721107:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc75ea180 going to sleep for 11 seconds 00000100:00100000:3.0:1787560985.721176:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862965888 00000100:00100000:3.0:1787560985.721311:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862965888 00000100:00100000:3.0:1787560985.721415:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787560985.721475:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22742:x1874392862965888:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787560985.721676:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22742:x1874392862965888:12345-0@lo:1000:mdt00_002.0 Request processed in 249us (660us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1787560985.721711:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787560985.721812:0:22742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3240700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22742:1874392862965888:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787560985.721886:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e99 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.721899:0:22742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e99 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.721908:0:22742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e99 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.721914:0:22742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3089000 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560985.721920:0:22742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e99 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.721929:0:22742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e99 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.721950:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9cafd33ff800) 00010000:00010000:1.0:1787560985.721953:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787560985.721959:0:22742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e99 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.721966:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caec3089000/0x4642c20bf2f35e99 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.722009:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffa00/0x4642c20bf2f35df8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.722016:0:22742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffa00/0x4642c20bf2f35df8 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.722022:0:22742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffa00/0x4642c20bf2f35df8 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.722038:0:22742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caffcbffa00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560985.722041:0:22742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffa00/0x4642c20bf2f35df8 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.722048:0:22742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffa00/0x4642c20bf2f35df8 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.722057:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9caec2028400) 00010000:00010000:1.0:1787560985.722059:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787560985.722068:0:22742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f35dff lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606033d expref: 19 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.722080:0:22742:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f35dff lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606033d expref: 19 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.722090:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f35dff lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606033d expref: 19 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.722158:0:22742:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffe00/0x4642c20bf2f35dff lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606033d expref: 19 pid: 22740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560985.722192:0:22742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3240000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22742:1874392862966016:192.168.203.29@tcp:105: 00000100:00100000:1.0:1787560985.722282:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc75eab40 going to sleep for 11 seconds 00000100:00100000:1.0:1787560985.726925:0:22742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3240000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22742:1874392862966016:192.168.203.29@tcp:105: 00010000:00010000:1.0:1787560985.726972:0:22742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffa00/0x4642c20bf2f35df8 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.727009:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9caffcbffa00/0x4642c20bf2f35df8 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.727059:0:22742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f35ea0 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.727080:0:22742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f35ea0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.727096:0:22742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f35ea0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.727111:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f35ea0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.727119:0:22742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f35ea0 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.727127:0:22742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f35ea0 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.727135:0:22742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb0021ffc00 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560985.727141:0:22742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f35ea0 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.727150:0:22742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f35ea0 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.727300:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9caec2028400) 00010000:00010000:1.0:1787560985.727305:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787560985.727310:0:22742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f35ea0 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.727324:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb0021ffc00/0x4642c20bf2f35ea0 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.727339:0:22742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35e92 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.727345:0:22742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35e92 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.727352:0:22742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35e92 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.727357:0:22742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cafc0030800 already unused, calling callback (ffffffffc1a234f0) 00010000:00010000:1.0:1787560985.727360:0:22742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35e92 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.727366:0:22742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35e92 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.727377:0:22742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9caec2028400) 00010000:00010000:1.0:1787560985.727379:0:22742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787560985.727383:0:22742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35e92 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.727388:0:22742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030800/0x4642c20bf2f35e92 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560985.728020:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ca781b59-3c9b-4203-8040-d3d106b1f7b5+19:18776:x1874392853419520:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 29795us (30220us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1787560985.728033:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 63 00000020:00080000:1.0:1787560985.728049:0:22742:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787560985.729226:0:22774:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787560985.729236:0:22774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787560985.729280:0:22774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1787560985.729294:0:22774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1787560985.735133:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560985.735391:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853419904 00000100:00100000:3.0:1787560985.735406:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853419904 00000100:00100000:3.0:1787560985.735536:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:3.0:1787560985.735549:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc2c82c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+19:18775:x1874392853419904:12345-192.168.203.29@tcp:49:dd.0 00000100:00100000:3.0:1787560985.735808:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc2c82c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+19:18775:x1874392853419904:12345-192.168.203.29@tcp:49:dd.0 Request processed in 260us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560985.735817:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:2.0:1787560985.741011:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1787560985.741758:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853420160 00000100:00100000:3.0:1787560985.741772:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853420160 00000100:00100000:2.0:1787560985.742041:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:2.0:1787560985.742058:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+19:18776:x1874392853420160:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787560985.746576:0:22744:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787560985.747737:0:22744:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00000100:00100000:1.0:1787560985.748211:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00010000:00010000:2.0:1787560985.748827:0:22744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f35ea7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.748972:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f35ea7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.748988:0:22744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f35ea7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.749026:0:22744:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f35ea7 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.749034:0:22744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f35ea7 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.749041:0:22744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f35ea7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.749072:0:22744:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787560985.749329:0:25786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853420288 00000100:00100000:3.0:1787560985.749342:0:25786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853420288 00000100:00100000:3.0:1787560985.749417:0:25786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 64 00000100:00100000:3.0:1787560985.749527:0:25786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca781b59-3c9b-4203-8040-d3d106b1f7b5+22:18775:x1874392853420288:12345-192.168.203.29@tcp:101:dd.0 00010000:00010000:3.0:1787560985.749553:0:25786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787560985.749575:0:25786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0031600/0x4642c20bf2f35eae lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x745b4bcf4606036e expref: -99 pid: 25786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560985.749695:0:25786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030e00/0x4642c20bf2f35eb5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560985.749708:0:25786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030e00/0x4642c20bf2f35eb5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560985.749717:0:25786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030e00/0x4642c20bf2f35eb5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.749946:0:22728:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787560985.749955:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f35ea7 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.749962:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb002176600 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:1.0:1787560985.749967:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f35ea7 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.749975:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f35ea7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.749992:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9cafd33ff800) 00010000:00010000:1.0:1787560985.749995:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787560985.750002:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f35ea7 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.750008:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cb002176600/0x4642c20bf2f35ea7 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22744 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.750028:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560985.750029:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787560985.750031:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787560985.750281:0:25786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0031600/0x4642c20bf2f35eae lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606036e expref: 24 pid: 25786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560985.750310:0:25786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cafc0030e00/0x4642c20bf2f35eb5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf4606036e expref: 23 pid: 25786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787560985.750319:0:25786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9caec2028400) 00010000:00010000:3.0:1787560985.750321:0:25786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787560985.750325:0:25786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cafc0030e00, rc 0) 00000100:00100000:3.0:1787560985.750410:0:25786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ca781b59-3c9b-4203-8040-d3d106b1f7b5+23:18775:x1874392853420288:12345-192.168.203.29@tcp:101:dd.0 Request processed in 980us (2206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560985.750420:0:25786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 64 00000100:00100000:2.0:1787560985.750670:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+23:18776:x1874392853420160:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 8615us (9673us total) trans 12884901918 rc 0/0 00000100:00100000:2.0:1787560985.750680:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 11 00000020:00080000:2.0:1787560985.750685:0:22744:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787560985.793624:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1787560985.794544:0:24253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853420416 00000100:00100000:2.0:1787560985.794561:0:24253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853420416 00000100:00100000:2.0:1787560985.794678:0:24253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:2.0:1787560985.794694:0:24253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+8:2405:x1874392853420416:12345-192.168.203.29@tcp:4:dd.0 00010000:00010000:2.0:1787560985.794746:0:24253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057ff37d3/0x4642c20bf2f35ebc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.795068:0:24253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000025b60759/0x4642c20bf2f35e7d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060367 expref: 8 pid: 24250 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.795081:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560985.795086:0:24253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787560985.795091:0:24253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057ff37d3/0x4642c20bf2f35ebc lrc: 4/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.795153:0:24253:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000025b60759/0x4642c20bf2f35e7d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060367 expref: 8 pid: 24250 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.795169:0:24253:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000025b60759/0x4642c20bf2f35e7d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060367 expref: 8 pid: 24250 timeout: 805 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560985.795188:0:24253:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baf100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:24253:1874392862966144:192.168.203.29@tcp:104: 00000100:00100000:2.0:1787560985.795380:0:24253:0:(client.c:2715:ptlrpc_set_wait()) set ffff9cafc4a333c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787560985.803721:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1787560985.804842:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853420672 00000100:00100000:1.0:1787560985.804864:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853420672 00010000:00010000:1.0:1787560985.804955:0:22726:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000025b60759/0x4642c20bf2f35e7d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060367 expref: 9 pid: 24250 timeout: 805 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560985.805016:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:1.0:1787560985.805029:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffb885f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+9:2404:x1874392853420672:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787560985.805074:0:22726:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787560985.805108:0:22726:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000025b60759/0x4642c20bf2f35e7d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060367 expref: 9 pid: 24250 timeout: 805 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.805127:0:22726:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000025b60759/0x4642c20bf2f35e7d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060367 expref: 9 pid: 24250 timeout: 805 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.805161:0:22726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560985.805168:0:22726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787560985.805176:0:22726:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000057ff37d3/0x4642c20bf2f35ebc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.805187:0:22726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057ff37d3/0x4642c20bf2f35ebc lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787560985.805217:0:22726:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787560985.805299:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffb885f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca781b59-3c9b-4203-8040-d3d106b1f7b5+9:2404:x1874392853420672:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 272us (1595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560985.805308:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 21 00010000:00010000:2.0:1787560985.807878:0:24253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025b60759/0x4642c20bf2f35e7d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x745b4bcf46060367 expref: 8 pid: 24250 timeout: 805 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787560985.807912:0:24253:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baf100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:24253:1874392862966144:192.168.203.29@tcp:104: 00010000:00010000:2.0:1787560985.807946:0:24253:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000057ff37d3/0x4642c20bf2f35ebc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.807961:0:24253:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000057ff37d3/0x4642c20bf2f35ebc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787560985.807969:0:24253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057ff37d3/0x4642c20bf2f35ebc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787560985.809871:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1787560985.810037:0:24255:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787560985.810050:0:24255:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1787560985.810382:0:24255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392853420544 00000100:00100000:1.0:1787560985.810395:0:24255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392853420544 00000100:00100000:0.0:1787560985.814049:0:25787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:0.0:1787560985.814077:0:25787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3be9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ca781b59-3c9b-4203-8040-d3d106b1f7b5+9:2404:x1874392853420544:12345-192.168.203.29@tcp:4:dd.0 00010000:00010000:0.0:1787560985.814126:0:25787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f184f022/0x4642c20bf2f35ec3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.814147:0:25787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560985.814152:0:25787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787560985.814158:0:25787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f184f022/0x4642c20bf2f35ec3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.814176:0:25787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f184f022/0x4642c20bf2f35ec3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787560985.891716:0:24244:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:0.0:1787560985.891737:0:24244:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:0.0:1787560985.895003:0:24253:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1787560985.895013:0:24253:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 1787560984 -> 1787560985 00002000:00010000:0.0:1787560985.895017:0:24253:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1787560984 -> 1787560985 00002000:00010000:0.0:1787560985.895020:0:24253:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:0.0:1787560985.895037:0:24253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057ff37d3/0x4642c20bf2f35ebc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.895051:0:24253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057ff37d3/0x4642c20bf2f35ebc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.895081:0:24253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057ff37d3/0x4642c20bf2f35ebc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.895088:0:24253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cb002176600 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560985.895093:0:24253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057ff37d3/0x4642c20bf2f35ebc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.895100:0:24253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057ff37d3/0x4642c20bf2f35ebc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.895119:0:24253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057ff37d3/0x4642c20bf2f35ebc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.895127:0:24253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057ff37d3/0x4642c20bf2f35ebc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560985.895237:0:24253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ca781b59-3c9b-4203-8040-d3d106b1f7b5+7:2405:x1874392853420416:12345-192.168.203.29@tcp:4:dd.0 Request processed in 100542us (101629us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1787560985.895248:0:24253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 0 00000001:00080000:2.0:1787560985.940379:0:24244:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:0.0:1787560985.940937:0:25787:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:0.0:1787560985.940946:0:25787:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:0.0:1787560985.940975:0:25787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f184f022/0x4642c20bf2f35ec3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.940991:0:25787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f184f022/0x4642c20bf2f35ec3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.941024:0:25787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f184f022/0x4642c20bf2f35ec3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.941032:0:25787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9caec3089a00 already unused, calling callback (ffffffffc0e2b230) 00010000:00010000:0.0:1787560985.941038:0:25787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f184f022/0x4642c20bf2f35ec3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.941047:0:25787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f184f022/0x4642c20bf2f35ec3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.941069:0:25787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f184f022/0x4642c20bf2f35ec3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787560985.941077:0:25787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f184f022/0x4642c20bf2f35ec3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787560985.941269:0:25787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3be9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ca781b59-3c9b-4203-8040-d3d106b1f7b5+5:2404:x1874392853420544:12345-192.168.203.29@tcp:4:dd.0 Request processed in 127196us (131403us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1787560985.941282:0:25787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 1 00010000:00010000:3.0:1787560986.099709:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787560986.167139:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3be8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862966272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787560986.167220:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560986.167463:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862966272 00000100:00100000:1.0:1787560986.167474:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862966272 00000100:00100000:1.0:1787560986.167567:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787560986.167577:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcbb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862966272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787560986.167602:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3676631040 00000100:00100000:1.0:1787560986.167692:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcbb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862966272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560986.167701:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787560986.167927:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3be8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862966272:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787560986.168757:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787560987.123617:0:22729:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787560987.187697:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862966400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787560987.187796:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560987.187925:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862966400 00000100:00100000:2.0:1787560987.187936:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862966400 00000100:00100000:2.0:1787560987.188008:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787560987.188019:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3bac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862966400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787560987.188053:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787560987.188102:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3bac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862966400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560987.188109:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1787560987.188132:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787560987.188175:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862966400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787560987.188683:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffb884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862966528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787560987.188723:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560987.188764:0:23481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862966528 00000100:00100000:3.0:1787560987.188769:0:23481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862966528 00000100:00100000:3.0:1787560987.188803:0:23481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787560987.188946:0:23481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec2ccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862966528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787560987.188975:0:23481:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1787560987.189021:0:23481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec2ccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1874392862966528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560987.189028:0:23481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787560987.189065:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffb884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1874392862966528:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787560987.189700:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862966656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787560987.189738:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560987.189760:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862967168:0@lo:400:kworker.0 00000100:00100000:2.0:1787560987.189784:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560987.189801:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862967680:0@lo:400:kworker.0 00000100:00100000:2.0:1787560987.190132:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560987.190164:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787560987.190171:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862967040:0@lo:400:kworker.0 00000100:00100000:2.0:1787560987.190195:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560987.190214:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862967552:0@lo:400:kworker.0 00000100:00100000:2.0:1787560987.190246:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560987.190264:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874392862968064:0@lo:400:kworker.0 00000100:00100000:2.0:1787560987.190285:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560987.190329:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862966656 00000100:00100000:2.0:1787560987.190336:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862966656 00000100:00100000:2.0:1787560987.193107:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787560987.193143:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862966656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787560987.193188:0:22746:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787560987.193283:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862966656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 150us (3544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560987.193291:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787560987.193325:0:24249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862967040 00000100:00100000:2.0:1787560987.193333:0:24249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862967040 00000100:00100000:2.0:1787560987.193388:0:24249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787560987.193395:0:24249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862967040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560987.193396:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862967168 00000100:00100000:1.0:1787560987.193402:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862967168 00000100:00100000:1.0:1787560987.193428:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862967680 00000100:00100000:1.0:1787560987.193444:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862967680 00000100:00100000:2.0:1787560987.193448:0:24249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1874392862967040:12345-0@lo:400:kworker.0 Request processed in 54us (3252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560987.193455:0:24249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787560987.193459:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862967552 00000100:00100000:1.0:1787560987.193462:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862967552 00000100:00100000:1.0:1787560987.193473:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862968064 00000100:00100000:1.0:1787560987.193476:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862968064 00000100:00100000:2.0:1787560987.193477:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787560987.193484:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caff48fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862967168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560987.193534:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caff48fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1874392862967168:12345-0@lo:400:kworker.0 Request processed in 50us (3749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560987.193570:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787560987.193582:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862967680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560987.193623:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1874392862967680:12345-0@lo:400:kworker.0 Request processed in 44us (3491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560987.193749:0:22740:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787560987.193761:0:22740:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1787560987.194226:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787560987.194256:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787560987.194263:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafc46eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862967552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560987.194307:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafc46eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1874392862967552:12345-0@lo:400:kworker.0 Request processed in 44us (4060us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560987.194314:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787560987.194330:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787560987.194338:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874392862968064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787560987.194368:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1874392862968064:12345-0@lo:400:kworker.0 Request processed in 32us (4082us total) trans 0 rc 0/0 00000100:00100000:2.0:1787560987.194383:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787560987.194421:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787560987.194457:0:3623:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862968192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560987.194510:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560987.194551:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c33dd467-64b2-4362-8604-d1a6489592bb:3625:1874392862966784:0@lo:400:kworker.0 00000100:00100000:1.0:1787560987.194573:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787560987.194583:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862968192 00000100:00100000:2.0:1787560987.194587:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560987.194590:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862968192 00000100:00100000:2.0:1787560987.194635:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caffbaf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862967296:0@lo:400:kworker.0 00000100:00100000:3.0:1787560987.194656:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862966784 00000100:00100000:0.0:1787560987.194660:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862966912:0@lo:400:kworker.0 00000100:00100000:2.0:1787560987.194666:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787560987.194668:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862966784 00000100:00100000:2.0:1787560987.194699:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862967808:0@lo:400:kworker.0 00000100:00100000:0.0:1787560987.194707:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560987.194736:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787560987.194743:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec407dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862967424:0@lo:400:kworker.0 00000100:00100000:2.0:1787560987.194752:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caec3852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862968320:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787560987.194769:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787560987.194770:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560987.194774:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787560987.194787:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862968192:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787560987.194791:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9caff48fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862967936:0@lo:400:kworker.0 00000100:00100000:2.0:1787560987.194801:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862967296 00000100:00100000:2.0:1787560987.194805:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862967296 00000100:00100000:0.0:1787560987.194817:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787560987.194829:0:24250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862967424 00000100:00100000:2.0:1787560987.194832:0:24250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862967424 00000100:00100000:2.0:1787560987.194855:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787560987.194862:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caffcb0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862967296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560987.194863:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:0.0:1787560987.194868:0:3624:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9caffcbbad80, transno 12884901892 00000004:00080000:0.0:1787560987.194878:0:3624:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:3.0:1787560987.194898:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787560987.194902:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862967296:12345-0@lo:400:kworker.0 Request processed in 39us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560987.194902:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862967040:0@lo:400:kworker.0 00000100:00100000:2.0:1787560987.194912:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787560987.194914:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cafcf6b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+24:3625:x1874392862966784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787560987.194920:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1874392862967552:0@lo:400:kworker.0 00000100:00100000:2.0:1787560987.194926:0:24250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787560987.194933:0:24250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862967424:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787560987.194936:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caff48f8700 x1874392862968064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787561003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787560987.194946:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1874392862968064:0@lo:400:kworker.0 00000100:00100000:3.0:1787560987.194965:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cafcf6b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c33dd467-64b2-4362-8604-d1a6489592bb+24:3625:x1874392862966784:12345-0@lo:400:kworker.0 Request processed in 57us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787560987.194969:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1874392862966656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787560987.194976:0:24250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1874392862967424:12345-0@lo:400:kworker.0 Request processed in 44us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787560987.194978:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787560987.194988:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1874392862967168:0@lo:400:kworker.0 00002000:00000024:1.0:1787560987.194989:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3676631040 00000100:00100000:2.0:1787560987.194998:0:24250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787560987.195006:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1874392862967680:0@lo:400:kworker.0 00000100:00100000:2.0:1787560987.195022:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862967808 00000100:00100000:1.0:1787560987.195051:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caffcb09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1874392862968192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 270us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560987.195062:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787560987.195076:0:24252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862968320 00000100:00100000:1.0:1787560987.195080:0:24252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862968320 00000100:00100000:1.0:1787560987.195102:0:24252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787560987.195109:0:24252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862968320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787560987.195120:0:24252:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787560987.195154:0:24252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1874392862968320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560987.195170:0:24252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787560987.195171:0:3623:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3850a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1874392862968192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787560987.195261:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862967808 00000100:00100000:2.0:1787560987.195301:0:22740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862967936 00000100:00080000:1.0:1787560987.195303:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787560987.195305:0:22740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862967936 00000100:00080000:1.0:1787560987.195310:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787560987.195315:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787560987.195318:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787560987.195334:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874392862966912 00000100:00100000:1.0:1787560987.195339:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874392862966912 00000100:00100000:1.0:1787560987.195469:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787560987.195478:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862966912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560987.195531:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1874392862966912:12345-0@lo:400:kworker.0 Request processed in 54us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560987.195539:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787560987.195589:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787560987.195597:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec33c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862967808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560987.195630:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec33c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1874392862967808:12345-0@lo:400:kworker.0 Request processed in 35us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560987.195636:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787560987.195675:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c33dd467-64b2-4362-8604-d1a6489592bb:3625:1874392862966784:0@lo:400:kworker.0 00000100:00100000:1.0:1787560987.195688:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caffbaf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862967296:0@lo:400:kworker.0 00010000:00080000:1.0:1787560987.195699:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9caff48f9180 x1874392862967808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787561003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787560987.195708:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1874392862967808:0@lo:400:kworker.0 00000100:00100000:1.0:1787560987.195722:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3852300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1874392862968320:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787560987.195771:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec3baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1874392862966912:0@lo:400:kworker.0 00000100:00100000:2.0:1787560987.195974:0:22740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787560987.195982:0:22740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9caec3852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862967936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787560987.196006:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caec407dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1874392862967424:0@lo:400:kworker.0 00000100:00100000:2.0:1787560987.196032:0:22740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9caec3852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1874392862967936:12345-0@lo:400:kworker.0 Request processed in 50us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787560987.196033:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9caff48fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1874392862967936:0@lo:400:kworker.0 00000100:00100000:2.0:1787560987.196046:0:22740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1787560987.196111:0:22736:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1787560987.945037:0:25825:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1787560988.147768:0:22728:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787560988.787885:0:22774:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1787560988.787895:0:22774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787560988.787915:0:22774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1787560988.787925:0:22774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1787560989.176039:0:25080:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14248 lines, 14248 kept, 0 dropped, 0 bad.